big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
8,031 Commits 2 Branches 2 Tags 264 MiB
1e7ce76bba
Commit Graph

771 Commits

Author SHA1 Message Date
Owen O'Malley
7730629164 HADOOP-10141. Create KeyProvider API to separate encryption key storage 
from the applications. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552462 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-20 00:25:42 +00:00
Daryn Sharp
011a7b210d HADOOP-10172. Cache SASL server factories (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552389 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-19 18:21:33 +00:00
Jonathan Turner Eagles
a5ec6df324 HADOOP-10171. TestRPC fails intermittently on jkd7 (Mit Desai via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552024 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-18 17:02:58 +00:00
Chris Nauroth
9263f3bb14 HDFS-5596. Implement RPC stubs. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1550544 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 21:47:46 +00:00
Chris Nauroth
709040c52e HDFS-5650. Remove AclReadFlag and AclWriteFlag in FileSystem API. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1550256 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 20:54:46 +00:00
Chris Nauroth
b4d8aabe6b HDFS-5594. FileSystem API for ACLs. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1549910 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-10 17:56:30 +00:00
Colin McCabe
7f059104d2 HADOOP-10142. Avoid groups lookup for unprivileged users such as dr.who (vinay via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548763 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-07 00:11:15 +00:00
Jonathan Turner Eagles
ca9a32c951 HADOOP-10058. TestMetricsSystemImpl#testInitFirstVerifyStopInvokedImmediately fails on trunk (Chen He via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548215 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-05 17:37:13 +00:00
Colin McCabe
08d6213083 HADOOP-10130. RawLocalFS pread does not track FileSystem Statistics (Binglin Chang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547117 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-02 17:28:53 +00:00
Jing Zhao
2214871d91 HDFS-5545. Allow specifying endpoints for listeners in HttpServer. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546151 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-27 18:20:14 +00:00
Jonathan Turner Eagles
18b53b780d HADOOP-10111. Allow DU to be initialized with an initial value (Kihwal Lee via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544239 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-21 16:13:16 +00:00
Arun Murthy
d9ba056bdb HADOOP-10047. Add a direct-buffer based apis for compression. Contributed by Gopal V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543542 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-19 19:29:30 +00:00
Arun Murthy
a6acf72aaa Revert HADOOP-10047, wrong patch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543538 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-19 19:25:31 +00:00
Arun Murthy
b96cc8fdbf HADOOP-10047. Add a direct-buffer based apis for compression. Contributed by Gopal V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543456 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-19 15:38:27 +00:00
Daryn Sharp
1da81363fa HADOOP-9955. RPC idle connection closing is extremely inefficient (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1542111 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-14 22:55:18 +00:00
Bikas Saha
797159bbd4 YARN-1222. Make improvements in ZKRMStateStore for fencing (Karthik Kambatla via bikas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541995 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-14 17:53:25 +00:00
Chris Nauroth
95a87caed0 HADOOP-10094. NPE in GenericOptionsParser#preProcessForWindows(). Contributed by Enis Soztutar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541991 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-14 17:47:44 +00:00
Daryn Sharp
e43255302a HADOOP-9956. RPC listener inefficiently assigns connections to readers (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541736 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 21:37:21 +00:00
Andrew Wang
9d06631719 HDFS-5450. better API for getting the cached blocks locations. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541338 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 00:31:55 +00:00
Colin McCabe
7abf7e8151 HADOOP-9478. Fix race conditions during the initialization of Configuration related to deprecatedKeyMap (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1538248 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-02 18:42:27 +00:00
Andrew Wang
e87b2a3684 merge trunk into HDFS-4949 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1535563 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-24 21:38:25 +00:00
Jonathan Turner Eagles
8ad510bb93 HADOOP-9291. enhance unit-test coverage of package o.a.h.metrics2 (Ivan A. Veselovsky via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1534474 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-22 03:41:49 +00:00
Colin McCabe
e86f4a2e25 HDFS-5276. FileSystem.Statistics should use thread-local counters to avoid multi-threaded performance issues on read/write. (Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1533668 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-19 00:17:37 +00:00
Andrew Wang
da1f4419e3 merge the rest of trunk to branch HDFS-4949 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532967 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-17 05:32:42 +00:00
Jonathan Turner Eagles
b838776163 HADOOP-9078. enhance unit-test coverage of class org.apache.hadoop.fs.FileContext (Ivan A. Veselovsky via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532928 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-16 22:42:12 +00:00
Chris Nauroth
b468160e77 HADOOP-9897. Add method to get path start position without drive specifier in o.a.h.fs.Path. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532880 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-16 20:10:06 +00:00
Andrew Wang
af89caf9e4 HDFS-5359. Allow LightWeightGSet#Iterator to remove elements. (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532153 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-15 00:19:48 +00:00
Suresh Srinivas
4f0089621c HADOOP-10029. Specifying har file to MR job fails in secure cluster. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531125 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-10 21:55:38 +00:00
Chris Nauroth
a75794567b HADOOP-10031. FsShell -get/copyToLocal/moveFromLocal should support Windows local path. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530823 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 22:57:59 +00:00
Chris Nauroth
b7e885435a HADOOP-10030. FsShell -put/copyFromLocal should support Windows local path. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530462 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-08 23:41:53 +00:00
Jonathan Turner Eagles
db8bf2e0a3 HADOOP-9199. Cover package org.apache.hadoop.io with unit tests (Andrey Klochkov via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530404 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-08 19:36:16 +00:00
Vinod Kumar Vavilapalli
21181b6553 YARN-1277. Added a policy based configuration for http/https in common HttpServer and using the same in YARN - related 
to per project https config support via HADOOP-10022. Contributed by Suresh Srinivas and Omkar Vinit Joshi.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1529662 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-06 18:43:36 +00:00
Jason Darrell Lowe
8549c34917 HADOOP-9225. Cover package org.apache.hadoop.compress.Snappy. Contributed by Vadim Bondarev, Andrey Klochkov and Nathan Roberts 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1529296 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-04 20:56:21 +00:00
Jason Darrell Lowe
d9610d5299 HADOOP-9254. Cover packages org.apache.hadoop.util.bloom, org.apache.hadoop.util.hash. Contributed by Vadim Bondarev 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1528620 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-02 20:50:42 +00:00
Jason Darrell Lowe
97a8ebe849 HADOOP-9063. enhance unit-test coverage of class org.apache.hadoop.fs.FileUtil. Contributed by Ivan A. Veselovsky 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1528502 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-02 14:48:12 +00:00
Suresh Srinivas
703838c598 HADOOP-10012. Secure Oozie jobs fail with delegation token renewal exception in Namenode HA setup. Contributed by Daryn Sharp and Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1528301 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-02 04:00:06 +00:00
Suresh Srinivas
4e9c652c52 HADOOP-10003. HarFileSystem.listLocatedStatus() fails. Contributed by Jason Dere and suresh. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1528256 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-01 22:57:59 +00:00
Chris Nauroth
eccdb9aa8b HDFS-5260. Merge zero-copy memory-mapped HDFS client reads to trunk and branch-2. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1527113 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-27 22:51:12 +00:00
Steve Loughran
3caca924bc HADOOP-8545. Filesystem Implementation for OpenStack Swift 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526854 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-27 11:32:53 +00:00
Chris Nauroth
b8f481815b HADOOP-9948. Add a config value to CLITestHelper to skip tests on Windows. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526606 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-26 17:10:13 +00:00
Colin McCabe
8a66e493ba HADOOP-9998. Provide methods to clear only part of the DNSToSwitchMapping. (Junping Du via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526567 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-26 15:24:30 +00:00
Brandon Li
3582026204 HDFS-5246. Make Hadoop nfs server port and mount daemon port configurable. Contributed by Jinghui Wang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526316 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-25 21:59:35 +00:00
Ivan Mitic
43bb7c8d52 HADOOP-9776. HarFileSystem.listStatus() returns invalid authority if port number is empty. Contributed by Shanyu Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526109 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-25 05:17:47 +00:00
Colin McCabe
9a361c5821 HDFS-5191. Revisit zero-copy API in FSDataInputStream to make it more intuitive (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1526020 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-24 21:40:53 +00:00
Arpit Agarwal
eef16dadaf HDFS-5139. Remove redundant -R option from setrep. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525659 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-23 17:57:23 +00:00
Chris Nauroth
0bdeb7d143 HADOOP-9977. Hadoop services won't start with different keypass and keystorepass when https is enabled. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525657 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-23 17:48:38 +00:00
Andrew Wang
aae86e4f3f merge changes from trunk to HDFS-4949 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1524865 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-19 23:42:10 +00:00
Hitesh Shah
8628c1704b YARN-353. Add Zookeeper-based store implementation for RMStateStore. Contributed by Bikas Saha, Jian He and Karthik Kambatla. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524829 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-19 20:39:10 +00:00
Ivan Mitic
3720956a6a HADOOP-9791. Add a test case covering long paths for new FileUtil access check methods. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524631 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-19 06:54:29 +00:00
Colin McCabe
50af34f778 HDFS-5201. NativeIO: consolidate getrlimit into NativeIO#getMemlockLimit. (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1523153 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-14 00:05:29 +00:00
Chris Nauroth
1a1f49fa4f HDFS-5195. Prevent passing null pointer to mlock and munlock. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1523093 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-13 20:47:15 +00:00
Ivan Mitic
40cf0068d8 HADOOP-9924. Addendum patch to address issue with an empty classpath entry on Windows. Contributed by Shanyu Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520903 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-08 19:51:46 +00:00
Andrew Wang
efc1048ffe Revert HADOOP-9877 because of breakage reported in HADOOP-9912 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520713 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-06 22:57:44 +00:00
Jonathan Turner Eagles
6cfcd39165 HADOOP-8704. add request logging to jetty/httpserver (jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520674 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-06 19:40:02 +00:00
Colin McCabe
4f46801111 HADOOP-9915. o.a.h.fs.Stat support on Mac OS X (Contributed by Binglin Chang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520190 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-05 01:46:14 +00:00
Luke Lu
0e0271b5fd HADOOP-9916. Fix race in ipc.Client retry. (Binglin Chang via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1519973 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-04 10:34:28 +00:00
Ivan Mitic
b87bcbb82d HADOOP-9924. FileUtil.createJarWithClassPath() does not generate relative classpath correctly. Contributed by Shanyu Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1519891 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-04 01:16:04 +00:00
Ivan Mitic
2088309d66 HADOOP-9774. RawLocalFileSystem.listStatus() return absolute paths when input path is relative on Windows. Contributed by Shanyu Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1518865 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-30 01:04:35 +00:00
Andrew Wang
87e449fd23 HADOOP-9909. org.apache.hadoop.fs.Stat should permit other LANG. (Shinichi Yamashita via Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1518862 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-30 00:32:03 +00:00
Sanford Ryza
82fc0f1855 Adding and removing files missed for HADOOP-9906 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1518306 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-28 18:03:37 +00:00
Sanford Ryza
f3c0074030 HADOOP-9906. Move HAZKUtil to o.a.h.util.ZKUtil and make inner-classes public (Karthik Kambatla via Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1518303 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-28 17:54:49 +00:00
Jonathan Turner Eagles
e588ffe3c0 HDFS-4329. DFSShell issues with directories with spaces in name (Cristina L. Abad via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516904 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-23 15:48:43 +00:00
Luke Lu
782191f1ba HADOOP-9784. Add a builder for HttpServer. (Junping Du via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516128 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-21 10:12:13 +00:00
Jonathan Turner Eagles
2cd6064195 HADOOP-9686. Easy access to final parameters in Configuration (Jason Lowe via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515984 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-20 21:53:38 +00:00
Andrew Wang
b7a6c5ebb4 HADOOP-9877. Fix listing of snapshot directories in globStatus. (Binglin Chang via Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515955 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-20 20:19:07 +00:00
Colin McCabe
d0b61a169e HADOOP-9875. TestDoAsEffectiveUser can fail on JDK 7. (Aaron T. Myers via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514147 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 03:58:23 +00:00
Andrew Wang
dd00bb71aa merge trunk into HDFS-4949 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1514105 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 00:15:11 +00:00
Suresh Srinivas
0cb5f08149 HADOOP-9381. Document dfs cp -f option. Contributed by Keegan Witt and Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514089 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-14 23:17:55 +00:00
Colin McCabe
fdba5fac26 HADOOP-9652. RawLocalFs#getFileLinkStatus does not fill in the link owner and mode. (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514088 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-14 23:12:55 +00:00
Colin McCabe
70527c8754 merge trunk into HDFS-4949 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1513658 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-13 21:19:53 +00:00
Daryn Sharp
deec7ca21a HADOOP-9757. Har metadata cache can grow without limit (Cristina Abad via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1512465 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-09 19:41:59 +00:00
Colin McCabe
2a4031940c HDFS-5049. Add JNI mlock support. (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1512427 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-09 18:14:07 +00:00
Daryn Sharp
e6c1f2233a HADOOP-9789. Support server advertised kerberos principals (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1512380 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-09 16:28:39 +00:00
Chris Nauroth
f2942687d4 HADOOP-9527. Add symlink support to LocalFileSystem on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1511118 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-06 20:35:52 +00:00
Andrew Wang
95f9a515aa HADOOP-9817. FileSystem#globStatus and FileContext#globStatus need to work with symlinks. (Colin Patrick McCabe via Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510807 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-05 23:28:14 +00:00
Daryn Sharp
63a1273f2a HADOOP-9832. Add RPC header to client ping (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510793 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-05 23:01:27 +00:00
Daryn Sharp
f5312aedb9 HADOOP-9816. RPC Sasl QOP is broken (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510772 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-05 22:02:40 +00:00
Luke Lu
c8e200f2c2 HADOOP-9319. Update bundled LZ4 source to r99. (Binglin Chang via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510734 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-05 21:10:54 +00:00
Chris Nauroth
dc119ef7da HADOOP-9801. Configuration#writeXml uses platform defaulting encoding, which may mishandle multi-byte characters. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509405 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-01 20:03:31 +00:00
Tsz-wo Sze
134557da47 HADOOP-9803. Add a generic type parameter to RetryInvocationHandler. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509070 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-01 02:20:33 +00:00
Sanford Ryza
3ab5f46643 HADOOP-9787. ShutdownHelper util to shutdown threads and threadpools. (Karthik Kambatla via Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509051 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-31 23:42:33 +00:00
Suresh Srinivas
8c7a7e6196 HDFS-5025. Record ClientId and CallId in EditLog to enable rebuilding retry cache in case of HA failover. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1508332 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-30 07:51:38 +00:00
Suresh Srinivas
3be4036abe HADOOP-9792. Retry the methods that are tagged @AtMostOnce along with @Idempotent. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1508312 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-30 06:19:28 +00:00
Chris Nauroth
33552b664b HADOOP-9768. chown and chgrp reject users and groups with spaces on platforms where spaces are otherwise acceptable. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1508305 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-30 05:28:43 +00:00
Jing Zhao
f451228250 HADOOP-9786. RetryInvocationHandler#isRpcInvocation should support ProtocolTranslator. Contributed by Suresh Srinivas and Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1508304 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-30 05:22:32 +00:00
Colin McCabe
f593d57296 revert HADOOP-9652 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1508248 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-29 23:56:59 +00:00
Daryn Sharp
65be212675 HADOOP-9698. [RPC v9] Client must honor server's SASL negotiate response (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1508086 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-29 14:44:21 +00:00
Colin McCabe
16fe97bebf HADOOP-9652. RawLocalFs#getFileLinkStatus does not fill in the link owner and mode. (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507506 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 23:02:37 +00:00
Chris Nauroth
38adf46c02 HADOOP-9507. LocalFileSystem rename() is broken in some cases when destination exists. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507429 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 20:47:05 +00:00
Tsz-wo Sze
a690a215db HADOOP-9756. Remove the deprecated getServer(..) methods from RPC. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507259 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 10:59:20 +00:00
Tsz-wo Sze
42e8cbf92c HADOOP-9773. TestLightWeightCache should not set size limit to zero when testing it. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507165 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 00:55:24 +00:00
Jing Zhao
a0a986dda7 HADOOP-9762. RetryCache utility for implementing RPC retries. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1506426 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-24 07:48:36 +00:00
Jing Zhao
3024030b24 HADOOP-9763. Extends LightWeightGSet to support eviction of expired elements. Contributed by Tsz Wo (Nicholas) SZE. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1506405 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-24 06:26:11 +00:00
Suresh Srinivas
9dbd2e7efc HADOOP-9760. Move GSet and related classes to common from HDFS. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505875 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-23 01:40:58 +00:00
Tsz-wo Sze
3eb61be352 HADOOP-9754. Remove unnecessary "throws IOException/InterruptedException", and fix generic and other javac warnings. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505610 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-22 07:22:14 +00:00
Tsz-wo Sze
9ff01d6261 HADOOP-9751. Add clientId and retryCount to RpcResponseHeaderProto. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505036 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-19 21:49:58 +00:00
Jing Zhao
8724ceb235 HADOOP-9717. Add retry attempt count to the RPC requests. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504725 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 23:44:06 +00:00
Luke Lu
ba3d29a2e2 HADOOP-9164. Print paths of loaded native libraries in NativeLibraryChecker. (Binglin Chang via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504700 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 22:38:36 +00:00
Tsz-wo Sze
7ec67c5118 HADOOP-9716. Rpc retries should use the same call ID as the original call. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504362 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 04:42:56 +00:00
Daryn Sharp
a3a9d72e98 HADOOP-9683. [RPC v9] Wrap IpcConnectionContext in RPC headers (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503811 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 17:59:39 +00:00
Harsh J
adfd2fa314 HADOOP-9241. DU refresh interval is not configurable. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502954 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-14 10:46:37 +00:00
Colin McCabe
a038ec6ceb HADOOP-9703. org.apache.hadoop.ipc.Client leaks threads on stop (Tsuyoshi OZAWA via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502696 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-12 21:36:44 +00:00
Colin McCabe
e1a1c33632 HADOOP-9417. Support for symlink resolution in LocalFileSystem / RawLocalFileSystem. (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502307 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-11 18:10:46 +00:00
Chris Nauroth
da8e962e39 HDFS-4372. Track NameNode startup progress. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502120 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-11 05:35:29 +00:00
Chris Nauroth
0a5f16a89e HADOOP-9691. RPC clients can generate call ID using AtomicInteger instead of synchronizing on the Client instance. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501615 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-09 23:45:57 +00:00
Chris Nauroth
9b252b39df HADOOP-8440. HarFileSystem.decodeHarURI fails for URIs whose host contains numbers. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501424 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-09 18:22:00 +00:00
Suresh Srinivas
eb2a603387 HADOOP-9688. Add globally unique Client ID to RPC requests. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1500843 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-08 17:08:01 +00:00
Colin McCabe
33fe54a25f HADOOP-9416. Add new symlink resolution methods in FileSystem and FileSystemLinkResolver. (awang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1499602 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-03 23:29:08 +00:00
Enis Soztutar
a52d85834d HADOOP-9660 [WINDOWS] Powershell / cmd parses -Dkey=value from command line as [-Dkey, value] which breaks GenericsOptionParser (enis) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1499132 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-02 22:28:44 +00:00
Chris Nauroth
488230551f HADOOP-9678. TestRPC#testStopsAllThreads intermittently fails on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498786 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-02 05:32:17 +00:00
Colin McCabe
805e9b5b6d HADOOP-9676. Make maximum RPC buffer size configurable (Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498737 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-01 23:17:13 +00:00
Arun Murthy
1773893c9a HADOOP-9665. Fixed BlockDecompressorStream#decompress to return -1 rather than throw EOF at end of file. Contributed by Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1497922 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-28 21:05:43 +00:00
Vinod Kumar Vavilapalli
b3a8d99817 YARN-874. Making common RPC to switch to not switch to simple when other mechanisms are enabled and thus fix YARN/MR test failures after HADOOP-9421. Contributed by Daryn Sharp and Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496692 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-26 00:42:26 +00:00
Colin McCabe
03601136dd HADOOP-9355. Abstract Symlink tests to use either FileContext or FileSystem (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496690 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-26 00:35:39 +00:00
Colin McCabe
bf11465847 HADOOP-9355. Abstract symlink tests to use either FileContext or FileSystem. (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496305 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-25 00:22:12 +00:00
Alejandro Abdelnur
2c6a4e1a75 HADOOP-9661. Allow metrics sources to be extended. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496227 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-24 21:41:25 +00:00
Daryn Sharp
5f9b4c14a1 HADOOP-9421. [RPC v9] Convert SASL to use ProtoBuf and provide negotiation capabilities (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495577 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-21 20:09:31 +00:00
Aaron Myers
be3a8b6636 Fix up a little test failure. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494787 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-19 22:29:22 +00:00
Chris Nauroth
44b9959eda HADOOP-9624. TestFSMainOperationsLocalFileSystem failed when the Hadoop test root path has "X" in its name. Contributed by Xi Fang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494363 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-18 23:02:17 +00:00
Chris Nauroth
2e99da4853 HADOOP-9637. Adding Native Fstat for Windows as needed by YARN. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494341 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-18 22:15:26 +00:00
Jason Darrell Lowe
3ab7f86c16 HADOOP-9582. Non-existent file to "hadoop fs -conf" doesn't throw error. Contributed by Ashwin Shankar 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494331 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-18 21:56:25 +00:00
Vinod Kumar Vavilapalli
b9efe6bd4a HADOOP-9649. Promoted YARN service life-cycle libraries into Hadoop Common for usage across all Hadoop projects. Contributed by Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493650 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-17 06:39:33 +00:00
Chris Nauroth
18a4cb4872 HADOOP-9632. TestShellCommandFencer will fail if there is a 'host' machine in the network. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493451 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-16 03:30:05 +00:00
Chris Nauroth
c5821cf38b HADOOP-9638. Parallel test changes caused invalid test path for several HDFS tests on Windows. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492297 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-12 17:21:47 +00:00
Suresh Srinivas
ba6bd09811 HADOOP-8982. TestSocketIOWithTimeout fails on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490124 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-06 04:17:04 +00:00
Suresh Srinivas
8f201a070e HADOOP-9526. TestShellCommandFencer and TestShell fail on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490120 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-06 04:02:24 +00:00
Jason Darrell Lowe
85623a2d75 HADOOP-9287. Parallel-testing hadoop-common. Contributed by Andrey Klochkov 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1488040 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-30 22:43:16 +00:00
Konstantin Boudnik
9f551fa542 HADOOP-9605. Update junit dependency. Contributed by Timothy St. Clair. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487980 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-30 19:09:26 +00:00
Vinod Kumar Vavilapalli
9ae713ef58 HADOOP-9574. Fix for timing issues in the original patch's test-case. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487722 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-30 04:21:57 +00:00
Vinod Kumar Vavilapalli
fdfedf4c31 HADOOP-9574. Added new methods in AbstractDelegationTokenSecretManager for helping YARN ResourceManager to reuse code for RM restart. Contributed by Jian He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487692 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-30 00:52:53 +00:00
Aaron Myers
8c62c46046 HDFS-4298. StorageRetentionManager spews warnings when used with QJM. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485371 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-22 19:37:41 +00:00
Vinod Kumar Vavilapalli
27e6673ec3 MAPREDUCE-5156. Change hadoop examples ProgramDriver to be able to run 1.x examples jar on top of YARN. This change breaks 0.23.x direct usages of ProgramDriver. Contributed by Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485085 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-22 06:36:24 +00:00
Todd Lipcon
d5a6e764dc HADOOP-9220. Unnecessary transition to standby in ActiveStandbyElector. Contributed by Tom White and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482401 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-14 15:37:12 +00:00
Todd Lipcon
e29170e771 HADOOP-9307. BufferedFSInputStream.read returns wrong results after certain seeks. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482377 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-14 15:16:12 +00:00
Todd Lipcon
8a4ff65b3c HADOOP-9459. ActiveStandbyElector can join election even before Service HEALTHY, and results in null data at ActiveBreadCrumb. Contributed by Vinay and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482227 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-14 06:43:47 +00:00
Aaron Myers
945cb2ecaa HADOOP-9485. No default value in the code for hadoop.rpc.socket.factory.class.default. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481200 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 21:45:32 +00:00
Kihwal Lee
a96780013e HADOOP-9549. WebHdfsFileSystem hangs on close(). Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481075 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 16:22:54 +00:00
Suresh Srinivas
ae9a981855 HADOOP-9556. disable HA tests on Windows that fail due to ZooKeeper client connection management bug. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480880 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 05:50:48 +00:00
Tsz-wo Sze
37d6f14560 Merge r1479733 through r1480439 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1480440 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-08 20:20:56 +00:00
Steve Loughran
fa56ccfd53 HADOOP-9540. Expose the InMemoryS3 and S3N FilesystemStores implementations for Unit testing. Hari 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1479985 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-07 17:21:14 +00:00
Tsz-wo Sze
393188c445 Merge r1477868 through r1479732 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479733 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-07 00:17:50 +00:00
Sanjay Radia
725623534c HADOOP-9425 Add error codes to rpc-response (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1479143 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-04 17:51:22 +00:00
Vinod Kumar Vavilapalli
bfc73613fc HADOOP-9511. Adding support for additional input streams (FSDataInputStream and RandomAccessFile) in SecureIOUtils so as to help YARN-578. Contributed by Omkar Vinit Joshi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1479010 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-03 23:43:12 +00:00
Suresh Srinivas
776eb119ac HADOOP-9523. Provide a generic IBM java vendor flag in PlatformName.java to support non-Sun JREs. Contributed by Tian Hong Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478634 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-03 03:36:51 +00:00
Suresh Srinivas
afa786098a HADOOP-9483. winutils support for readlink command. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478592 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-02 22:39:56 +00:00
Suresh Srinivas
1c762c01c4 HADOOP-9043. Disallow in winutils creating symlinks with forwards slashes. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478577 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-02 21:40:36 +00:00
Sanjay Radia
6096cb3435 HDFS-4659 Support setting execution bit for regular files (Brandon Li via sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477994 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-01 13:31:08 +00:00
Christopher Douglas
0728f00282 HADOOP-8608. Add Configuration API for parsing time durations. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477869 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 23:07:21 +00:00
Tsz-wo Sze
faca77f227 Merge r1476453 through r1477867 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477868 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 23:02:35 +00:00
Aaron Myers
bfef63719d HADOOP-9338. FsShell Copy Commands Should Optionally Preserve File Attributes. Contributed by Nick White. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477714 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 16:27:58 +00:00
Suresh Srinivas
30b7a9c49f HADOOP-9413. Add common utils for File#setReadable/Writable/Executable & File#canRead/Write/Execute that work cross-platform. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477376 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 22:12:57 +00:00
Suresh Srinivas
293fb1ec1e HADOOP-9524. Fix ShellCommandFencer to work on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476856 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-28 23:16:47 +00:00
Suresh Srinivas
f5ef2db500 HADOOP-9500. TestUserGroupInformation#testGetServerSideGroups fails on Windows due to failure to find winutils.exe. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476606 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 15:44:33 +00:00
Suresh Srinivas
27b3f84fe5 Merge trunk to HDFS-2802 branch. This involves fixing many conflict with HDFS-4434. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470225 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-20 20:22:21 +00:00
Suresh Srinivas
0b101bd7e8 HDFS-4434. Reverting change r1470089 that merges trunk to HDFS-2802. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470194 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-20 16:57:44 +00:00
Suresh Srinivas
9af0babe7e Merging trunk after fixing conflict with HDFS-4434. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470089 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-20 00:02:43 +00:00
Bikas Saha
7c66645417 HADOOP-9488. FileUtil#createJarWithClassPath only substitutes environment variables from current process environment/does not support overriding when launching new process (Chris Nauroth via bikas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469996 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-19 19:23:35 +00:00
Tsz-wo Sze
0ad27ad3e3 HDFS-4707. Add snapshot methods to FilterFileSystem and fix findbugs warnings. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1469119 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-18 01:28:00 +00:00
Aaron Myers
b7aaa1b74c Merge trunk into the HDFS-347 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1467511 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-12 23:05:28 +00:00
Jason Darrell Lowe
390deffbaf HADOOP-9233. Cover package org.apache.hadoop.io.compress.zlib with unit tests. Contributed by Vadim Bondarev 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467090 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-11 21:17:56 +00:00
Jason Darrell Lowe
3131636249 HADOOP-9222. Cover package with org.apache.hadoop.io.lz4 unit tests. Contributed by Vadim Bondarev 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467072 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-11 20:16:49 +00:00
Luke Lu
4edf48c7ad HADOOP-9467. Metrics2 record filter should check name as well as tags. (Ganeshan Iyler via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466377 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-10 08:25:37 +00:00
Suresh Srinivas
2b19054c92 HADOOP-9437. TestNativeIO#testRenameTo fails on Windows due to assumption that POSIX errno is embedded in NativeIOException. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466306 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-10 00:45:47 +00:00
Todd Lipcon
f0351527d5 HDFS-4643. Fix flakiness in TestQuorumJournalManager. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466253 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-09 21:34:12 +00:00
Todd Lipcon
087acf8fd6 HDFS-3981. Fix handling of FSN lock in getBlockLocations. Contributed by Xiaobo Peng and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465751 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-08 19:57:16 +00:00
Aaron Myers
a9d515aed8 HDFS-1804. Add a new block-volume device choosing policy that looks at free space. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465183 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-06 04:08:09 +00:00
Suresh Srinivas
28c74a21ea HADOOP-9429. TestConfiguration fails with IBM JAVA. Contributed by Amir Sanjar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464725 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-04 20:26:20 +00:00
Luke Lu
ab850368e8 HADOOP-9451. Fault single-layer config if node group topology is enabled. (Junping Du via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464301 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-04 07:07:59 +00:00
Alejandro Abdelnur
da0e779e4b HADOOP-9401. CodecPool: Add counters for number of (de)compressors leased out. (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464219 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-03 22:26:47 +00:00
Eli Collins
0e9f61addc Revert initial HADOOP-9357 patch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464182 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-03 19:43:29 +00:00
Todd Lipcon
c45c8ee720 Complete commit of prior merge. 
The previous merge accidentally only committed the hdfs project instead of common and MR
as well.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1463203 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-01 16:47:16 +00:00
Todd Lipcon
1611b51a97 HADOOP-9150. Avoid unnecessary DNS resolution attempts for logical URIs. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1462303 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-28 20:58:45 +00:00
Eli Collins
799e3c344e HADOOP-9357. Fallback to default authority if not specified in FileContext. Contributed by Andrew Wang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461898 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-27 23:43:45 +00:00
Aaron Myers
fc5fd80e9f HADOOP-9125. LdapGroupsMapping threw CommunicationException after some idle time. Contributed by Kai Zheng. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461863 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-27 21:49:43 +00:00
Luke Lu
5319818487 HADOOP-9194. RPC Support for QoS. (Junping Du via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461370 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-26 23:29:09 +00:00
Sanjay Radia
5e325d4562 HADOOP-9433 TestLocalFileSystem#testHasFileDescriptor leaks file handle (Chris Nauroth via sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1460922 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-25 22:30:30 +00:00
Steve Loughran
a10055cf6d HADOOP-9258 Add stricter tests to FileSystemContractTestBase (includes fixes for production code HADOOP-9261 & HADOOP-9265 and test enhancements HADOOP-9228, HADOOP-9227 & HADOOP-9259) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1460646 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-25 13:12:27 +00:00
Sanjay Radia
1186572389 HADOOP-9431 TestSecurityUtil#testLocalHostNameForNullOrWild on systems where hostname contains capital letters (Chris Nauroth via sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1460181 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-23 16:07:48 +00:00
Tsz-wo Sze
883601a1d6 HADOOP-9387. Fix DF so that it won't execute a shell command on Windows to compute the file system/mount point. Contributed by Ivan Mitic 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459642 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-22 06:26:52 +00:00
Aaron Myers
64741f4635 HDFS-4521. Invalid network toploogies should not be cached. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457878 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-18 17:20:13 +00:00
Daryn Sharp
7eb7b3b723 HADOOP-9299. kerberos name resolution is kicking in even when kerberos is not configured (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457763 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-18 13:46:52 +00:00
Aaron Myers
c2003ab56b HADOOP-9318. When exiting on a signal, print the signal name first. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457122 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-15 21:16:41 +00:00
Aaron Myers
3bf09c5150 HDFS-4591. HA clients can fail to fail over while Standby NN is performing long checkpoint. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456107 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 19:51:19 +00:00
Suresh Srinivas
ebf2e6b363 HADOOP-9099. NetUtils.normalizeHostName fails on domains where UnknownHost resolves to an IP address. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455629 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-12 17:11:35 +00:00
Aaron Myers
f75592f16e HADOOP-9393. TestRPC fails with JDK7. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455418 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-12 06:26:07 +00:00
Suresh Srinivas
f5227eb51c HADOOP-8973. DiskChecker cannot reliably detect an inaccessible disk on Windows with NTFS ACLs. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454889 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-10 18:17:41 +00:00
Suresh Srinivas
a3c4488efd HADOOP-9364. PathData#expandAsGlob does not return correct results for absolute paths on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454108 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 21:32:12 +00:00
Daryn Sharp
6d4ab86412 HADOOP-9374. Add tokens from -tokenCacheFile into UGI (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454019 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 19:22:44 +00:00
Suresh Srinivas
33b3bcd357 HADOOP-9365. TestHAZKUtil fails on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453676 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 03:42:18 +00:00
Suresh Srinivas
97605f27e7 HADOOP-9376. TestProxyUserFromEnv fails on a Windows domain joined machine. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453675 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 03:34:44 +00:00
Suresh Srinivas
6942fd1db5 HADOOP-9372. Fix bad timeout annotations on tests. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453637 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 01:09:53 +00:00
Jonathan Turner Eagles
b427fe9de8 HADOOP-9209. Add shell command to dump file checksums (Todd Lipcon via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453613 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 23:17:14 +00:00
Jason Darrell Lowe
85470f0a33 HADOOP-8462. Native-code implementation of bzip2 codec. Contributed by Govind Kamat 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453608 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 23:10:12 +00:00
Suresh Srinivas
638801cce1 HADOOP-8952. Enhancements to support Hadoop on Windows Server and Windows Azure environments. Contributed by Ivan Mitic, Chuan Liu, Ramya Sunil, Bikas Saha, Kanna Karanam, John Gordon, Brandon Li, Chris Nauroth, David Lao, Sumadhur Reddy Bolli, Arpit Agarwal, Ahmed El Baz, Mike Liddell, Jing Zhao, Thejas Nair, Steve Maine, Ganeshan Iyer, Raja Aluri, Giridharan Kesavan, Ramya Bharathi Nimmagadda. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453486 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 19:15:18 +00:00
Siddharth Seth
52703c2d0d HADOOP-9343. Allow additional exceptions through the RPC layer. (sseth) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452918 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 17:56:17 +00:00
Aaron Myers
cc15fff263 HADOOP-9337. org.apache.hadoop.fs.DF.getMount() does not work on Mac OS. Contributed by Ivan A. Veselovsky. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452622 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 01:30:05 +00:00
Daryn Sharp
84567faa92 HADOOP-9352. Expose UGI.setLoginUser for tests (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452338 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-04 14:59:41 +00:00
Alejandro Abdelnur
892e088773 HADOOP-9349. Confusing output when running hadoop version from one hadoop installation when HADOOP_HOME points to another. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451448 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-01 01:20:53 +00:00
Kihwal Lee
c5368561f9 HADOOP-9336. Allow UGI of current connection to be queried. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451376 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-28 22:01:51 +00:00
Kihwal Lee
eb1cc863d2 HADOOP-9339. IPC.Server incorrectly sets UGI auth type. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450963 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-27 21:16:09 +00:00