big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
7,685 Commits 2 Branches 2 Tags 264 MiB
3671a5e16f
Commit Graph

1144 Commits

Author SHA1 Message Date
Jason Darrell Lowe
85470f0a33 HADOOP-8462. Native-code implementation of bzip2 codec. Contributed by Govind Kamat 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453608 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 23:10:12 +00:00
Suresh Srinivas
638801cce1 HADOOP-8952. Enhancements to support Hadoop on Windows Server and Windows Azure environments. Contributed by Ivan Mitic, Chuan Liu, Ramya Sunil, Bikas Saha, Kanna Karanam, John Gordon, Brandon Li, Chris Nauroth, David Lao, Sumadhur Reddy Bolli, Arpit Agarwal, Ahmed El Baz, Mike Liddell, Jing Zhao, Thejas Nair, Steve Maine, Ganeshan Iyer, Raja Aluri, Giridharan Kesavan, Ramya Bharathi Nimmagadda. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453486 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 19:15:18 +00:00
Siddharth Seth
52703c2d0d HADOOP-9343. Allow additional exceptions through the RPC layer. (sseth) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452918 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 17:56:17 +00:00
Aaron Myers
cc15fff263 HADOOP-9337. org.apache.hadoop.fs.DF.getMount() does not work on Mac OS. Contributed by Ivan A. Veselovsky. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452622 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 01:30:05 +00:00
Sanjay Radia
ead90cc1a8 HADOOP-9163 The rpc msg in ProtobufRpcEngine.proto should be moved out to avoid an extra copy (Sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452581 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-04 22:55:22 +00:00
Daryn Sharp
84567faa92 HADOOP-9352. Expose UGI.setLoginUser for tests (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452338 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-04 14:59:41 +00:00
Alejandro Abdelnur
892e088773 HADOOP-9349. Confusing output when running hadoop version from one hadoop installation when HADOOP_HOME points to another. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451448 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-01 01:20:53 +00:00
Kihwal Lee
c5368561f9 HADOOP-9336. Allow UGI of current connection to be queried. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451376 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-28 22:01:51 +00:00
Kihwal Lee
eb1cc863d2 HADOOP-9339. IPC.Server incorrectly sets UGI auth type. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450963 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-27 21:16:09 +00:00
Suresh Srinivas
9e87bcb3ad HADOOP-8917. add LOCALE.US to toLowerCase in SecurityUtil.replacePattern. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450571 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-27 01:34:39 +00:00
Aaron Myers
9397260411 HADOOP-7487. DF should throw a more reasonable exception when mount cannot be determined. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449992 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-26 01:37:28 +00:00
Suresh Srinivas
4840775e3d HADOOP-9323. Fix typos in API documentation. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449977 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-26 00:10:35 +00:00
Tsz-wo Sze
59e968a114 HDFS-4514. Add CLI for supporting snapshot rename, diff report, and snapshottable directory listing. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449956 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-25 23:14:58 +00:00
Aaron Myers
f61581501a Merge trunk into HDFS-347 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1446832 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-16 01:12:07 +00:00
Aaron Myers
3a417cbf1d HDFS-347: style cleanups. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1446830 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-16 00:59:01 +00:00
Suresh Srinivas
a9f6a27e93 Merge trunk to HDFS-2802 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1446507 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-15 10:57:34 +00:00
Sanjay Radia
461e614a3a HADOOP-9218 Document the Rpc-wrappers used internally (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1446428 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-15 02:26:46 +00:00
Thomas White
c01827aa48 HADOOP-9154. SortedMapWritable#putAll() doesn't add key/value classes to the map. Contributed by Karthik Kambatla. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1446183 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-14 14:07:33 +00:00
Aaron Myers
a3ddc8ef96 HADOOP-9305. Add support for running the Hadoop client on 64-bit AIX. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445884 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-13 19:42:13 +00:00
Alejandro Abdelnur
7e615c7f75 MAPREDUCE-4994. -jt generic command line option does not work. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445330 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-12 20:16:08 +00:00
Tsz-wo Sze
fa8bafbd46 Merge r1441206 through r1444434 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1444439 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-09 21:29:44 +00:00
Suresh Srinivas
c3d09010c7 HADOOP-9277. Improve javadoc for FileContext. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443710 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-07 20:38:29 +00:00
Aaron Myers
411bb0bd99 HADOOP-9283. Add support for running the Hadoop client on AIX. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443303 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-07 03:13:14 +00:00
Suresh Srinivas
8159dad856 HADOOP-9289. FsShell rm -f fails for non-matching globs. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443108 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-06 18:20:54 +00:00
Tsz-wo Sze
0b565a967d HADOOP-9278. Fix the file handle leak in HarMetaData.parseMetaData() in HarFileSystem. Contributed by Chris Nauroth 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442755 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-05 21:23:29 +00:00
Aaron Myers
5a0b746639 HDFS-4404. Create file failure when the machine of first attempted NameNode is down. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442461 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-05 03:18:14 +00:00
Tsz-wo Sze
ef2ff99d36 HADOOP-9252. In StringUtils, humanReadableInt(..) has a race condition and the synchronization of limitDecimalTo2(double) can be avoided. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442386 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-04 21:40:59 +00:00
Hitesh Shah
114e23f7bd HADOOP-9276. Allow BoundedByteArrayOutputStream to be resettable. Contributed by Arun Murthy 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442312 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-04 19:42:51 +00:00
Thomas White
af8553b9fe HADOOP-9124. SortedMapWritable violates contract of Map interface for equals() and hashCode(). Contributed by Surenkumar Nihalani 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441475 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-01 15:03:35 +00:00
Tsz-wo Sze
40df526bd3 Merge r1440222 through r1441205 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1441206 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 21:39:42 +00:00
Suresh Srinivas
71a57ded39 HADOOP-9264. Port change to use Java untar API on Windows from branch-1-win to trunk. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441172 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 20:13:01 +00:00
Suresh Srinivas
b04586e7eb HADOOP-9264. Reverting r1441164 and wait for Jenkins results before committing the patch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441166 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 19:49:06 +00:00
Suresh Srinivas
e6ef76999f HADOOP-9264. Port change to use Java untar API on Windows from branch-1-win to trunk. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441164 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 19:45:28 +00:00
Aaron Myers
e7380b4f9c HDFS-4428. FsDatasetImpl should disclose what the error is when a rename fails. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440865 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 07:29:46 +00:00
Aaron Myers
dcd27ff778 Merge trunk into HDFS-347 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1440579 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-30 18:32:00 +00:00
Konstantin Shvachko
481b6cccf0 HDFS-3598. WebHDFS support for file concat. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440290 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-30 06:51:57 +00:00
Harsh J
159b991e72 Reverting HADOOP-9241. To be fixed and reviewed. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439748 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 05:33:02 +00:00
Harsh J
96d724b441 HADOOP-9241. DU refresh interval is not configurable. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439129 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-27 17:52:16 +00:00
Tsz-wo Sze
74d1e5c302 Merge r1432789 through r1437840 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1437843 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-24 02:45:45 +00:00
Todd Lipcon
f5ab88b5b7 Fix trivial javadoc warning on branch 
(javadoc references parameter 'defaultVal' but it is actually 'defaultValue')


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437797 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-23 23:18:57 +00:00
Todd Lipcon
797465820b Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437623 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-23 18:51:24 +00:00
Todd Lipcon
89bd14913a HDFS-4416. Rename dfs.datanode.domain.socket.path to dfs.domain.socket.path. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1436568 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-21 19:29:06 +00:00
Suresh Srinivas
ae270e72cf HADOOP-8924. Add maven plugin alternative to shell script to save package-info.java. Contributed by Alejandro Abdelnur and Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435380 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-18 22:35:58 +00:00
Suresh Srinivas
f8cca2df8a HADOOP-8924. Revert r1435372 that missed some files 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435379 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-18 22:32:49 +00:00
Suresh Srinivas
98db9f5930 HADOOP-8924. Add maven plugin alternative to shell script to save package-info.java. Contributed by Alejandro Abdelnur and Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435372 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-18 22:18:12 +00:00
Robert Joseph Evans
5c5e6ed13a HADOOP-8849. FileUtil#fullyDelete should grant the target directories +rwx permissions (Ivan A. Veselovsky via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434868 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-17 19:19:10 +00:00
Todd Lipcon
db17fadd38 HADOOP-9216. CompressionCodecFactory#getCodecClasses should trim the result of parsing by Configuration. Contributed by Tsuyoshi Ozawa. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434569 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-17 07:19:41 +00:00
Thomas White
0d143ad723 HADOOP-9212. Potential deadlock in FileSystem.Cache/IPC/UGI. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433879 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-16 10:20:11 +00:00
Suresh Srinivas
06f086dd23 HADOOP-9106. Allow configuration of IPC connect timeout. Contributed by Rober Parker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433747 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 23:54:21 +00:00
Alejandro Abdelnur
8ab69eb0c3 HADOOP-8816. HTTP Error 413 full HEAD if using kerberos authentication. (moritzmoeller via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433567 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 18:27:30 +00:00
Eli Collins
e6dbad4f6f HADOOP-9178. src/main/conf is missing hadoop-policy.xml. Contributed by Sandy Ryza 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433275 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 03:25:12 +00:00
Todd Lipcon
2f4e2c607e Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433249 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:42:06 +00:00
Todd Lipcon
2fd41b3b42 HDFS-4402. Some small DomainSocket fixes: avoid findbugs warning, change log level, etc. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433242 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:31:35 +00:00
Suresh Srinivas
6d807fcab1 HADOOP-9203. RPCCallBenchmark should find a random available port. Contributec by Andrew Purtell. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433220 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 23:48:50 +00:00
Todd Lipcon
12bf674e8e Merge trunk into branch. 
Fixed a couple trivial conflicts due to HDFS-4363, which moved some methods
from HdfsProtoUtil to PBHelper


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433133 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 21:12:16 +00:00
Tsz-wo Sze
90d6d55a4b Merge r1426019 through r1432788 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432796 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 03:44:35 +00:00
Konstantin Shvachko
06406d7056 HDFS-1245. Plugable block id generation. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432539 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-13 01:13:29 +00:00
Todd Lipcon
6f8ee865de HDFS-4388. DomainSocket should throw AsynchronousCloseException when appropriate. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1432339 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-12 00:12:30 +00:00
Todd Lipcon
9a4030e0e8 HDFS-4356. BlockReaderLocal should use passed file descriptors rather than paths. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1432335 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 23:52:22 +00:00
Suresh Srinivas
93c1b4b25a Merge r1414455:r1426018 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432246 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 19:40:23 +00:00
Eric Yang
a8d60f4190 HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431739 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-10 23:58:11 +00:00
Thomas White
d863f7a1e4 HADOOP-9183. Potential deadlock in ActiveStandbyElector. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431251 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-10 10:05:53 +00:00
Aaron Myers
7e599d9e3b HADOOP-9155. FsPermission should have different default value, 777 for directory and 666 for file. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431148 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 23:30:41 +00:00
Todd Lipcon
d94621a0cd HDFS-4354. Create DomainSocket and DomainPeer and associated unit tests. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1431102 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 21:37:34 +00:00
Todd Lipcon
c9db06f2e4 HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1431097 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 21:34:13 +00:00
Tsz-wo Sze
2d4097840c HDFS-4244. Support snapshot deletion. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1430953 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 16:44:05 +00:00
Tsz-wo Sze
837e17b2ea svn merge -c -1430507 . for reverting HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430662 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 02:39:15 +00:00
Todd Lipcon
239b2742d0 HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430507 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 20:44:09 +00:00
Suresh Srinivas
f6ae596d1e HADOOP-9181. Set daemon flag for HttpServer's QueuedThreadPool. Contributed by Liang Xie. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429810 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-07 14:33:52 +00:00
Aaron Myers
0af8890b1a Add file which was accidentally missed during commit of HDFS-4346. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428560 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 19:20:52 +00:00
Suresh Srinivas
9ad8639e1c HADOOP-9162. Add utility to check native library availability. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425390 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-23 02:08:50 +00:00
Robert Joseph Evans
557b022406 HADOOP-9105. FsShell -moveFromLocal erroneously fails (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424566 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-20 16:19:48 +00:00
Thomas White
834e941044 HADOOP-9153. Support createNonRecursive in ViewFileSystem. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423824 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-19 11:14:15 +00:00
Aaron Myers
371abd6e21 HADOOP-9152. HDFS can report negative DFS Used on clusters with very small amounts of data. Contributed by Brock Noland. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423602 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-18 19:49:14 +00:00
Suresh Srinivas
7d8057707f HADOOP-9147. Add missing fields to FIleStatus.toString. Contributed by Jonathan Allen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423444 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-18 14:23:53 +00:00
Sanjay Radia
aa4fe26a01 HADOOP-9140 Cleanup rpc PB protos (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423189 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-17 22:16:57 +00:00
Luke Lu
3689933b26 HADOOP-9041. FsUrlStreamHandlerFactory could cause an infinite loop in FileSystem initialization. (Yanbo Liang and Radim Kolar via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422430 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-16 00:39:17 +00:00
Luke Lu
db09dba7ae HADOOP-8561. Introduce HADOOP_PROXY_USER for secure impersonation in child hadoop client processes. (Yu Gao via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422429 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-16 00:38:59 +00:00
Todd Lipcon
0e7e20de64 HADOOP-9135. JniBasedUnixGroupsMappingWithFallback should log at debug rather than info during fallback. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1421013 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 22:07:51 +00:00
Sanjay Radia
cd80628ec4 HADOOP-8957 AbstractFileSystem#IsValidName should be overridden for embedded file systems like ViewFs (Chris Nauroth via Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420965 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 20:54:30 +00:00
Eli Collins
8c2846510e HADOOP-9113. o.a.h.fs.TestDelegationTokenRenewer is failing intermittently. Contributed by Karthik Kambatla 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420490 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 00:10:37 +00:00
Todd Lipcon
22a78a75b4 HADOOP-9126. FormatZK and ZKFC startup can fail due to zkclient connection establishment delay. Contributed by Rakesh R and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419831 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 22:09:20 +00:00
Todd Lipcon
7ba12a628a HADOOP-6762. Exception while doing RPC I/O closes channel. Contributed by Sam Rash and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419782 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 21:25:29 +00:00
Tsz-wo Sze
f4a723249e Merge r1415804 through r1419190 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1419193 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 03:37:32 +00:00
Eric Yang
bcaba93941 HADOOP-8418. Update UGI Principal classes name for running with 
IBM JDK on 64 bits Windows.  (Yu Gao via eyang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418572 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-08 00:48:04 +00:00
Todd Lipcon
6681523c87 HDFS-4282. TestEditLog.testFuzzSequences FAILED in all pre-commit test. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418214 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 08:18:14 +00:00
Suresh Srinivas
a5331eeead HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-06 17:09:17 +00:00
Aaron Myers
3337588975 HADOOP-9070. Kerberos SASL server cannot find kerberos key. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417729 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-06 02:53:36 +00:00
Todd Lipcon
bd239a8d97 HADOOP-9103. UTF8 class does not properly decode Unicode characters outside the basic multilingual plane. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417649 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-05 21:13:46 +00:00
Suresh Srinivas
9821af9ce8 Reverting the previous merge r1416603 which committed some extra changes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1416712 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 22:43:00 +00:00
Suresh Srinivas
d500d59cbe Merging trunk to HDFS-2802 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1416603 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 18:04:51 +00:00
Suresh Srinivas
e5d54ac89a HADOOP-9090. Support on-demand publish of metrics. Contributed by Mostafa Elhemali. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416538 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 14:23:16 +00:00
Tsz-wo Sze
6ad4752853 Merge r1414455 through r1415803 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1415809 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 19:52:49 +00:00
Tsz-wo Sze
833b928adf HDFS-3495. Update Balancer to support new NetworkTopology with NodeGroup. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414878 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-28 19:41:57 +00:00
Tsz-wo Sze
1ce3274dd5 Merge r1412283 through r1414454 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1414456 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-27 23:02:00 +00:00
Alejandro Abdelnur
f6230b1c8c HADOOP-9084. Augment DelegationTokenRenewer API to cancel the tokens on calls to removeRenewAction. (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414326 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-27 19:23:05 +00:00
Suresh Srinivas
3b3a72e622 HADOOP-9093. Move all the Exception in PathExceptions to o.a.h.fs package. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413960 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-27 00:40:55 +00:00
Robert Joseph Evans
68bc61ab5c HADOOP-9038. unit-tests for AllocatorPerContext.PathIterator (Ivan A. Veselovsky via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413776 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-26 18:47:20 +00:00
Robert Joseph Evans
0d92f54e82 HADOOP-8992. Enhance unit-test coverage of class HarFileSystem (Ivan A. Veselovsky via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413743 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-26 17:45:57 +00:00
Tsz-wo Sze
3dd84fcef7 Merge r1410998 through r1412282 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1412297 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 21:08:45 +00:00
Thomas White
d6af507199 HADOOP-9049. DelegationTokenRenewer needs to be Singleton and FileSystems should register/deregister to/from. Contributed by Karthik Kambatla. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412077 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 12:29:37 +00:00
Suresh Srinivas
c24bc56484 HADOOP-9075. FileContext#FSLinkResolver should be made static. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411988 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 05:55:48 +00:00
Tsz-wo Sze
d8ffea5943 Merge r1408927 through r1410997 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1411007 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 22:31:28 +00:00
Robert Joseph Evans
86ce5f6c91 HADOOP-9035. Generalize setup of LoginContext (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410018 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 21:14:37 +00:00
Alejandro Abdelnur
ce2067fb15 HADOOP-6607. Add different variants of non caching HTTP headers. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409921 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 18:45:58 +00:00
Daryn Sharp
97e52dd71e HDFS-4104. dfs -test -d prints inappropriate error on nonexistent directory (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409848 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 15:51:03 +00:00
Alejandro Abdelnur
ec8ed4e951 HADOO-8998. set Cache-Control no-cache header on all dynamic content. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409095 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 06:22:11 +00:00
Tsz-wo Sze
2a9f450511 Merge r1407704 through r1408926 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1408938 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 20:21:39 +00:00
Daryn Sharp
fe8f635b78 HADOOP-8999. SASL negotiation is flawed (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408837 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 17:10:13 +00:00
Eli Collins
3492ab6de0 HDFS-1322. Document umask in DistributedFileSystem#mkdirs javadocs. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408532 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 01:28:33 +00:00
Robert Joseph Evans
4755ef989a HADOOP-9021. Enforce configured SASL method on the server (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408473 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 22:13:00 +00:00
Tsz-wo Sze
40fe1ffbaa Merge r1406415 through r1407703 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1407706 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-10 00:49:15 +00:00
Robert Joseph Evans
de1f33dc35 HADOOP-9020. Add a SASL PLAIN server (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407622 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 20:40:09 +00:00
Alejandro Abdelnur
f8c486fbc8 HADOOP-7115. Add a cache for getpwuid_r and getpwgid_r calls (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407577 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 18:25:49 +00:00
Sanjay Radia
76d43a08ed HADOOP-8589 ViewFs tests fail when tests and home dirs are nested (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406939 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-08 06:16:02 +00:00
Robert Joseph Evans
1594dd6965 HADOOP-9015. Standardize creation of SaslRpcServers (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406851 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 22:50:48 +00:00
Robert Joseph Evans
3c02237459 HADOOP-9014. Standardize creation of SaslRpcClients (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406689 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 16:05:03 +00:00
Robert Joseph Evans
cb293a62a5 HADOOP-9013. UGI should not hardcode loginUser's authenticationType (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406684 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 15:56:46 +00:00
Tsz-wo Sze
92c440c115 Merge r1406007 through r1406326 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1406337 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 21:11:42 +00:00
Daryn Sharp
3a698e6aea HDFS-1331. dfs -test should work like /bin/test (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406198 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 15:57:58 +00:00
Robert Joseph Evans
5605b54010 HADOOP-9012. IPC Client sends wrong connection context (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406184 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 15:37:14 +00:00
Robert Joseph Evans
b1aa62a848 HADOOP-9010. Map UGI authenticationMethod to RPC authMethod (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405910 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 18:37:39 +00:00
Robert Joseph Evans
8303175db8 HADOOP-9009. Add SecurityUtil methods to get/set authentication method (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405904 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 18:26:49 +00:00
Tsz-wo Sze
f84000900a HDFS-4149. Implement the disallowSnapshot(..) in FSNamesystem and add resetSnapshottable(..) to SnapshotManager. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1405683 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 00:40:54 +00:00
Tsz-wo Sze
e341184d54 Merge r1403306 through r1404284 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1404285 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 18:34:51 +00:00
Thomas Graves
aac5c149c7 MAPREDUCE-4752. Reduce MR AM memory usage through String Interning (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404177 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 14:57:12 +00:00
Robert Joseph Evans
12eb3b8abc HADOOP-8986. Server$Call object is never released after it is sent (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403745 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 15:46:15 +00:00
Suresh Srinivas
2d5334931e HDFS-4097. Provide CLI support for createSnapshot. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1401971 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 04:08:36 +00:00
Daryn Sharp
61ffa3adb9 MAPREDUCE-4229. Intern counter names in the JT (bobby via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401473 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 21:01:03 +00:00
Robert Joseph Evans
b73903f6a7 HADOOP-8962. RawLocalFileSystem.listStatus fails when a child filename contains a colon (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401325 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 15:47:26 +00:00
Robert Joseph Evans
13422461f3 HADOOP-8811. Compile hadoop native library in FreeBSD (Radim Kolar via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401321 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 15:32:25 +00:00
Suresh Srinivas
0dc2681900 HADOOP-8951. RunJar to fail with user-comprehensible error message if jar missing. Contributed by Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400921 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-22 15:55:04 +00:00
Suresh Srinivas
6f79fffb86 HADOOP-8900. BuiltInGzipDecompressor throws IOException - stored gzip size doesn't match decompressed size. Contributed by Slavik Krassovsky. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399377 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 18:36:32 +00:00
Robert Joseph Evans
224de4f92c HADOOP-8926. hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data (Gopal V via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399005 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 21:52:10 +00:00
Eli Collins
be2b9d0236 HADOOP-8931. Add Java version to startup message. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398998 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 21:29:18 +00:00
Robert Joseph Evans
6a059dc40e HADOOP-8922. Provide alternate JSONP output for JMXJsonServlet to allow javascript in browser dashboard (Damien Hardy via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398904 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 18:00:01 +00:00
Suresh Srinivas
9757f7407a HADOOP-8923. JNI-based user-group mapping modules can be too chatty on lookup failures. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398883 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 16:52:42 +00:00
Todd Lipcon
e0db1e9e10 HADOOP-8929. Add toString, other improvements for SampleQuantiles. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398658 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 06:06:20 +00:00
Suresh Srinivas
41eec8a32b HADOOP-8920. Add more javadoc to metrics2 related classes. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398640 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 04:29:50 +00:00
Jason Darrell Lowe
f8bdac0a1b HADOOP-8906. paths with multiple globs are unreliable. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397704 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 19:49:40 +00:00
Suresh Srinivas
611ff4ec89 HADOOP-8910. Add examples to GlobExpander#expand method. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397691 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 19:03:10 +00:00
Daryn Sharp
22ef03bc76 HADOOP-8784. Improve IPC.Client's token use (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397634 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 16:27:26 +00:00
Suresh Srinivas
94ed14c48c HADOOP-8911. CRLF characters in source and text files. Contributed Raja Aluri. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397432 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 04:35:42 +00:00
Eli Collins
2115bd2ec7 HADOOP-8886. Remove KFS support. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395820 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 00:16:26 +00:00
Aaron Myers
2b49b39f3c Revert initial commit of HADOOP-8884 per feedback from Todd. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395783 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 21:25:37 +00:00
Aaron Myers
2a32ba9f99 HADOOP-8884. DEBUG should be WARN for DEBUG util.NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError. Contributed by Anthony Rojas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395714 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 18:44:59 +00:00
Eli Collins
c50033d0c8 HADOOP-8804. Improve Web UIs when the wildcard address is used. Contributed by Senthil Kumar 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395703 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 18:17:39 +00:00
Alejandro Abdelnur
50b20477fd HADOOP-8881. FileBasedKeyStoresFactory initialization logging should be debug not info. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394165 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 17:32:01 +00:00
Daryn Sharp
a7d4f30131 HADOOP-8783. Improve RPC.Server's digest auth (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393483 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 13:43:53 +00:00
Eli Collins
fc54f57c59 HADOOP-8756. Fix SEGV when libsnappy is in java.library.path but not LD_LIBRARY_PATH. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393243 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 00:06:39 +00:00
Aaron Myers
ccabb684eb HADOOP-8616. ViewFS configuration requires a trailing slash. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392707 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-02 01:28:17 +00:00
Aaron Myers
c808caea75 Revert an errant commit of HADOOP-8616. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392705 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-02 01:26:27 +00:00
Aaron Myers
d1f4ec4ac8 HADOOP-8616. ViewFS configuration requires a trailing slash. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392703 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-02 01:17:00 +00:00
Aaron Myers
1ced82cc81 HADOOP-8866. SampleQuantiles#query is O(N^2) instead of O(N). Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391711 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 00:59:04 +00:00
Eli Collins
a33ae4020d HADOOP-8855. SSL-based image transfer does not work when Kerberos is disabled. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390841 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 05:03:42 +00:00
Eli Collins
47dfcf45af HDFS-3972. Trash emptier fails in secure HA cluster. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390729 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 21:25:04 +00:00
Jason Darrell Lowe
6ddbb22567 HADOOP-8843. Old trash directories are never deleted on upgrade from 1.x. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390616 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 17:14:27 +00:00
Todd Lipcon
9270635f33 HADOOP-3957. Change MutableQuantiles to use a shared thread for rolling over metrics. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390210 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 23:16:14 +00:00
Harsh J
a7e450c7cc HADOOP-8436. NPE In getLocalPathForWrite ( path, conf ) when the required context item is not configured. Contributed by Brahma Reddy Battula. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389799 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 11:10:11 +00:00
Harsh J
d50e06d9e0 HADOOP-7930. Kerberos relogin interval in UserGroupInformation should be configurable. Contributed by Robert Kanter. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389783 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 10:17:11 +00:00
Suresh Srinivas
5308a0ecd5 HADOOP-8813. Add InterfaceAudience and InterfaceStability annotations to RPC Server and Client classes. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389649 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-24 23:16:04 +00:00
Owen O'Malley
0187553d9a Fix the length of the secret key. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389194 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-24 03:45:07 +00:00
Harsh J
28379070d4 HADOOP-8588. SerializationFactory shouldn't throw a NullPointerException if the serializations list is empty. Contributed by Sho Shimauchi. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389002 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-23 10:32:13 +00:00
Harsh J
28023b7759 HADOOP-7256. Resource leak during failure scenario of closing of resources. Contributed by Ramkrishna S. Vasudevan. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388893 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-22 20:34:16 +00:00
Harsh J
bd76d9a827 HADOOP-8833. fs -text should make sure to call inputstream.seek(0) before using input stream. Contributed by Tom White and Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388869 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-22 18:56:07 +00:00
Eli Collins
7dee7f11f6 HDFS-3932. NameNode Web UI broken if the rpc-address is set to the wildcard. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388321 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 04:51:43 +00:00
Suresh Srinivas
4c56bccf5e HADOOP-8814. Replace string equals by String#isEmpty(). Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387853 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-20 04:06:11 +00:00
Alejandro Abdelnur
8bf6b80f2b Reverting HADOOP-8805 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387697 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 18:06:42 +00:00
Alejandro Abdelnur
9f6cfe32e4 HADOOP-8805. Move protocol buffer implementation of GetUserMappingProtocol from HDFS to Common. (bowang via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387298 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 18:15:37 +00:00
Eli Collins
ea6a36e2e7 HADOOP-8812. ExitUtil#terminate should print Exception#toString. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387273 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 17:32:01 +00:00
Eli Collins
4d2e77bc1c Revert previous commit - accidentally included two changes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386783 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 19:28:14 +00:00
Eli Collins
8a9debd0ef HADOOP-8806. libhadoop.so: dlopen should be better at locating libsnappy.so, etc. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386780 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 19:25:05 +00:00
Suresh Srinivas
6afabd7e57 HADOOP-8819. Incorrectly & is used instead of && in some file system implementations. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386451 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 01:39:11 +00:00
Suresh Srinivas
5d37911882 HADOOP-8821. Fix findbugs warning related concatenating string in a for loop in Configuration#dumpDeprecatedKeys(). Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385389 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-16 22:33:13 +00:00
Suresh Srinivas
0c53ed4cd1 HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-16 21:10:39 +00:00
Thomas White
d89828573d HADOOP-8780. Update DeprecatedProperties apt file. Contributed by Ahmed Radwan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384833 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-14 16:05:30 +00:00
Eli Collins
eb7f8a71e0 HADOOP-8801. ExitUtil#terminate should capture the exception stack trace. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384435 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-13 17:56:49 +00:00
Doug Cutting
de2efbe3ba HADOOP-8597. Permit FsShell's text command to read Avro files. Contributed by Ivan Vladimirov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383607 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 20:38:45 +00:00
Todd Lipcon
bdcbc2d1ef HADOOP-8786. HttpServer continues to start even if AuthenticationFilter fails to init. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383254 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 06:37:17 +00:00
Tsz-wo Sze
e8c193bf24 HADOOP-8754. Deprecate all the RPC.getServer() variants. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381845 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 03:09:53 +00:00
Alejandro Abdelnur
11312adedb HADOOP-8749. HADOOP-8031 changed the way in which relative xincludes are handled in Configuration. (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381703 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 18:15:37 +00:00
Eli Collins
91e832e7b4 HADOOP-8770. NN should not RPC to self to find trash defaults. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381319 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 19:42:09 +00:00
Suresh Srinivas
4911d9b1ff HADOOP-8736. Add Builder for building RPC server. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379652 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 22:40:51 +00:00
Robert Joseph Evans
38d003a6db HADOOP-8727. Gracefully deprecate dfs.umaskmode in 2.x onwards (Harsh J via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379537 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 18:27:23 +00:00
Suresh Srinivas
e5a9d672f0 HADOOP-8684. Deadlock between WritableComparator and WritableComparable. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379506 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 17:01:25 +00:00
Robert Joseph Evans
6f6e170325 HADOOP-8726. The Secrets in Credentials are not available to MR tasks (daryn and Benoy Antony via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379100 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 19:58:07 +00:00
Tsz-wo Sze
ec94ea2658 HADOOP-8748. Refactor DFSClient retry utility methods to a new class in org.apache.hadoop.io.retry. Contributed by Arun C Murthy 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378969 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 14:50:18 +00:00
Suresh Srinivas
e7b12c89e1 HADOOP-8619. WritableComparator must implement no-arg constructor. Contributed by Chris Douglas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378120 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 13:05:31 +00:00
Suresh Srinivas
deead78e35 HDFS-3844. Add @Override and remove {@inheritdoc} and unnecessary imports. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377168 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-25 01:03:22 +00:00
Suresh Srinivas
7a1dc1ab70 HDFS-3834. Remove unused static fields NAME, DESCRIPTION and Usage from Command. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377001 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 17:36:22 +00:00
Robert Joseph Evans
cffee556e4 HADOOP-8725. MR is broken when security is off (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376929 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 14:16:41 +00:00
Alejandro Abdelnur
bbf1f55bee HADOOP-8031. Configuration class fails to find embedded .jar resources; should use URL.openStream() (genman via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376772 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 23:24:25 +00:00
Alejandro Abdelnur
fc1fab9084 HADOOP-4572. Can not access user logs - Jetty is not configured by default to serve aliases/symlinks (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376753 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 22:52:47 +00:00
Robert Joseph Evans
4f8e1f779b HADOOP-8709. globStatus changed behavior from 0.20/1.x (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376653 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 19:18:05 +00:00
Robert Joseph Evans
aeb364d8b5 HADOOP-8225. DistCp fails when invoked by Oozie (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376618 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 18:06:56 +00:00
Robert Joseph Evans
34bd9794f7 HADOOP-8655. Fix TextInputFormat for large deliminators. (Gelesh via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376592 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 16:58:36 +00:00
Robert Joseph Evans
42beb56a2e HADOOP-8632. Configuration leaking class-loaders (Costin Leau via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376543 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 15:24:46 +00:00
Eli Collins
5b790ab046 HADOOP-8075. Lower native-hadoop library log from info to debug. Contributed by Hızır Sefa İrken 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376322 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 00:01:00 +00:00
Aaron Myers
d66223fd99 HADOOP-8721. ZKFC should not retry 45 times when attempting a graceful fence during a failover. Contributed by Vinayakumar B. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376194 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 18:54:02 +00:00
Aaron Myers
de8b34a70e HDFS-3835. Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376188 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 18:47:07 +00:00
Suresh Srinivas
e8477759ac HADOOP-8711. IPC Server supports adding exceptions for which the message is printed and the stack trace is not printed to avoid chatter. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375790 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 21:01:28 +00:00
Tsz-wo Sze
f2dd818201 HADOOP-8239. Add subclasses of MD5MD5CRC32FileChecksum to support file checksum with CRC32C. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375450 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 09:44:46 +00:00
Robert Joseph Evans
d5f080825c HADOOP-8611. Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails (Robert Parker via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375221 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-20 21:17:13 +00:00
Eli Collins
f58941f2ac HADOOP-8614. IOUtils#skipFully hangs forever on EOF. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375216 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-20 21:10:44 +00:00
Tsz-wo Sze
b0ea77303b HADOOP-8240. Add a new API to allow users to specify a checksum type on FileSystem.create(..). Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374696 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-19 05:46:57 +00:00
Eli Collins
54621c3776 HADOOP-8710. Remove ability for users to easily run the trash emptire. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374476 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 23:26:55 +00:00
Eli Collins
18c5bc86ca HADOOP-8689. Make trash a server side configuration option. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374472 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 23:22:17 +00:00
Daryn Sharp
8fa10b184e HADOOP-7967. Need generalized multi-token filesystem support (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374271 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 14:05:11 +00:00
Robert Joseph Evans
2926ae6ead HADOOP-8654. TextInputFormat delimiter bug (Gelesh and Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373859 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 14:23:28 +00:00
Tsz-wo Sze
3cab01ba6e HADOOP-8700. Use enum to define the checksum constants in DataChecksum. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373683 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 01:32:10 +00:00
Alejandro Abdelnur
5aeabcdf6f HADOOP-7754. Expose file descriptors from Hadoop-wrapped local FileSystems (todd and ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373235 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 06:40:29 +00:00
Alejandro Abdelnur
fd8ce04dc5 HADOOP-8699. some common testcases create core-site.xml in test-classes making other testcases to fail. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373206 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 04:21:04 +00:00
Suresh Srinivas
28e87740c5 HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373173 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:28:41 +00:00
Todd Lipcon
b38bd555e8 HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373061 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 20:11:40 +00:00
Alejandro Abdelnur
4bca22005f HADOOP-8681. add support for HTTPS to the web UIs. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371525 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 22:52:56 +00:00
Aaron Myers
9b4a7900c7 HDFS-3637. Add support for encrypting the DataTransferProtocol. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370354 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 16:40:03 +00:00
Alejandro Abdelnur
5383694df9 HADOOP-8644. AuthenticatedURL should be able to use SSLFactory. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370045 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-06 22:22:32 +00:00
Thomas Graves
12d0e02591 HADOOP-8633. Interrupted FsShell copies may leave tmp files (Daryn Sharp via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368002 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 14:02:22 +00:00
Robert Joseph Evans
75be1e0e76 HADOOP-8637. FilterFileSystem#setWriteChecksum is broken (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367702 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 18:58:43 +00:00
Robert Joseph Evans
7226dead1e HADOOP-8635. Cannot cancel paths registered deleteOnExit (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367296 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 20:58:44 +00:00
Robert Joseph Evans
48a2e2b4e2 HADOOP-8550. hadoop fs -touchz automatically created parent directories (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367202 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 18:11:32 +00:00
Robert Joseph Evans
d8584fde03 HADOOP-8634. Ensure FileSystem#close doesn't squawk for deleteOnExit paths (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367196 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 18:05:38 +00:00
Robert Joseph Evans
98f1523b20 HADOOP-8627. FS deleteOnExit may delete the wrong path (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367114 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 15:18:11 +00:00
Daryn Sharp
b3b72482e4 HADOOP-8613. AbstractDelegationTokenIdentifier#getUser() should set token auth type. (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366440 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-27 16:39:51 +00:00
Aaron Myers
c1ea9b4490 HDFS-3650. Use MutableQuantiles to provide latency histograms for various operations. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366246 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-27 00:26:21 +00:00
Todd Lipcon
2f478ac89c HADOOP-8642. ProtobufRpcEngine should log all RPCs if TRACE logging is enabled. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366127 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-26 18:22:00 +00:00
Alejandro Abdelnur
9d16c9354b MAPREDUCE-4417. add support for encrypted shuffle (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365979 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-26 13:23:05 +00:00
Todd Lipcon
06b394dcf9 Amend previous commit of HDFS-3626: accidentally included a hunk from HADOOP-8621 in svn commit. Reverting that hunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365817 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 22:04:59 +00:00
Todd Lipcon
972953bd77 HDFS-3626. Creating file with invalid path can corrupt edit log. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365801 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 21:52:38 +00:00
Robert Joseph Evans
0bfa7d79d0 HADOOP-8551. fs -mkdir creates parent directories without the -p option (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365588 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 13:56:29 +00:00
Robert Joseph Evans
a2d5603106 HADOOP-8606. FileSystem.get may return the wrong filesystem (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365224 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-24 19:00:50 +00:00
Aaron Myers
80e2b4117b HADOOP-8609. IPC server logs a useless message when shutting down socket. Contributed by Jon Zuanich. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363950 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-20 20:50:30 +00:00
Robert Joseph Evans
4c51dacd52 Reverting HADOOP-8551. fs -mkdir creates parent directories without the -p option 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363547 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-19 21:15:42 +00:00
Robert Joseph Evans
52c8271bf1 HADOOP-8551. fs -mkdir creates parent directories without the -p option (Daryn Sharp and John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363435 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-19 17:46:47 +00:00
Todd Lipcon
30099efb35 HADOOP-8599. Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362295 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 22:41:56 +00:00
Suresh Srinivas
2799d9659d HADOOP-8593. Add missed @Override annotations in Metric/Metrics2 package. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362294 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 22:38:29 +00:00
Eli Collins
4b519219de Amend HDFS-3666, applied earlier version of the patch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362278 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 21:49:35 +00:00
Eli Collins
527933f4f3 HDFS-3666. Plumb more exception messages to terminate. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362270 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 21:26:58 +00:00
Robert Joseph Evans
612443951b MAPREDUCE-4395. Possible NPE at ClientDistributedCacheManager#determineTimestamps (Bhallamudi via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362052 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 14:19:36 +00:00
Harsh J
0f122c209d HADOOP-8531. SequenceFile Writer can throw out a better error if a serializer or deserializer isn't available. Contributed by Madhukara Phatak. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361933 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 08:33:13 +00:00
Eli Collins
64fc2cb03d HDFS-3663. MiniDFSCluster should capture the code path that led to the first ExitException. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361775 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 19:43:39 +00:00
Harsh J
7351a01259 HADOOP-7818. DiskChecker#checkDir should fail if the directory is not executable. Contributed by Madhukara Phatak. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361717 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 15:33:27 +00:00
Harsh J
385f31ad85 HADOOP-8362. Improve exception message when Configuration.set() is called with a null key or value. Contributed by Madhukara Phatak and Suresh Srinivas (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361712 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 15:07:02 +00:00
Eli Collins
4a5ba3b7bd HDFS-3641. Move server Util time methods to common and use now instead of System#currentTimeMillis. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360858 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 19:01:49 +00:00
Aaron Myers
b5b0ac64a1 HADOOP-8541. Better high-percentile latency metrics. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360501 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 01:31:40 +00:00
Aaron Myers
96d77c17cc HADOOP-8585. Fix initialization circularity between UserGroupInformation and HadoopConfiguration. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360498 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 01:22:34 +00:00
Eli Collins
4c13b6f34e HADOOP-8587. HarFileSystem access of harMetaCache isn't threadsafe. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360448 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 22:28:54 +00:00
Eli Collins
cdae6953e8 HDFS-3582. Hook daemon process exit for testing. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360329 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 17:58:02 +00:00
Harsh J
e5ea2aa765 HADOOP-3886. Error in javadoc of Reporter, Mapper and Progressable. Contributed by Jingguo Yao. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360222 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 15:06:42 +00:00
Eli Collins
43e37b96f8 HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360056 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 08:21:22 +00:00
Eli Collins
151a1b0185 Revert previous commit, accidentally included HADOOP-8587. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360055 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 08:19:59 +00:00
Eli Collins
c41b97860d HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360048 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 08:10:00 +00:00
Thomas Graves
58a8826fb5 HADOOP-8573. Configuration tries to read from an inputstream resource multiple times (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359891 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 20:50:17 +00:00
Harsh J
caf9fe2f13 HADOOP-8423. MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data. Contributed by Todd Lipcon. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359866 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 19:58:49 +00:00
Aaron Myers
fb4a6ac9e9 HDFS-3568. fuse_dfs: add support for security. Contributed by Colin McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359824 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 18:28:13 +00:00
Robert Joseph Evans
0b7139d6bc HADOOP-8525. Provide Improved Traceability for Configuration (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359775 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 16:49:24 +00:00
Alejandro Abdelnur
820be7cbef MAPREDUCE-3993. Graceful handling of codec errors during decompression (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359345 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 19:19:00 +00:00
Alejandro Abdelnur
0a2252bdda HADOOP-8566. AvroReflectSerializer.accept(Class) throws a NPE if the class has no package (primitive types and arrays). (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358454 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-06 22:27:13 +00:00
Robert Joseph Evans
0e7204c9e7 MAPREDUCE-4379. Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358305 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-06 17:19:13 +00:00
Tsz-wo Sze
4d0cab2729 HDFS-3601. Add BlockPlacementPolicyWithNodeGroup to support block placement with 4-layer network topology. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357442 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-05 01:31:57 +00:00
Todd Lipcon
3728d16160 HDFS-3574. Fix small race and do some cleanup in GetImageServlet. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356939 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-03 20:55:29 +00:00
Todd Lipcon
b8389e4c73 HDFS-3343. Improve metrics for DN read latency. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356928 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-03 20:45:21 +00:00
Daryn Sharp
3c2101ae4a HADOOP-8110. Fix trash checkpoint collisions (Jason Lowe via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356897 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-03 19:59:56 +00:00
Eli Collins
161ed29087 HADOOP-8463. hadoop.security.auth_to_local needs a key definition and doc. Contributed by Madhukara Phatak 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356513 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-02 22:46:55 +00:00
Suresh Srinivas
22822df7c3 HADOOP-8533. Remove parallel call ununsed capability in RPC. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356504 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-02 22:15:44 +00:00
Harsh J
cb5867573e HADOOP-6802. Remove FS_CLIENT_BUFFER_DIR_KEY = "fs.client.buffer.dir" from CommonConfigurationKeys.java (not used, deprecated). Contributed by Sho Shimauchi. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355784 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-30 18:40:34 +00:00
Harsh J
06d0109314 HADOOP-8449. hadoop fs -text fails with compressed sequence files with the codec file extension. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355636 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-30 05:04:23 +00:00
Todd Lipcon
802f885a55 HDFS-3446. HostsFileReader silently ignores bad includes/excludes. Contributed by Matthew Jacobs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355584 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-29 22:24:29 +00:00
Alejandro Abdelnur
32d3ed55d0 HADOOP-8168. empty-string owners or groups causes {{MissingFormatWidthException}} in o.a.h.fs.shell.Ls.ProcessPath() (ekoontz via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355085 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 17:42:44 +00:00
Todd Lipcon
5770a453f3 HDFS-3572. Cleanup code which inits SPNEGO in HttpServer. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354767 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-27 22:41:41 +00:00
Siddharth Seth
a945336368 MAPREDUCE-4031. Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353038 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-22 21:40:35 +00:00
Harsh J
d1138f0914 HADOOP-8524. Allow users to get source of a Configuration parameter. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352689 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-21 21:12:31 +00:00
Tsz-wo Sze
ed7040f07b HADOOP-8470. Add NetworkTopologyWithNodeGroup, a 4-layer implementation of NetworkTopology. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351445 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-18 18:23:10 +00:00
Tsz-wo Sze
9ab9bc9f37 Revert r1351163 for fixing the JIRA number; it should be HADOOP-8470 but not HADOOP-8468. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351444 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-18 18:20:41 +00:00
Tsz-wo Sze
19ac5c4e8b HADOOP-8468. Add NetworkTopologyWithNodeGroup, a 4-layer implementation of NetworkTopology. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351163 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-17 21:12:25 +00:00
Eli Collins
07b8584431 HDFS-3531. EditLogFileOutputStream#preallocate should check for incomplete writes. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349616 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-13 02:42:52 +00:00
Eli Collins
0199fe9763 HADOOP-8507. Avoid OOM while deserializing DelegationTokenIdentifer. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349561 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 22:10:12 +00:00
Alejandro Abdelnur
4d4661802e HDFS-3228. Move DelegationTokenRenewer to common (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349555 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 21:52:46 +00:00
Eli Collins
797c8548d0 Revert HADOOP-8491 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349133 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 06:22:06 +00:00
Tsz-wo Sze
45fafc2b8f HDFS-3504. Support configurable retry policy in DFSClient for RPC connections and RPC calls, and add MultipleLinearRandomRetry, a new retry policy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349124 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 05:27:15 +00:00
Eli Collins
6e3ebf4d73 HADOOP-8491. Check for short writes when using FileChannel#write and related methods. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349019 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-11 21:20:28 +00:00
Tsz-wo Sze
415ce38b82 HADOOP-8469. Make NetworkTopology class pluggable. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347867 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-08 02:29:40 +00:00
Robert Joseph Evans
8d559d2d9a HADOOP-8452. DN logs backtrace when running under jsvc and /jmx is loaded (Andy Isaacson via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344733 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-31 14:10:16 +00:00
Tsz-wo Sze
83cf475050 HDFS-744. Support hsync in HDFS. Contributed by Lars Hofhans 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344419 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-30 19:10:09 +00:00
Harsh J
d2b57e00bc HADOOP-8358. Config-related WARN for dfs.web.ugi can be avoided. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343290 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-28 15:36:00 +00:00
Harsh J
4709160d75 HADOOP-6871. When the value of a configuration key is set to its unresolved form, it causes an IllegalStateException in Configuration.get() stating that substitution depth is too large. Contributed by Arvind Prabhakar (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342626 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 14:02:01 +00:00
Harsh J
ceaf168dc7 HADOOP-7659. fs -getmerge isn't guaranteed to work well over non-HDFS filesystems (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342600 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 12:46:22 +00:00
Harsh J
e62a76a40c HADOOP-8323. Add javadoc and tests for Text.clear() behavior (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342514 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 06:38:16 +00:00
Harsh J
458be39423 HADOOP-8415. Add getDouble() and setDouble() in org.apache.hadoop.conf.Configuration. Contributed by Jan van der Lugt. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342501 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 06:06:01 +00:00
Eli Collins
22cb0ec82a HADOOP-8422. Deprecate FileSystem#getDefault* and getServerDefault methods that don't take a Path argument. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342495 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 04:10:15 +00:00
Todd Lipcon
6c544adeb3 Merge HDFS-3042 (automatic failover) to trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342112 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-24 00:56:20 +00:00
Sanjay Radia
266a0f1de9 HADOOP-8367 Improve documentation of declaringClassProtocolName in rpc headers (Sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342051 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 21:16:39 +00:00
Aaron Myers
23b96766ad Amend HADOOP-8408 per Daryn's post-commit feedback. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341338 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-22 07:50:00 +00:00
Todd Lipcon
1a3bd5d42f Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1340622 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-20 06:12:14 +00:00
Eli Collins
eae281c130 HADOOP-8408. MR doesn't work with a non-default ViewFS mount table and security enabled. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339970 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-18 04:20:28 +00:00
Aaron Myers
1377709b4c HDFS-3433. GetImageServlet should allow administrative requestors when security is enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339540 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 10:23:18 +00:00
Todd Lipcon
026d0b4d53 HADOOP-8406. CompressionCodecFactory.CODEC_PROVIDERS iteration is thread-unsafe. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339476 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 04:28:35 +00:00
Todd Lipcon
7b1d347b43 HADOOP-8405. ZKFC tests leak ZK instances. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339435 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 00:38:59 +00:00
Todd Lipcon
0600e834be HDFS-3432. TestDFSZKFailoverController tries to fail over too early. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339434 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 00:36:13 +00:00
Todd Lipcon
e14e10fb86 Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339410 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-16 22:47:37 +00:00
Todd Lipcon
52ecdb751e HDFS-3412. Fix findbugs warnings in auto-HA branch. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1338817 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 18:16:49 +00:00
Eli Collins
b64cd82a34 HADOOP-8398. Cleanup BlockLocation. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338806 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 17:25:49 +00:00
Harsh J
f22276ee3f HADOOP-8297. Writable javadocs don't carry default constructor (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338557 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 06:42:42 +00:00
Todd Lipcon
4cd70e87be Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1337645 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-12 20:52:34 +00:00
Harsh J
810ae618fd HADOOP-8395. Text shell command unnecessarily demands that a SequenceFile's key class be WritableComparable (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337449 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-12 06:03:39 +00:00
Sanjay Radia
2116f28d9e HADOOP-8366 Use ProtoBuf for RpcResponseHeader (sanjay radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337283 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 16:56:52 +00:00
Thomas White
aea890f7d2 MAPREDUCE-4148. MapReduce should not have a compile-time dependency on HDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337199 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 15:00:48 +00:00
Eli Collins
dfd733401d HADOOP-8388. Remove unused BlockLocation serialization. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336966 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 23:48:12 +00:00
Eli Collins
1a4539abf7 Remove SHORT_STRING_MAX, left out of the previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336946 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 23:17:29 +00:00
Eli Collins
032216a3a7 HADOOP-8361. Avoid out-of-memory problems when deserializing strings. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336945 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 23:15:53 +00:00
Aaron Myers
f5960f71d9 HDFS-3395. NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336690 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 13:49:06 +00:00
Todd Lipcon
b75f0187c8 HDFS-3341, HADOOP-8340. SNAPSHOT build versions should compare as less than their eventual release. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336459 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 00:30:53 +00:00
Suresh Srinivas
1ceecf2aa2 HADOOP-8372. NetUtils.normalizeHostName() incorrectly handles hostname starting with a numeric character. Contributed by Junping Du. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336446 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-09 23:18:15 +00:00
Tsz-wo Sze
07280c9761 HADOOP-8359. Fix javadoc warnings in Configuration. Contributed by Anupam Seth 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335258 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-07 21:11:01 +00:00
Thomas White
35a33067bb HADOOP-8328. Duplicate FileSystem Statistics object for 'file' scheme. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335085 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-07 16:00:56 +00:00
Harsh J
e7d03636a0 HADOOP-8323. Revert HADOOP-7940, cause it may cause a performance regression. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334603 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-06 11:20:16 +00:00
Aaron Myers
51e520c68a HADOOP-8349. ViewFS doesn't work when the root of a file system is mounted. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334231 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 22:14:10 +00:00
Eli Collins
5dbbe0e0a5 HDFS-2617. Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution. Contributed by Jakob Homan, Alejandro Abdelnur, and Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334216 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 21:58:44 +00:00
Alejandro Abdelnur
a70587f368 HADOOP-8343. Allow configuration of authorization for JmxJsonServlet and MetricsServlet (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333750 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 03:31:44 +00:00
Alejandro Abdelnur
af66607406 HADOOP-8356. FileSystem service loading mechanism should print the FileSystem impl it is failing to load (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333744 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 03:10:26 +00:00
Todd Lipcon
6b58fa6494 Amend previous commit of HADOOP-8350 (missed new SocketInputWrapper file) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333650 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 21:58:08 +00:00
Todd Lipcon
03181022ab HADOOP-8350. Improve NetUtils.getInputStream to return a stream which has a tunable timeout. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333649 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 21:57:10 +00:00
Eli Collins
d948998777 HADOOP-8347. Hadoop Common logs misspell 'successful'. Contributed by Philip Zeyliger 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333321 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 06:35:45 +00:00
Todd Lipcon
f6c01e2f8e Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333291 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 02:14:01 +00:00
Todd Lipcon
9d5799553f HADOOP-8279. Allow manual failover to be invoked when auto-failover is enabled. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333288 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 01:56:33 +00:00
Alejandro Abdelnur
a5a2abbacc HADOOP-8342. HDFS command fails with exception following merge of HADOOP-8325 (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333224 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-02 21:48:39 +00:00
Thomas Graves
70c392df0e HADOOP-8339. jenkins complaining about 16 javadoc warnings (Tom White and Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332853 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-01 21:46:58 +00:00
Eli Collins
bbfda83044 HADOOP-8275. Range check DelegationKey length. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332839 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-01 21:25:36 +00:00
Robert Joseph Evans
7d1b804d3a HADOOP-8172. Configuration no longer sets all keys in a deprecated key list. (Anupam Seth via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332821 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-01 21:00:52 +00:00
Robert Joseph Evans
1e88c1f088 HADOOP-8335. Improve Configuration's address handling (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332427 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-30 21:55:26 +00:00
Alejandro Abdelnur
8a0c7323ce HADOOP-8325. Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332345 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-30 19:21:11 +00:00
Robert Joseph Evans
097a001b3f HADOOP-8334. HttpServer sometimes returns incorrect port (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332336 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-30 18:56:42 +00:00
Robert Joseph Evans
500dc61523 HADOOP-8305. distcp over viewfs is broken (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331440 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-27 14:39:35 +00:00
Alejandro Abdelnur
17e03547dc HADOOP-8321. TestUrlStreamHandler fails. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331073 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 20:35:58 +00:00
Aaron Myers
4b62c68292 HADOOP-8310. FileContext#checkPath should handle URIs with no port. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331007 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 18:19:01 +00:00
Thomas Graves
e84b552713 HADOOP-8296. hadoop/yarn daemonlog usage wrong (Devaraj K via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330445 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 17:59:08 +00:00
Alejandro Abdelnur
e29ede3f72 HADOOP-8314. HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330086 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 03:20:53 +00:00
Alejandro Abdelnur
706e861a85 HADOOP-7549. Use JDK ServiceLoader mechanism to find FileSystem implementations. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329994 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 20:33:05 +00:00
Todd Lipcon
c6e1321245 HADOOP-8306. ZKFC: improve error message when ZK is not running. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1329960 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 19:34:51 +00:00
Eli Collins
858887e289 HADOOP-8152. Expand public APIs for security library classes. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329541 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 03:59:35 +00:00
Sanjay Radia
589c68ae09 HADOOP-8285 Use ProtoBuf for RpcPayLoadHeader (sanjay radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329319 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 16:34:21 +00:00
Thomas White
0363ca0489 HADOOP-7350. Use ServiceLoader to discover compression codec classes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328083 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 19:20:31 +00:00
Robert Joseph Evans
f6cadd8610 HADOOP-8288. Remove references of mapred.child.ulimit etc. since they are not being used any more (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328018 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 16:05:34 +00:00
Todd Lipcon
ca49126e3d Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1327724 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 23:35:30 +00:00
Aaron Myers
c21bd72a2f HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327182 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 17:06:38 +00:00
Aaron Myers
1675c18ded Revert HADOOP-8280 so it can be recommitted using `svn mv' 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327179 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 16:49:04 +00:00
Robert Joseph Evans
e8eed2f62d HADOOP-8227. Allow RPC to limit ephemeral port range. (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327127 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 15:04:20 +00:00
Robert Joseph Evans
a98ba41092 HADOOP-8286. Simplify getting a socket address from conf (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327108 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 14:21:11 +00:00
Aaron Myers
551468385c HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326727 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 18:28:36 +00:00
Robert Joseph Evans
047a7b276c HADOOP-7510. Tokens should use original hostname provided instead of ip (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325500 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 20:43:18 +00:00
Eli Collins
f01ede227f HADOOP-8144. pseudoSortByDistance in NetworkTopology doesn't work properly if no local node and first node is local rack node. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325367 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 16:37:15 +00:00
Todd Lipcon
2bf19979b3 Merge trunk into auto-failover branch. 
Needs a few tweaks to fix compilation - will do in followup commit. This is just a straight merge


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324567 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:47:40 +00:00
Todd Lipcon
41a014c31b HADOOP-8247. Add a config to enable auto-HA, which disables manual FailoverController. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324566 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:40:26 +00:00
Robert Joseph Evans
482e0638e8 HADOOP-8264. Remove irritating double double quotes in front of hostname (Bernd Fondermann via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311738 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 14:12:02 +00:00
Todd Lipcon
4b0d4d54d9 HADOOP-8263. Stringification of IPC calls not useful. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311543 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 01:02:05 +00:00
Aaron Myers
909176c1fc HADOOP-8261. Har file system doesn't deal with FS URIs with a host but no port. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311133 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 05:56:22 +00:00
Todd Lipcon
693ec453d2 HADOOP-8246. Auto-HA: automatically scope znode by nameservice ID. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310919 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 23:24:57 +00:00
Todd Lipcon
ca6f0940fd Merge trunk into auto-failover branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310905 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 22:53:55 +00:00
Robert Joseph Evans
fcb3ff5d18 HADOOP-8014. ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310555 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 19:16:13 +00:00
Robert Joseph Evans
534591697c HADOOP-8014. ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310507 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 17:54:40 +00:00
Todd Lipcon
30068a1d83 Merge trunk into auto-failover branch. 
Addressed two semantic conflicts after the commit of HADOOP-8077 -- test code was referencing the old constant for the fencing methods config key.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310174 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 05:07:33 +00:00
Todd Lipcon
d483b6f3fc HADOOP-8077. HA: fencing method should be able to be configured on a per-NN or per-NS basis. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310173 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 04:56:26 +00:00
Todd Lipcon
04cc1d614d HADOOP-8251. Fix SecurityUtil.fetchServiceTicket after HADOOP-6941. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310168 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 04:47:05 +00:00
Todd Lipcon
844faefd08 HDFS-3200. Scope all ZKFC configurations by nameservice. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310165 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 04:27:44 +00:00
Tsz-wo Sze
bf5b508074 HADOOP-6963. In FileUtil.getDU(..), neither include the size of directories nor follow symbolic links. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309994 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 18:28:34 +00:00
Aaron Myers
8a109ebebb HADOOP-8244. Improve comments on ByteBufferReadable.read. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309625 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 23:36:29 +00:00
Todd Lipcon
00a1548005 Merge trunk into auto-HA branch 
Resolved some trivial conflicts in NNHAServiceTarget


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309576 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 20:00:15 +00:00
Robert Joseph Evans
fcacb14a1e HADOOP-8179. risk of NPE in CopyCommands processArguments() (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309572 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 19:53:09 +00:00
Todd Lipcon
b74d742785 HADOOP-8245. Fix flakiness in TestZKFailoverController. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309554 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 19:21:01 +00:00
Todd Lipcon
dae6daba8c HADOOP-8007. Use substitution tokens for fencing argument. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309285 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 08:27:16 +00:00
Todd Lipcon
30e1b3bba8 HADOOP-8215. Security support for ZK Failover controller. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309185 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 23:37:15 +00:00
Todd Lipcon
39a5fd5c71 Merge trunk into auto-failover branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309164 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 21:48:23 +00:00
Todd Lipcon
84ff2d6d06 HADOOP-8243. Security support broken in CLI (manual) failover controller. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309135 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 20:41:26 +00:00
Eli Collins
9b1d2949ae HADOOP-8242. AbstractDelegationTokenIdentifier: add getter methods for owner and realuser. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308485 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 19:22:10 +00:00
Eli Collins
950273bde4 HADOOP-8210. Common side of HDFS-3148: The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308457 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 18:49:06 +00:00
Todd Lipcon
2fd05aa597 Merge trunk into auto-failover branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1308260 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 07:28:42 +00:00
Todd Lipcon
a4ccb8f504 HADOOP-8236. haadmin should have configurable timeouts for failover commands. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308235 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 03:48:28 +00:00
Eli Collins
78e3568340 HADOOP-8238. NetUtils#getHostNameOfIP blows up if given ip:port string w/o port. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308192 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 20:07:03 +00:00
Todd Lipcon
543701387f HADOOP-8228. Auto HA: Refactor tests and add stress tests. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307599 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 20:30:47 +00:00
Todd Lipcon
6693167028 HADOOP-8220. ZKFailoverController doesn't handle failure to become active correctly. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307596 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 20:23:59 +00:00
Todd Lipcon
04416861eb Amend HADOOP-8212 (Improve ActiveStandbyElector's behavior when session expires) 
Amendment patch incorporates following feedback from Bikas Saha:
- adds a new functional test for session expiration while in the standby state
- adds a safety check in the StatCallback for session expiration
- improves some comments


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307128 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 21:49:37 +00:00
Eli Collins
978404d1a8 HADOOP-8208. Disallow self failover. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306935 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 15:48:58 +00:00
Todd Lipcon
84a97fbcf6 HADOOP-8218. RPC.closeProxy shouldn't throw error when closing a mock. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306164 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 04:53:26 +00:00
Suresh Srinivas
600e327a56 HADOOP-8202. RPC stopProxy() does not close the proxy correctly. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305704 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 01:31:29 +00:00
Todd Lipcon
578f413778 HADOOP-8206. Common portion of a ZK-based failover controller. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305673 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 23:37:33 +00:00
Todd Lipcon
31c2e3f29c HADOOP-8212. Improve ActiveStandbyElector's behavior when session expires. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305510 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 19:31:43 +00:00
Todd Lipcon
1d5e7dde95 HADOOP-8204. TestHealthMonitor fails occasionally. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305199 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 01:57:03 +00:00
Todd Lipcon
840df19cee HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305195 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 01:54:14 +00:00
Todd Lipcon
39775dca68 Revert HADOOP-8193 from r1304967. Patch introduced some NPEs in a test case. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305152 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-25 21:38:31 +00:00
Todd Lipcon
90ea037d21 HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304967 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 23:48:07 +00:00
Todd Lipcon
805c1280ce HADOOP-8163. Improve ActiveStandbyElector to provide hooks for fencing old active. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304675 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 00:05:33 +00:00
Thomas White
1ff0359aa0 HADOOP-7030. Add TableMapping topology implementation to read host to rack mapping from a file. Contributed by Patrick Angeles and tomwhite. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304597 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 21:03:30 +00:00
Tsz-wo Sze
081eda94fe HADOOP-8184. ProtoBuf RPC engine uses the IPC layer reply packet. Contributed by Sanjay Radia 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304542 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 18:21:45 +00:00
Todd Lipcon
b795c65f49 HDFS-3071. haadmin failover command does not provide enough detail when target NN is not ready to be active. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304203 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 06:29:40 +00:00
Eli Collins
b5a8ccb75b HADOOP-8159. NetworkTopology: getLeaf should check for invalid topologies. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304118 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 22:43:28 +00:00
Alejandro Abdelnur
a8ebdaeb08 HADOOP-8197. Configuration logs WARNs on every use of a deprecated key (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303884 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 16:46:48 +00:00
Todd Lipcon
76817c28a2 HADOOP-8157. Fix race condition in Configuration that could cause spurious ClassNotFoundExceptions after a GC. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303634 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 00:49:06 +00:00
Todd Lipcon
19495b2f4b HADOOP-7788. Add simple HealthMonitor class to watch an HAService. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303208 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 23:29:18 +00:00
Todd Lipcon
8fd473cf4c HADOOP-8191. SshFenceByTcpPort uses netcat incorrectly. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303148 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 21:01:39 +00:00
Aaron Myers
4ceca97606 HDFS-3083. Cannot run an MR job with HA and security enabled when second-listed NN active. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303098 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 19:00:56 +00:00
Aaron Myers
12fca4cf33 HADOOP-8189. LdapGroupsMapping shouldn't throw away IOException. Contributed by Jonathan Natkins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302783 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 06:32:49 +00:00
Aaron Myers
21426e6e42 HADOOP-8121. Active Directory Group Mapping Service. Contributed by Jonathan Natkins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302740 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 01:00:14 +00:00
Harsh J
978e2d662a HADOOP-8183. Stop using mapred.used.genericoptions.parser (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302598 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-19 19:06:48 +00:00
Uma Maheswara Rao G
a019a6f7c9 HADOOP-8177. MBeans shouldn't try to register when it fails to create MBeanName. (Contributed by Devaraj K). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302067 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-18 05:54:33 +00:00
Robert Joseph Evans
0ac5e89419 HADOOP-8088. User-group mapping cache incorrectly does negative caching on transient failures (Khiwal Lee via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302062 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-18 04:07:41 +00:00
Robert Joseph Evans
af3163d1d1 HADOOP-8176. Disambiguate the destination of FsShell copies (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301612 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 16:08:00 +00:00
Robert Joseph Evans
3e8c273f37 MAPREDUCE-4010. TestWritableJobConf fails on trunk (tucu via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301551 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 14:39:01 +00:00
Devaraj Das
2a0147f8f6 HADOOP-6941. Adds support for building Hadoop with IBM's JDK. Contributed by Stephen Watt, Eli Collins and Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301308 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 01:45:12 +00:00
Tsz-wo Sze
483ca92d9b HADOOP-8175. Add -p option to mkdir in FsShell. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301303 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 01:28:38 +00:00
Tsz-wo Sze
c7feccd7ed Revert previous commit r1301273 for HADOOP-8175. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301282 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 23:53:37 +00:00
Tsz-wo Sze
889a863da1 HADOOP-8175. FsShell: Add -p option to mkdir. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301273 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 23:42:38 +00:00
Tsz-wo Sze
dffd37926d HADOOP-8173. FsShell needs to handle quoted metachars. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301250 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 22:36:00 +00:00
Alejandro Abdelnur
9180eca592 HADOOP-8167. Configuration deprecation logic breaks backwards compatibility (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300642 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-14 17:07:26 +00:00
Suresh Srinivas
03e036b51e HADOOP-8164. Back slash as path separator is handled for Windows only. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300290 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 19:07:08 +00:00
Uma Maheswara Rao G
42900bd080 HADOOP-7900. LocalDirAllocator confChanged() accesses conf.get() twice. Contributed by Ravi Gummadi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299434 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-11 19:23:45 +00:00
Uma Maheswara Rao G
3c373405e0 HADOOP-8146. FsShell commands cannot be interrupted. Contributed by Daryn Shar 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298976 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 18:48:35 +00:00
Eli Collins
07c3b02281 HADOOP-7806. Support binding to sub-interfaces. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298700 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 04:43:06 +00:00
Eli Collins
d8cc362350 HADOOP-8154. DNS#getIPs shouldn't silently return the local host IP for bogus interface names. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298696 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 03:51:15 +00:00
Todd Lipcon
0aeed92a75 HADOOP-8141. Add method to SecurityUtil to init krb5 cipher suites. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298036 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-07 18:42:53 +00:00
Robert Joseph Evans
bb86825d49 HADOOP-8140. dfs -getmerge should process its argments better (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297771 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 22:44:26 +00:00
Aaron Myers
26cd2356e0 HADOOP-8135. Add ByteBufferReadable interface to FSDataInputStream. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296556 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-03 02:02:23 +00:00
Aaron Myers
ffa527138b Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296485 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 21:43:28 +00:00
Robert Joseph Evans
97d104767d HADOOP-8131. FsShell put doesn't correctly handle a non-existent dir (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296386 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 19:03:05 +00:00
Todd Lipcon
87d1c67944 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296025 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 01:48:32 +00:00
Aaron Myers
7be4e5bd22 HDFS-3039. Address findbugs and javadoc warnings on branch. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296017 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 01:32:49 +00:00
Tsz-wo Sze
b2f67b4704 HADOOP-8124, HDFS-3034, MAPREDUCE-3956. Remove the deprecated Syncable.sync(). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295999 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 23:51:19 +00:00
Todd Lipcon
1d3a0c9557 Fix two more issues from trunk merge just committed -- removal of VersionedProtocol 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295349 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 00:08:13 +00:00
Todd Lipcon
1ba357553a Merge trunk into HA branch. 
Resolved some semantic conflicts in TestFileAppendRestart - we now log more OP_ADDs in the HA branch than we did in trunk.
Resolved some conflicts around removal of VersionedProtocol, etc.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295342 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 23:47:49 +00:00
Sanjay Radia
7ae04652a6 HADOOP-7557 Make IPC header be extensible (sanjay radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295261 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 20:43:21 +00:00
Tsz-wo Sze
2249e004d0 HADOOP-8118. In metrics2.util.MBeans, change log level to trace for the stack trace of InstanceAlreadyExistsException. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295240 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 19:57:43 +00:00
Harsh J
e478bc4384 HADOOP-7940. The Text.clear() method does not clear the bytes as intended. Contributed by Csaba Miklos. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295061 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 10:52:22 +00:00
Jitendra Nath Pandey
271654c6f5 HADOOP-7994. Remove getProtocolVersion and getProtocolSignature from the client side translator and server side implementation. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295016 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 08:52:21 +00:00
Aaron Myers
978a8050e2 HDFS-2920. fix remaining TODO items. Contributed by Aaron T. Myers and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294923 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 01:09:07 +00:00
Aaron Myers
375c6b8f2e Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294762 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 18:33:41 +00:00
Alejandro Abdelnur
e43656c711 HADOOP-8098. KerberosAuthenticatorHandler should use _HOST replacement to resolve principal name (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294757 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 18:26:53 +00:00
Aaron Myers
328702891e Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293279 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 14:49:38 +00:00
Jitendra Nath Pandey
584a1ca1f7 HADOOP-8108. Move method getHostPortString() from NameNode to NetUtils. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293128 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 08:16:40 +00:00
Suresh Srinivas
22d5944c42 HADOOP-8085. Add RPC metrics to ProtobufRpcEngine. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293071 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 04:05:39 +00:00
Aaron Myers
60ab29759e Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291893 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-21 16:24:40 +00:00
Devaraj Das
ae7e43139d HADOOP-8084. Updates ProtoBufRpc engine to not do an unnecessary copy for RPC request/response. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291602 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-21 05:19:53 +00:00
Aaron Myers
f0db867292 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291400 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-20 18:33:37 +00:00
Matthew Foley
def0ac8060 HADOOP-8050. Deadlock in metrics. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291084 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-19 22:45:12 +00:00
Steve Loughran
145338bc44 HADOOP-7680 TestHardLink fails on Mac OS X, when gnu stat is in path. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1290868 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 21:05:06 +00:00
Steve Loughran
3f8d7dbde3 HADOOP-8046 Revert StaticMapping semantics to the existing ones, add DNS mapping diagnostics in progress 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245911 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 12:57:49 +00:00
Aaron Myers
53b7d6c6bc Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245690 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 18:19:31 +00:00
Robert Joseph Evans
1425c65b5e HADOOP-8054. NPE with FilterFileSystem (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245637 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 16:27:27 +00:00
Aaron Myers
7933dc5838 HDFS-2586. Add protobuf service and implementation for HAServiceProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245338 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 07:37:43 +00:00
Aaron Myers
833e96534f Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245117 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 18:35:32 +00:00
Eli Collins
1ceb0eeaf4 HADOOP-8074. Small bug in hadoop error message for unknown commands. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244766 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 22:23:20 +00:00
Aaron Myers
1fb0ab92f8 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244645 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 19:04:17 +00:00
Todd Lipcon
cdc8146bd4 HADOOP-8068. void methods can swallow exceptions when going through failover path. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244628 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 18:20:11 +00:00
Todd Lipcon
063be5749d HADOOP-6502. Improve the performance of Configuration.getClassByName when the class is not found by caching negative results. Contributed by Sharad Agarwal and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244620 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 18:10:21 +00:00
Aaron Myers
011611c765 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244202 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 20:37:10 +00:00
Todd Lipcon
f42e58c381 HADOOP-8071. Avoid an extra packet in client code when nagling is disabled. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244189 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 19:47:02 +00:00
Todd Lipcon
82ffe0e732 HADOOP-8070. Add a standalone benchmark for RPC call performance. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244185 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 19:29:42 +00:00
Todd Lipcon
db187cf40e Merge trunk into HA branch. 
Some conflicts around TestBlockRecovery: mocking changed for new heartbeat types/responses


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243691 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 21:00:37 +00:00
Matthew Foley
00ee0585ab HADOOP-8052. Hadoop Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to avoid making Ganglia's gmetad core. Contributed by Varun Kapoor. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243207 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-12 07:47:35 +00:00
Todd Lipcon
a626fa04f9 Revert HDFS-2922 via svn merge -c -1242572 
The patch broke a lot of unit tests in the nightly build. Will recommit after it is fixed.



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242874 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 18:17:21 +00:00
Todd Lipcon
c14bb61a82 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242635 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 01:49:08 +00:00
Eli Collins
8af96c7b22 HDFS-2917. HA: haadmin should not work if run by regular user. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242626 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 00:46:17 +00:00
Thomas Graves
2a2faac0de HADOOP-8048. Allow merging of Credentials (Daryn Sharp via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242616 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 00:17:49 +00:00
Eli Collins
a63e12c4c8 HDFS-2922. HA: close out operation categories. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242572 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 22:33:20 +00:00
Todd Lipcon
1b4c990b61 HADOOP-8041. Log a warning when a failover is first attempted. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242441 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 18:25:44 +00:00
Todd Lipcon
5e26de982b HDFS-2924. Standby checkpointing fails to authenticate in secure cluster. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242439 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 18:22:02 +00:00
Robert Joseph Evans
7f7b05226e HADOOP-8042. When copying a file out of HDFS, modifying it, and uploading it back into HDFS, the put fails due to a CRC mismatch (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242389 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 16:41:44 +00:00
Todd Lipcon
e918b91e23 HDFS-2579. Starting delegation token manager during safemode fails. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242225 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 06:12:01 +00:00
Aaron Myers
2d1406e9e7 HADOOP-8027. Visiting /jmx on the daemon web interfaces may print unnecessary error in logs. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241303 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 01:09:34 +00:00
Eli Collins
c17b4f8eef HDFS-2819. Document new HA-related configs in hdfs-default.xml. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240914 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 08:21:06 +00:00
Eli Collins
7b913180be HDFS-2808. HA: haadmin should use namenode ids. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240600 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 20:12:51 +00:00
Aaron Myers
ec6961b39c HDFS-2792. Make fsck work. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240449 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 03:10:39 +00:00
Robert Joseph Evans
da00476fca HADOOP-8013 ViewFileSystem does not honor setVerifyChecksum (Dayrn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240383 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-03 22:55:52 +00:00
Robert Joseph Evans
7e8bf2c7ee HADOOP-8015 ChRootFileSystem should extend FilterFileSystem (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239924 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 23:24:04 +00:00
Eli Collins
4324e1bcd7 HADOOP-7991. HA: the FailoverController should check the standby is ready before failing over. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239774 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 19:20:32 +00:00
Robert Joseph Evans
58ba16e85f HADOOP-8001 ChecksumFileSystem's rename doesn't correctly handle checksum files (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239727 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 17:12:44 +00:00
Robert Joseph Evans
f8a245c273 HADOOP-8006 TestFSInputChecker is failing in trunk. (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238841 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 22:40:25 +00:00
Eli Collins
6884348444 HADOOP-7938. HA: the FailoverController should optionally fence the active during failover. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238058 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-30 22:42:46 +00:00
Eli Collins
5c156519df HADOOP-7983. HA: failover should be able to pass args to fencers. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238049 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-30 22:27:42 +00:00
Aaron Myers
6122357da5 HDFS-2841. HAAdmin does not work if security is enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237534 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-30 02:52:27 +00:00
Aaron Myers
30dd704e6c Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237157 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 20:33:30 +00:00
Mahadev Konar
934047630a HADOOP-8002. SecurityUtil acquired token message should be a debug rather than info. (Arpit Gupta via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236976 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 04:05:19 +00:00
Todd Lipcon
327c216c2f Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236965 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 02:50:23 +00:00
Jitendra Nath Pandey
ed6a73140e HADOOP-7988. Upper case in hostname part of the principals doesn't work with kerberos. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236960 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 02:24:08 +00:00
Aaron Myers
2b2e56056e Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236936 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 00:21:07 +00:00
Robert Joseph Evans
cc8a2a29f1 HADOOP-7998 CheckFileSystem does not correctly honor setVerifyChecksum (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236911 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-27 22:42:47 +00:00
Mahadev Konar
c8bb6f59b8 HADOOP-7993. Hadoop ignores old-style config options for enabling compressed output. (Anupam Seth via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236506 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-27 03:42:36 +00:00
Eli Collins
c5caed914d HADOOP-7997. SequenceFile.createWriter(...createParent...) no longer works on existing file. Contributed by Gregory Chanan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236456 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-27 00:09:10 +00:00
Jitendra Nath Pandey
12289efa2b HADOOP-7965. Support for protocol version and signature in PB. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236444 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-26 23:23:03 +00:00
Aaron Myers
1c95060a72 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236333 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-26 18:03:46 +00:00
Jitendra Nath Pandey
a00640a3db HADOOP-7987. Support setting the run-as user in unsecure mode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235945 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-25 21:02:47 +00:00
Suresh Srinivas
cbfe8fea0e HADOOP-7992. Add ZKClient library to facilitate leader election. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235841 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-25 17:26:20 +00:00
Jitendra Nath Pandey
0b2245a0f3 HDFS-2807. Service level authorizartion for HAServiceProtocol. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235431 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 19:31:49 +00:00
Todd Lipcon
fa4a33a566 Merge trunk into HA branch. 
- Some conflicts on BlockManager due to the recent commit of HDFS-2822 - moved logic to processMisReplicatedBlock function
- testNoExtensionIfNoBlocks(org.apache.hadoop.hdfs.TestSafeMode) is now failing due to an existing bug in the HA branch, to be fixed soon 


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235078 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 00:00:05 +00:00
Mahadev Konar
f07d91a1fc HADOOP-7981. Improve documentation for org.apache.hadoop.io.compress.Decompressor.getRemaining (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235007 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 21:44:49 +00:00
Aaron Myers
2abe5c818d Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234087 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-20 19:30:53 +00:00
Todd Lipcon
b7eb5334f5 HADOOP-7982. UserGroupInformation fails to login if thread's context classloader can't load HadoopLoginModule. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233751 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-20 03:33:50 +00:00
Todd Lipcon
212678f036 HDFS-2767. ConfiguredFailoverProxyProvider should support NameNodeProtocol. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232284 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 03:10:25 +00:00
Aaron Myers
940eeb866c Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232184 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-16 21:57:28 +00:00
Harsh J
a9002bfea1 HADOOP-7968. Errant println left in RPC.getHighestSupportedProtocol (Sho Shimauchi via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231732 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-15 19:15:04 +00:00
Suresh Srinivas
72207596be HADOOP-7972. HAServiceProtocol exceptions need to be unwrapped. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230861 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 02:30:29 +00:00
Aaron Myers
8610a9231a Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230696 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 18:40:50 +00:00
Suresh Srinivas
09e5af76f3 HADOOP-7970. HAServiceProtocol methods must throw IOException.Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230351 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 01:39:30 +00:00
Suresh Srinivas
8f83a2355b HADOOP-7964. Deadlock in NetUtils and SecurityUtil class initialization. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230249 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 21:02:04 +00:00
Aaron Myers
ede7f21278 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230248 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 20:53:50 +00:00
Todd Lipcon
44d070cd01 HDFS-2724. NN web UI can throw NPE after startup, before standby state is entered. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229466 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-10 03:46:05 +00:00
Vinod Kumar Vavilapalli
8feb26f116 HADOOP-7963. Fix ViewFS to catch a null canonical service-name and pass tests TestViewFileSystem* (Siddharth Seth via vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229379 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-09 21:52:53 +00:00
Eli Collins
fcf1039cdc Previous commit didn't fixup package statements. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228561 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 03:29:35 +00:00
Eli Collins
2d0b340c47 HADOOP-7961. Move HA fencing to common. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228510 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 00:17:42 +00:00
Aaron Myers
d680080da0 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228339 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-06 18:47:05 +00:00
Thomas White
a878bea3fe HADOOP-7937. Forward port SequenceFile#syncFs and friends from Hadoop 1.x. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1228291 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-06 17:24:55 +00:00
Harsh J
574f0b4c0a HADOOP-4515. Configuration#getBoolean must not be case sensitive. (Sho Shimauchi via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227964 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-06 05:42:24 +00:00
Aaron Myers
20af88280a Fix bad merge which mixed up two configuration options. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227962 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-06 05:37:24 +00:00
Jitendra Nath Pandey
a230d19d99 HADOOP-7957. Classes deriving GetGroupsBase should be able to override proxy creation. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227861 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 21:56:47 +00:00
Eli Collins
fb9cdcfa60 HADOOP-7924. 
FailoverController for client-based configuration. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227836 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 21:02:59 +00:00
Aaron Myers
3187a3ae05 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227775 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 19:21:01 +00:00
Suresh Srinivas
4bb572d336 HADOOP-7808. Port HADOOP-7510 - Add configurable option to use original hostname in token instead of IP to allow server IP change. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227737 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 18:41:59 +00:00
Eli Collins
85c4158074 HADOOP-7949. Updated maxIdleTime default in the code to match core-default.xml. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227423 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 01:31:14 +00:00
Aaron Myers
cd81cc6664 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227260 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 18:47:51 +00:00
Siddharth Seth
7ee3e072b8 HADOOP-7933. Add a getDelegationTokens api to FileSystem which checks for known tokens in the passed Credentials object. (sseth) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226916 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-03 18:58:57 +00:00
Aaron Myers
f216303598 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225612 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 18:25:48 +00:00
Harsh J
07027b80f3 HADOOP-7910. Add Configuration.getLongBytes to handle human readable byte size values. (Sho Shimauchi via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225489 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 10:27:14 +00:00
Aaron Myers
d619dee4ed Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225264 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-28 18:37:22 +00:00
Harsh J
1e0c51c66e HADOOP-7348. Change 'addnl' in getmerge util to be a flag '-nl' instead (XieXianshan via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225192 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-28 14:30:19 +00:00
Harsh J
9eb87574a3 HADOOP-7574. Improve FSShell -stat, add user/group elements (XieXianshan via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225114 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-28 06:48:31 +00:00
Aaron Myers
a500ba50c2 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1224965 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-27 18:18:36 +00:00
Alejandro Abdelnur
ae0d48854d HDFS-2707. HttpFS should read the hadoop-auth secret from a file instead inline from the configuration. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1224794 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-26 19:37:25 +00:00
Todd Lipcon
009dfed8d7 HADOOP-7932. Make client connection retries on socket time outs configurable. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220957 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 21:32:55 +00:00
Todd Lipcon
8ff28f4549 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220616 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 05:34:51 +00:00
Todd Lipcon
45e81ae415 HADOOP-7925. Add interface and update CLI to query current state to HAServiceProtocol. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220611 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 05:21:24 +00:00
Todd Lipcon
191b56d802 HADOOP-7657. Add support for LZ4 compression. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220314 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-18 00:54:18 +00:00
Aaron Myers
08c9dc3780 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215367 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-17 00:31:46 +00:00
Aaron Myers
059290ce3a HADOOP-7931. o.a.h.ipc.WritableRpcEngine should have a way to force initialization. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215358 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-17 00:14:36 +00:00
Aaron Myers
116bf57bd6 HADOOP-7928. HA: Client failover policy is incorrectly trying to fail over all IOExceptions. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215019 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 01:54:44 +00:00
Todd Lipcon
b77c107ccb Committing rest of merge from trunk (accidentally only committed the HDFS portion before) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214546 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 23:34:04 +00:00
Suresh Srinivas
d9c9fb913e HADOOP-7920. Remove Avro Rpc. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214114 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 08:45:59 +00:00
Todd Lipcon
d5a658e7a4 HADOOP-7921. StandbyException should extend IOException. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214093 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 08:10:34 +00:00
Todd Lipcon
9cf3e0805f HADOOP-7922. Improve some logging for client IPC failovers and StandbyExceptions. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214082 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 07:51:30 +00:00
Aaron Myers
9818091a66 HADOOP-7896. HA: if both NNs are in Standby mode, client needs to try failing back and forth several times with sleeps. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214076 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 07:24:36 +00:00
Todd Lipcon
fac14e799a HADOOP-7892. IPC logs too verbose after "RpcKind" introduction. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213954 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 21:59:34 +00:00
Alejandro Abdelnur
0201be46c2 HADOOP-7810. move hadoop archive to core from tools. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213907 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 20:17:59 +00:00
Aaron Myers
a0fe4f476a Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1213867 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 19:02:37 +00:00
Sanjay Radia
186df142cc HADOOP-7913 Fix bug in ProtoBufRpcEngine (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213619 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 09:18:04 +00:00
Aaron Myers
89379bc1a3 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1213389 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 19:41:20 +00:00
Alejandro Abdelnur
ad7d537caa HADOOP-7899. Generate proto java files as part of the build. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212615 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 20:37:57 +00:00
Alejandro Abdelnur
66fce20802 HADOOP-7902. skipping name rules setting (if already set) should be done on UGI initialization only. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212591 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 19:28:25 +00:00
Amar Kamat
82d57ee7fe HADOOP-7851. Configuration.getClasses() never returns the default value. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212282 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 08:50:09 +00:00
Eli Collins
2deaca4415 HADOOP-6886. LocalFileSystem Needs createNonRecursive API. Contributed by Nicolas Spiegelberg and Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212073 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 19:57:14 +00:00
Eli Collins
dec526076f HADOOP-6840. Support non-recursive create() in FileSystem and SequenceFile.Writer. Contributed by Jitendra and Eli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212062 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 19:29:02 +00:00
Suresh Srinivas
4283ac6d7a HADOOP-7897. ProtobufRpcEngine client side exception mechanism is not consistent with WritableRpcEngine. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212004 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 17:47:06 +00:00
Aaron Myers
d9ea5bb489 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1211749 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 02:57:47 +00:00
Aaron Myers
d9690b0922 HADOOP-7888. TestFailoverProxy fails intermittently on trunk. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211728 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 01:21:24 +00:00