big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
5,692 Commits 2 Branches 2 Tags 264 MiB
172d0cef69
Commit Graph

809 Commits

Author SHA1 Message Date
Konstantin Shvachko
481b6cccf0 HDFS-3598. WebHDFS support for file concat. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440290 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-30 06:51:57 +00:00
Harsh J
159b991e72 Reverting HADOOP-9241. To be fixed and reviewed. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439748 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 05:33:02 +00:00
Harsh J
96d724b441 HADOOP-9241. DU refresh interval is not configurable. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439129 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-27 17:52:16 +00:00
Tsz-wo Sze
74d1e5c302 Merge r1432789 through r1437840 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1437843 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-24 02:45:45 +00:00
Todd Lipcon
f5ab88b5b7 Fix trivial javadoc warning on branch 
(javadoc references parameter 'defaultVal' but it is actually 'defaultValue')


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437797 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-23 23:18:57 +00:00
Todd Lipcon
797465820b Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437623 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-23 18:51:24 +00:00
Todd Lipcon
89bd14913a HDFS-4416. Rename dfs.datanode.domain.socket.path to dfs.domain.socket.path. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1436568 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-21 19:29:06 +00:00
Suresh Srinivas
ae270e72cf HADOOP-8924. Add maven plugin alternative to shell script to save package-info.java. Contributed by Alejandro Abdelnur and Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435380 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-18 22:35:58 +00:00
Suresh Srinivas
f8cca2df8a HADOOP-8924. Revert r1435372 that missed some files 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435379 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-18 22:32:49 +00:00
Suresh Srinivas
98db9f5930 HADOOP-8924. Add maven plugin alternative to shell script to save package-info.java. Contributed by Alejandro Abdelnur and Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435372 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-18 22:18:12 +00:00
Robert Joseph Evans
5c5e6ed13a HADOOP-8849. FileUtil#fullyDelete should grant the target directories +rwx permissions (Ivan A. Veselovsky via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434868 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-17 19:19:10 +00:00
Todd Lipcon
db17fadd38 HADOOP-9216. CompressionCodecFactory#getCodecClasses should trim the result of parsing by Configuration. Contributed by Tsuyoshi Ozawa. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434569 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-17 07:19:41 +00:00
Thomas White
0d143ad723 HADOOP-9212. Potential deadlock in FileSystem.Cache/IPC/UGI. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433879 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-16 10:20:11 +00:00
Suresh Srinivas
06f086dd23 HADOOP-9106. Allow configuration of IPC connect timeout. Contributed by Rober Parker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433747 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 23:54:21 +00:00
Alejandro Abdelnur
8ab69eb0c3 HADOOP-8816. HTTP Error 413 full HEAD if using kerberos authentication. (moritzmoeller via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433567 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 18:27:30 +00:00
Eli Collins
e6dbad4f6f HADOOP-9178. src/main/conf is missing hadoop-policy.xml. Contributed by Sandy Ryza 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433275 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 03:25:12 +00:00
Todd Lipcon
2f4e2c607e Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433249 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:42:06 +00:00
Todd Lipcon
2fd41b3b42 HDFS-4402. Some small DomainSocket fixes: avoid findbugs warning, change log level, etc. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433242 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:31:35 +00:00
Suresh Srinivas
6d807fcab1 HADOOP-9203. RPCCallBenchmark should find a random available port. Contributec by Andrew Purtell. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433220 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 23:48:50 +00:00
Todd Lipcon
12bf674e8e Merge trunk into branch. 
Fixed a couple trivial conflicts due to HDFS-4363, which moved some methods
from HdfsProtoUtil to PBHelper


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433133 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 21:12:16 +00:00
Tsz-wo Sze
90d6d55a4b Merge r1426019 through r1432788 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432796 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 03:44:35 +00:00
Konstantin Shvachko
06406d7056 HDFS-1245. Plugable block id generation. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432539 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-13 01:13:29 +00:00
Todd Lipcon
6f8ee865de HDFS-4388. DomainSocket should throw AsynchronousCloseException when appropriate. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1432339 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-12 00:12:30 +00:00
Todd Lipcon
9a4030e0e8 HDFS-4356. BlockReaderLocal should use passed file descriptors rather than paths. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1432335 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 23:52:22 +00:00
Suresh Srinivas
93c1b4b25a Merge r1414455:r1426018 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432246 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 19:40:23 +00:00
Eric Yang
a8d60f4190 HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431739 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-10 23:58:11 +00:00
Thomas White
d863f7a1e4 HADOOP-9183. Potential deadlock in ActiveStandbyElector. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431251 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-10 10:05:53 +00:00
Aaron Myers
7e599d9e3b HADOOP-9155. FsPermission should have different default value, 777 for directory and 666 for file. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431148 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 23:30:41 +00:00
Todd Lipcon
d94621a0cd HDFS-4354. Create DomainSocket and DomainPeer and associated unit tests. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1431102 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 21:37:34 +00:00
Todd Lipcon
c9db06f2e4 HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1431097 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 21:34:13 +00:00
Tsz-wo Sze
2d4097840c HDFS-4244. Support snapshot deletion. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1430953 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 16:44:05 +00:00
Tsz-wo Sze
837e17b2ea svn merge -c -1430507 . for reverting HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430662 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 02:39:15 +00:00
Todd Lipcon
239b2742d0 HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430507 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 20:44:09 +00:00
Suresh Srinivas
f6ae596d1e HADOOP-9181. Set daemon flag for HttpServer's QueuedThreadPool. Contributed by Liang Xie. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429810 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-07 14:33:52 +00:00
Aaron Myers
0af8890b1a Add file which was accidentally missed during commit of HDFS-4346. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428560 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 19:20:52 +00:00
Suresh Srinivas
9ad8639e1c HADOOP-9162. Add utility to check native library availability. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425390 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-23 02:08:50 +00:00
Robert Joseph Evans
557b022406 HADOOP-9105. FsShell -moveFromLocal erroneously fails (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424566 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-20 16:19:48 +00:00
Thomas White
834e941044 HADOOP-9153. Support createNonRecursive in ViewFileSystem. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423824 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-19 11:14:15 +00:00
Aaron Myers
371abd6e21 HADOOP-9152. HDFS can report negative DFS Used on clusters with very small amounts of data. Contributed by Brock Noland. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423602 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-18 19:49:14 +00:00
Suresh Srinivas
7d8057707f HADOOP-9147. Add missing fields to FIleStatus.toString. Contributed by Jonathan Allen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423444 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-18 14:23:53 +00:00
Sanjay Radia
aa4fe26a01 HADOOP-9140 Cleanup rpc PB protos (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423189 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-17 22:16:57 +00:00
Luke Lu
3689933b26 HADOOP-9041. FsUrlStreamHandlerFactory could cause an infinite loop in FileSystem initialization. (Yanbo Liang and Radim Kolar via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422430 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-16 00:39:17 +00:00
Luke Lu
db09dba7ae HADOOP-8561. Introduce HADOOP_PROXY_USER for secure impersonation in child hadoop client processes. (Yu Gao via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422429 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-16 00:38:59 +00:00
Todd Lipcon
0e7e20de64 HADOOP-9135. JniBasedUnixGroupsMappingWithFallback should log at debug rather than info during fallback. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1421013 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 22:07:51 +00:00
Sanjay Radia
cd80628ec4 HADOOP-8957 AbstractFileSystem#IsValidName should be overridden for embedded file systems like ViewFs (Chris Nauroth via Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420965 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 20:54:30 +00:00
Eli Collins
8c2846510e HADOOP-9113. o.a.h.fs.TestDelegationTokenRenewer is failing intermittently. Contributed by Karthik Kambatla 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420490 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 00:10:37 +00:00
Todd Lipcon
22a78a75b4 HADOOP-9126. FormatZK and ZKFC startup can fail due to zkclient connection establishment delay. Contributed by Rakesh R and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419831 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 22:09:20 +00:00
Todd Lipcon
7ba12a628a HADOOP-6762. Exception while doing RPC I/O closes channel. Contributed by Sam Rash and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419782 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 21:25:29 +00:00
Tsz-wo Sze
f4a723249e Merge r1415804 through r1419190 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1419193 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 03:37:32 +00:00
Eric Yang
bcaba93941 HADOOP-8418. Update UGI Principal classes name for running with 
IBM JDK on 64 bits Windows.  (Yu Gao via eyang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418572 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-08 00:48:04 +00:00
Todd Lipcon
6681523c87 HDFS-4282. TestEditLog.testFuzzSequences FAILED in all pre-commit test. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418214 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 08:18:14 +00:00
Suresh Srinivas
a5331eeead HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-06 17:09:17 +00:00
Aaron Myers
3337588975 HADOOP-9070. Kerberos SASL server cannot find kerberos key. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417729 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-06 02:53:36 +00:00
Todd Lipcon
bd239a8d97 HADOOP-9103. UTF8 class does not properly decode Unicode characters outside the basic multilingual plane. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417649 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-05 21:13:46 +00:00
Suresh Srinivas
9821af9ce8 Reverting the previous merge r1416603 which committed some extra changes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1416712 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 22:43:00 +00:00
Suresh Srinivas
d500d59cbe Merging trunk to HDFS-2802 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1416603 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 18:04:51 +00:00
Suresh Srinivas
e5d54ac89a HADOOP-9090. Support on-demand publish of metrics. Contributed by Mostafa Elhemali. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416538 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 14:23:16 +00:00
Tsz-wo Sze
6ad4752853 Merge r1414455 through r1415803 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1415809 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 19:52:49 +00:00
Tsz-wo Sze
833b928adf HDFS-3495. Update Balancer to support new NetworkTopology with NodeGroup. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414878 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-28 19:41:57 +00:00
Tsz-wo Sze
1ce3274dd5 Merge r1412283 through r1414454 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1414456 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-27 23:02:00 +00:00
Alejandro Abdelnur
f6230b1c8c HADOOP-9084. Augment DelegationTokenRenewer API to cancel the tokens on calls to removeRenewAction. (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414326 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-27 19:23:05 +00:00
Suresh Srinivas
3b3a72e622 HADOOP-9093. Move all the Exception in PathExceptions to o.a.h.fs package. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413960 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-27 00:40:55 +00:00
Robert Joseph Evans
68bc61ab5c HADOOP-9038. unit-tests for AllocatorPerContext.PathIterator (Ivan A. Veselovsky via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413776 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-26 18:47:20 +00:00
Robert Joseph Evans
0d92f54e82 HADOOP-8992. Enhance unit-test coverage of class HarFileSystem (Ivan A. Veselovsky via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413743 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-26 17:45:57 +00:00
Tsz-wo Sze
3dd84fcef7 Merge r1410998 through r1412282 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1412297 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 21:08:45 +00:00
Thomas White
d6af507199 HADOOP-9049. DelegationTokenRenewer needs to be Singleton and FileSystems should register/deregister to/from. Contributed by Karthik Kambatla. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412077 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 12:29:37 +00:00
Suresh Srinivas
c24bc56484 HADOOP-9075. FileContext#FSLinkResolver should be made static. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411988 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 05:55:48 +00:00
Tsz-wo Sze
d8ffea5943 Merge r1408927 through r1410997 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1411007 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 22:31:28 +00:00
Robert Joseph Evans
86ce5f6c91 HADOOP-9035. Generalize setup of LoginContext (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410018 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 21:14:37 +00:00
Alejandro Abdelnur
ce2067fb15 HADOOP-6607. Add different variants of non caching HTTP headers. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409921 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 18:45:58 +00:00
Daryn Sharp
97e52dd71e HDFS-4104. dfs -test -d prints inappropriate error on nonexistent directory (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409848 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 15:51:03 +00:00
Alejandro Abdelnur
ec8ed4e951 HADOO-8998. set Cache-Control no-cache header on all dynamic content. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409095 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 06:22:11 +00:00
Tsz-wo Sze
2a9f450511 Merge r1407704 through r1408926 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1408938 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 20:21:39 +00:00
Daryn Sharp
fe8f635b78 HADOOP-8999. SASL negotiation is flawed (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408837 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 17:10:13 +00:00
Eli Collins
3492ab6de0 HDFS-1322. Document umask in DistributedFileSystem#mkdirs javadocs. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408532 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 01:28:33 +00:00
Robert Joseph Evans
4755ef989a HADOOP-9021. Enforce configured SASL method on the server (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408473 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 22:13:00 +00:00
Tsz-wo Sze
40fe1ffbaa Merge r1406415 through r1407703 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1407706 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-10 00:49:15 +00:00
Robert Joseph Evans
de1f33dc35 HADOOP-9020. Add a SASL PLAIN server (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407622 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 20:40:09 +00:00
Alejandro Abdelnur
f8c486fbc8 HADOOP-7115. Add a cache for getpwuid_r and getpwgid_r calls (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407577 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 18:25:49 +00:00
Sanjay Radia
76d43a08ed HADOOP-8589 ViewFs tests fail when tests and home dirs are nested (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406939 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-08 06:16:02 +00:00
Robert Joseph Evans
1594dd6965 HADOOP-9015. Standardize creation of SaslRpcServers (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406851 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 22:50:48 +00:00
Robert Joseph Evans
3c02237459 HADOOP-9014. Standardize creation of SaslRpcClients (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406689 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 16:05:03 +00:00
Robert Joseph Evans
cb293a62a5 HADOOP-9013. UGI should not hardcode loginUser's authenticationType (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406684 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 15:56:46 +00:00
Tsz-wo Sze
92c440c115 Merge r1406007 through r1406326 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1406337 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 21:11:42 +00:00
Daryn Sharp
3a698e6aea HDFS-1331. dfs -test should work like /bin/test (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406198 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 15:57:58 +00:00
Robert Joseph Evans
5605b54010 HADOOP-9012. IPC Client sends wrong connection context (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406184 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 15:37:14 +00:00
Robert Joseph Evans
b1aa62a848 HADOOP-9010. Map UGI authenticationMethod to RPC authMethod (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405910 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 18:37:39 +00:00
Robert Joseph Evans
8303175db8 HADOOP-9009. Add SecurityUtil methods to get/set authentication method (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405904 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 18:26:49 +00:00
Tsz-wo Sze
f84000900a HDFS-4149. Implement the disallowSnapshot(..) in FSNamesystem and add resetSnapshottable(..) to SnapshotManager. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1405683 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 00:40:54 +00:00
Tsz-wo Sze
e341184d54 Merge r1403306 through r1404284 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1404285 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 18:34:51 +00:00
Thomas Graves
aac5c149c7 MAPREDUCE-4752. Reduce MR AM memory usage through String Interning (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404177 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 14:57:12 +00:00
Robert Joseph Evans
12eb3b8abc HADOOP-8986. Server$Call object is never released after it is sent (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403745 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 15:46:15 +00:00
Suresh Srinivas
2d5334931e HDFS-4097. Provide CLI support for createSnapshot. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1401971 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 04:08:36 +00:00
Daryn Sharp
61ffa3adb9 MAPREDUCE-4229. Intern counter names in the JT (bobby via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401473 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 21:01:03 +00:00
Robert Joseph Evans
b73903f6a7 HADOOP-8962. RawLocalFileSystem.listStatus fails when a child filename contains a colon (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401325 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 15:47:26 +00:00
Robert Joseph Evans
13422461f3 HADOOP-8811. Compile hadoop native library in FreeBSD (Radim Kolar via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401321 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 15:32:25 +00:00
Suresh Srinivas
0dc2681900 HADOOP-8951. RunJar to fail with user-comprehensible error message if jar missing. Contributed by Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400921 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-22 15:55:04 +00:00
Suresh Srinivas
6f79fffb86 HADOOP-8900. BuiltInGzipDecompressor throws IOException - stored gzip size doesn't match decompressed size. Contributed by Slavik Krassovsky. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399377 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 18:36:32 +00:00
Robert Joseph Evans
224de4f92c HADOOP-8926. hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data (Gopal V via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399005 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 21:52:10 +00:00
Eli Collins
be2b9d0236 HADOOP-8931. Add Java version to startup message. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398998 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 21:29:18 +00:00
Robert Joseph Evans
6a059dc40e HADOOP-8922. Provide alternate JSONP output for JMXJsonServlet to allow javascript in browser dashboard (Damien Hardy via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398904 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 18:00:01 +00:00
Suresh Srinivas
9757f7407a HADOOP-8923. JNI-based user-group mapping modules can be too chatty on lookup failures. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398883 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 16:52:42 +00:00
Todd Lipcon
e0db1e9e10 HADOOP-8929. Add toString, other improvements for SampleQuantiles. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398658 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 06:06:20 +00:00
Suresh Srinivas
41eec8a32b HADOOP-8920. Add more javadoc to metrics2 related classes. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398640 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 04:29:50 +00:00
Jason Darrell Lowe
f8bdac0a1b HADOOP-8906. paths with multiple globs are unreliable. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397704 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 19:49:40 +00:00
Suresh Srinivas
611ff4ec89 HADOOP-8910. Add examples to GlobExpander#expand method. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397691 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 19:03:10 +00:00
Daryn Sharp
22ef03bc76 HADOOP-8784. Improve IPC.Client's token use (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397634 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 16:27:26 +00:00
Suresh Srinivas
94ed14c48c HADOOP-8911. CRLF characters in source and text files. Contributed Raja Aluri. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397432 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 04:35:42 +00:00
Eli Collins
2115bd2ec7 HADOOP-8886. Remove KFS support. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395820 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 00:16:26 +00:00
Aaron Myers
2b49b39f3c Revert initial commit of HADOOP-8884 per feedback from Todd. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395783 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 21:25:37 +00:00
Aaron Myers
2a32ba9f99 HADOOP-8884. DEBUG should be WARN for DEBUG util.NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError. Contributed by Anthony Rojas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395714 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 18:44:59 +00:00
Eli Collins
c50033d0c8 HADOOP-8804. Improve Web UIs when the wildcard address is used. Contributed by Senthil Kumar 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395703 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 18:17:39 +00:00
Alejandro Abdelnur
50b20477fd HADOOP-8881. FileBasedKeyStoresFactory initialization logging should be debug not info. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394165 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 17:32:01 +00:00
Daryn Sharp
a7d4f30131 HADOOP-8783. Improve RPC.Server's digest auth (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393483 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 13:43:53 +00:00
Eli Collins
fc54f57c59 HADOOP-8756. Fix SEGV when libsnappy is in java.library.path but not LD_LIBRARY_PATH. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393243 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 00:06:39 +00:00
Aaron Myers
ccabb684eb HADOOP-8616. ViewFS configuration requires a trailing slash. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392707 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-02 01:28:17 +00:00
Aaron Myers
c808caea75 Revert an errant commit of HADOOP-8616. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392705 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-02 01:26:27 +00:00
Aaron Myers
d1f4ec4ac8 HADOOP-8616. ViewFS configuration requires a trailing slash. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392703 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-02 01:17:00 +00:00
Aaron Myers
1ced82cc81 HADOOP-8866. SampleQuantiles#query is O(N^2) instead of O(N). Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391711 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 00:59:04 +00:00
Eli Collins
a33ae4020d HADOOP-8855. SSL-based image transfer does not work when Kerberos is disabled. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390841 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 05:03:42 +00:00
Eli Collins
47dfcf45af HDFS-3972. Trash emptier fails in secure HA cluster. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390729 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 21:25:04 +00:00
Jason Darrell Lowe
6ddbb22567 HADOOP-8843. Old trash directories are never deleted on upgrade from 1.x. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390616 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 17:14:27 +00:00
Todd Lipcon
9270635f33 HADOOP-3957. Change MutableQuantiles to use a shared thread for rolling over metrics. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390210 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 23:16:14 +00:00
Harsh J
a7e450c7cc HADOOP-8436. NPE In getLocalPathForWrite ( path, conf ) when the required context item is not configured. Contributed by Brahma Reddy Battula. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389799 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 11:10:11 +00:00
Harsh J
d50e06d9e0 HADOOP-7930. Kerberos relogin interval in UserGroupInformation should be configurable. Contributed by Robert Kanter. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389783 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 10:17:11 +00:00
Suresh Srinivas
5308a0ecd5 HADOOP-8813. Add InterfaceAudience and InterfaceStability annotations to RPC Server and Client classes. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389649 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-24 23:16:04 +00:00
Owen O'Malley
0187553d9a Fix the length of the secret key. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389194 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-24 03:45:07 +00:00
Harsh J
28379070d4 HADOOP-8588. SerializationFactory shouldn't throw a NullPointerException if the serializations list is empty. Contributed by Sho Shimauchi. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389002 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-23 10:32:13 +00:00
Harsh J
28023b7759 HADOOP-7256. Resource leak during failure scenario of closing of resources. Contributed by Ramkrishna S. Vasudevan. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388893 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-22 20:34:16 +00:00
Harsh J
bd76d9a827 HADOOP-8833. fs -text should make sure to call inputstream.seek(0) before using input stream. Contributed by Tom White and Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388869 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-22 18:56:07 +00:00
Eli Collins
7dee7f11f6 HDFS-3932. NameNode Web UI broken if the rpc-address is set to the wildcard. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388321 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 04:51:43 +00:00
Suresh Srinivas
4c56bccf5e HADOOP-8814. Replace string equals by String#isEmpty(). Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387853 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-20 04:06:11 +00:00
Alejandro Abdelnur
8bf6b80f2b Reverting HADOOP-8805 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387697 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 18:06:42 +00:00
Alejandro Abdelnur
9f6cfe32e4 HADOOP-8805. Move protocol buffer implementation of GetUserMappingProtocol from HDFS to Common. (bowang via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387298 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 18:15:37 +00:00
Eli Collins
ea6a36e2e7 HADOOP-8812. ExitUtil#terminate should print Exception#toString. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387273 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 17:32:01 +00:00
Eli Collins
4d2e77bc1c Revert previous commit - accidentally included two changes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386783 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 19:28:14 +00:00
Eli Collins
8a9debd0ef HADOOP-8806. libhadoop.so: dlopen should be better at locating libsnappy.so, etc. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386780 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 19:25:05 +00:00
Suresh Srinivas
6afabd7e57 HADOOP-8819. Incorrectly & is used instead of && in some file system implementations. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386451 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 01:39:11 +00:00
Suresh Srinivas
5d37911882 HADOOP-8821. Fix findbugs warning related concatenating string in a for loop in Configuration#dumpDeprecatedKeys(). Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385389 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-16 22:33:13 +00:00
Suresh Srinivas
0c53ed4cd1 HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-16 21:10:39 +00:00
Thomas White
d89828573d HADOOP-8780. Update DeprecatedProperties apt file. Contributed by Ahmed Radwan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384833 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-14 16:05:30 +00:00
Eli Collins
eb7f8a71e0 HADOOP-8801. ExitUtil#terminate should capture the exception stack trace. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384435 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-13 17:56:49 +00:00
Doug Cutting
de2efbe3ba HADOOP-8597. Permit FsShell's text command to read Avro files. Contributed by Ivan Vladimirov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383607 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 20:38:45 +00:00
Todd Lipcon
bdcbc2d1ef HADOOP-8786. HttpServer continues to start even if AuthenticationFilter fails to init. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383254 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 06:37:17 +00:00
Tsz-wo Sze
e8c193bf24 HADOOP-8754. Deprecate all the RPC.getServer() variants. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381845 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 03:09:53 +00:00
Alejandro Abdelnur
11312adedb HADOOP-8749. HADOOP-8031 changed the way in which relative xincludes are handled in Configuration. (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381703 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 18:15:37 +00:00
Eli Collins
91e832e7b4 HADOOP-8770. NN should not RPC to self to find trash defaults. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381319 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 19:42:09 +00:00
Suresh Srinivas
4911d9b1ff HADOOP-8736. Add Builder for building RPC server. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379652 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 22:40:51 +00:00
Robert Joseph Evans
38d003a6db HADOOP-8727. Gracefully deprecate dfs.umaskmode in 2.x onwards (Harsh J via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379537 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 18:27:23 +00:00
Suresh Srinivas
e5a9d672f0 HADOOP-8684. Deadlock between WritableComparator and WritableComparable. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379506 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 17:01:25 +00:00
Robert Joseph Evans
6f6e170325 HADOOP-8726. The Secrets in Credentials are not available to MR tasks (daryn and Benoy Antony via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379100 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 19:58:07 +00:00
Tsz-wo Sze
ec94ea2658 HADOOP-8748. Refactor DFSClient retry utility methods to a new class in org.apache.hadoop.io.retry. Contributed by Arun C Murthy 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378969 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 14:50:18 +00:00
Suresh Srinivas
e7b12c89e1 HADOOP-8619. WritableComparator must implement no-arg constructor. Contributed by Chris Douglas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378120 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 13:05:31 +00:00
Suresh Srinivas
deead78e35 HDFS-3844. Add @Override and remove {@inheritdoc} and unnecessary imports. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377168 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-25 01:03:22 +00:00
Suresh Srinivas
7a1dc1ab70 HDFS-3834. Remove unused static fields NAME, DESCRIPTION and Usage from Command. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377001 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 17:36:22 +00:00
Robert Joseph Evans
cffee556e4 HADOOP-8725. MR is broken when security is off (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376929 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 14:16:41 +00:00
Alejandro Abdelnur
bbf1f55bee HADOOP-8031. Configuration class fails to find embedded .jar resources; should use URL.openStream() (genman via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376772 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 23:24:25 +00:00
Alejandro Abdelnur
fc1fab9084 HADOOP-4572. Can not access user logs - Jetty is not configured by default to serve aliases/symlinks (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376753 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 22:52:47 +00:00
Robert Joseph Evans
4f8e1f779b HADOOP-8709. globStatus changed behavior from 0.20/1.x (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376653 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 19:18:05 +00:00
Robert Joseph Evans
aeb364d8b5 HADOOP-8225. DistCp fails when invoked by Oozie (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376618 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 18:06:56 +00:00
Robert Joseph Evans
34bd9794f7 HADOOP-8655. Fix TextInputFormat for large deliminators. (Gelesh via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376592 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 16:58:36 +00:00
Robert Joseph Evans
42beb56a2e HADOOP-8632. Configuration leaking class-loaders (Costin Leau via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376543 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 15:24:46 +00:00
Eli Collins
5b790ab046 HADOOP-8075. Lower native-hadoop library log from info to debug. Contributed by Hızır Sefa İrken 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376322 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 00:01:00 +00:00
Aaron Myers
d66223fd99 HADOOP-8721. ZKFC should not retry 45 times when attempting a graceful fence during a failover. Contributed by Vinayakumar B. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376194 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 18:54:02 +00:00
Aaron Myers
de8b34a70e HDFS-3835. Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376188 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 18:47:07 +00:00
Suresh Srinivas
e8477759ac HADOOP-8711. IPC Server supports adding exceptions for which the message is printed and the stack trace is not printed to avoid chatter. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375790 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 21:01:28 +00:00
Tsz-wo Sze
f2dd818201 HADOOP-8239. Add subclasses of MD5MD5CRC32FileChecksum to support file checksum with CRC32C. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375450 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 09:44:46 +00:00
Robert Joseph Evans
d5f080825c HADOOP-8611. Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails (Robert Parker via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375221 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-20 21:17:13 +00:00
Eli Collins
f58941f2ac HADOOP-8614. IOUtils#skipFully hangs forever on EOF. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375216 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-20 21:10:44 +00:00
Tsz-wo Sze
b0ea77303b HADOOP-8240. Add a new API to allow users to specify a checksum type on FileSystem.create(..). Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374696 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-19 05:46:57 +00:00
Eli Collins
54621c3776 HADOOP-8710. Remove ability for users to easily run the trash emptire. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374476 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 23:26:55 +00:00
Eli Collins
18c5bc86ca HADOOP-8689. Make trash a server side configuration option. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374472 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 23:22:17 +00:00
Daryn Sharp
8fa10b184e HADOOP-7967. Need generalized multi-token filesystem support (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374271 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 14:05:11 +00:00
Robert Joseph Evans
2926ae6ead HADOOP-8654. TextInputFormat delimiter bug (Gelesh and Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373859 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 14:23:28 +00:00
Tsz-wo Sze
3cab01ba6e HADOOP-8700. Use enum to define the checksum constants in DataChecksum. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373683 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 01:32:10 +00:00
Alejandro Abdelnur
5aeabcdf6f HADOOP-7754. Expose file descriptors from Hadoop-wrapped local FileSystems (todd and ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373235 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 06:40:29 +00:00
Alejandro Abdelnur
fd8ce04dc5 HADOOP-8699. some common testcases create core-site.xml in test-classes making other testcases to fail. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373206 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 04:21:04 +00:00
Suresh Srinivas
28e87740c5 HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373173 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:28:41 +00:00
Todd Lipcon
b38bd555e8 HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373061 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 20:11:40 +00:00
Alejandro Abdelnur
4bca22005f HADOOP-8681. add support for HTTPS to the web UIs. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371525 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 22:52:56 +00:00
Aaron Myers
9b4a7900c7 HDFS-3637. Add support for encrypting the DataTransferProtocol. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370354 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 16:40:03 +00:00
Alejandro Abdelnur
5383694df9 HADOOP-8644. AuthenticatedURL should be able to use SSLFactory. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370045 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-06 22:22:32 +00:00
Thomas Graves
12d0e02591 HADOOP-8633. Interrupted FsShell copies may leave tmp files (Daryn Sharp via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368002 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 14:02:22 +00:00
Robert Joseph Evans
75be1e0e76 HADOOP-8637. FilterFileSystem#setWriteChecksum is broken (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367702 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 18:58:43 +00:00
Robert Joseph Evans
7226dead1e HADOOP-8635. Cannot cancel paths registered deleteOnExit (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367296 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 20:58:44 +00:00
Robert Joseph Evans
48a2e2b4e2 HADOOP-8550. hadoop fs -touchz automatically created parent directories (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367202 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 18:11:32 +00:00
Robert Joseph Evans
d8584fde03 HADOOP-8634. Ensure FileSystem#close doesn't squawk for deleteOnExit paths (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367196 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 18:05:38 +00:00
Robert Joseph Evans
98f1523b20 HADOOP-8627. FS deleteOnExit may delete the wrong path (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367114 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 15:18:11 +00:00
Daryn Sharp
b3b72482e4 HADOOP-8613. AbstractDelegationTokenIdentifier#getUser() should set token auth type. (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366440 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-27 16:39:51 +00:00
Aaron Myers
c1ea9b4490 HDFS-3650. Use MutableQuantiles to provide latency histograms for various operations. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366246 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-27 00:26:21 +00:00
Todd Lipcon
2f478ac89c HADOOP-8642. ProtobufRpcEngine should log all RPCs if TRACE logging is enabled. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366127 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-26 18:22:00 +00:00
Alejandro Abdelnur
9d16c9354b MAPREDUCE-4417. add support for encrypted shuffle (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365979 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-26 13:23:05 +00:00
Todd Lipcon
06b394dcf9 Amend previous commit of HDFS-3626: accidentally included a hunk from HADOOP-8621 in svn commit. Reverting that hunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365817 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 22:04:59 +00:00
Todd Lipcon
972953bd77 HDFS-3626. Creating file with invalid path can corrupt edit log. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365801 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 21:52:38 +00:00
Robert Joseph Evans
0bfa7d79d0 HADOOP-8551. fs -mkdir creates parent directories without the -p option (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365588 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 13:56:29 +00:00
Robert Joseph Evans
a2d5603106 HADOOP-8606. FileSystem.get may return the wrong filesystem (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365224 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-24 19:00:50 +00:00
Aaron Myers
80e2b4117b HADOOP-8609. IPC server logs a useless message when shutting down socket. Contributed by Jon Zuanich. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363950 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-20 20:50:30 +00:00
Robert Joseph Evans
4c51dacd52 Reverting HADOOP-8551. fs -mkdir creates parent directories without the -p option 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363547 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-19 21:15:42 +00:00
Robert Joseph Evans
52c8271bf1 HADOOP-8551. fs -mkdir creates parent directories without the -p option (Daryn Sharp and John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363435 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-19 17:46:47 +00:00
Todd Lipcon
30099efb35 HADOOP-8599. Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362295 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 22:41:56 +00:00
Suresh Srinivas
2799d9659d HADOOP-8593. Add missed @Override annotations in Metric/Metrics2 package. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362294 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 22:38:29 +00:00
Eli Collins
4b519219de Amend HDFS-3666, applied earlier version of the patch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362278 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 21:49:35 +00:00
Eli Collins
527933f4f3 HDFS-3666. Plumb more exception messages to terminate. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362270 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 21:26:58 +00:00
Robert Joseph Evans
612443951b MAPREDUCE-4395. Possible NPE at ClientDistributedCacheManager#determineTimestamps (Bhallamudi via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362052 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 14:19:36 +00:00
Harsh J
0f122c209d HADOOP-8531. SequenceFile Writer can throw out a better error if a serializer or deserializer isn't available. Contributed by Madhukara Phatak. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361933 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 08:33:13 +00:00
Eli Collins
64fc2cb03d HDFS-3663. MiniDFSCluster should capture the code path that led to the first ExitException. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361775 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 19:43:39 +00:00
Harsh J
7351a01259 HADOOP-7818. DiskChecker#checkDir should fail if the directory is not executable. Contributed by Madhukara Phatak. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361717 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 15:33:27 +00:00
Harsh J
385f31ad85 HADOOP-8362. Improve exception message when Configuration.set() is called with a null key or value. Contributed by Madhukara Phatak and Suresh Srinivas (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361712 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 15:07:02 +00:00
Eli Collins
4a5ba3b7bd HDFS-3641. Move server Util time methods to common and use now instead of System#currentTimeMillis. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360858 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 19:01:49 +00:00
Aaron Myers
b5b0ac64a1 HADOOP-8541. Better high-percentile latency metrics. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360501 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 01:31:40 +00:00
Aaron Myers
96d77c17cc HADOOP-8585. Fix initialization circularity between UserGroupInformation and HadoopConfiguration. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360498 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 01:22:34 +00:00
Eli Collins
4c13b6f34e HADOOP-8587. HarFileSystem access of harMetaCache isn't threadsafe. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360448 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 22:28:54 +00:00
Eli Collins
cdae6953e8 HDFS-3582. Hook daemon process exit for testing. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360329 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 17:58:02 +00:00
Harsh J
e5ea2aa765 HADOOP-3886. Error in javadoc of Reporter, Mapper and Progressable. Contributed by Jingguo Yao. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360222 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 15:06:42 +00:00
Eli Collins
43e37b96f8 HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360056 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 08:21:22 +00:00
Eli Collins
151a1b0185 Revert previous commit, accidentally included HADOOP-8587. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360055 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 08:19:59 +00:00
Eli Collins
c41b97860d HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360048 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 08:10:00 +00:00
Thomas Graves
58a8826fb5 HADOOP-8573. Configuration tries to read from an inputstream resource multiple times (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359891 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 20:50:17 +00:00
Harsh J
caf9fe2f13 HADOOP-8423. MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data. Contributed by Todd Lipcon. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359866 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 19:58:49 +00:00
Aaron Myers
fb4a6ac9e9 HDFS-3568. fuse_dfs: add support for security. Contributed by Colin McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359824 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 18:28:13 +00:00
Robert Joseph Evans
0b7139d6bc HADOOP-8525. Provide Improved Traceability for Configuration (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359775 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 16:49:24 +00:00
Alejandro Abdelnur
820be7cbef MAPREDUCE-3993. Graceful handling of codec errors during decompression (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359345 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 19:19:00 +00:00
Alejandro Abdelnur
0a2252bdda HADOOP-8566. AvroReflectSerializer.accept(Class) throws a NPE if the class has no package (primitive types and arrays). (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358454 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-06 22:27:13 +00:00
Robert Joseph Evans
0e7204c9e7 MAPREDUCE-4379. Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358305 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-06 17:19:13 +00:00
Tsz-wo Sze
4d0cab2729 HDFS-3601. Add BlockPlacementPolicyWithNodeGroup to support block placement with 4-layer network topology. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357442 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-05 01:31:57 +00:00
Todd Lipcon
3728d16160 HDFS-3574. Fix small race and do some cleanup in GetImageServlet. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356939 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-03 20:55:29 +00:00
Todd Lipcon
b8389e4c73 HDFS-3343. Improve metrics for DN read latency. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356928 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-03 20:45:21 +00:00
Daryn Sharp
3c2101ae4a HADOOP-8110. Fix trash checkpoint collisions (Jason Lowe via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356897 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-03 19:59:56 +00:00
Eli Collins
161ed29087 HADOOP-8463. hadoop.security.auth_to_local needs a key definition and doc. Contributed by Madhukara Phatak 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356513 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-02 22:46:55 +00:00
Suresh Srinivas
22822df7c3 HADOOP-8533. Remove parallel call ununsed capability in RPC. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356504 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-02 22:15:44 +00:00
Harsh J
cb5867573e HADOOP-6802. Remove FS_CLIENT_BUFFER_DIR_KEY = "fs.client.buffer.dir" from CommonConfigurationKeys.java (not used, deprecated). Contributed by Sho Shimauchi. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355784 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-30 18:40:34 +00:00
Harsh J
06d0109314 HADOOP-8449. hadoop fs -text fails with compressed sequence files with the codec file extension. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355636 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-30 05:04:23 +00:00
Todd Lipcon
802f885a55 HDFS-3446. HostsFileReader silently ignores bad includes/excludes. Contributed by Matthew Jacobs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355584 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-29 22:24:29 +00:00
Alejandro Abdelnur
32d3ed55d0 HADOOP-8168. empty-string owners or groups causes {{MissingFormatWidthException}} in o.a.h.fs.shell.Ls.ProcessPath() (ekoontz via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355085 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 17:42:44 +00:00
Todd Lipcon
5770a453f3 HDFS-3572. Cleanup code which inits SPNEGO in HttpServer. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354767 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-27 22:41:41 +00:00
Siddharth Seth
a945336368 MAPREDUCE-4031. Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353038 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-22 21:40:35 +00:00
Harsh J
d1138f0914 HADOOP-8524. Allow users to get source of a Configuration parameter. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352689 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-21 21:12:31 +00:00
Tsz-wo Sze
ed7040f07b HADOOP-8470. Add NetworkTopologyWithNodeGroup, a 4-layer implementation of NetworkTopology. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351445 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-18 18:23:10 +00:00
Tsz-wo Sze
9ab9bc9f37 Revert r1351163 for fixing the JIRA number; it should be HADOOP-8470 but not HADOOP-8468. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351444 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-18 18:20:41 +00:00
Tsz-wo Sze
19ac5c4e8b HADOOP-8468. Add NetworkTopologyWithNodeGroup, a 4-layer implementation of NetworkTopology. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351163 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-17 21:12:25 +00:00
Eli Collins
07b8584431 HDFS-3531. EditLogFileOutputStream#preallocate should check for incomplete writes. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349616 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-13 02:42:52 +00:00
Eli Collins
0199fe9763 HADOOP-8507. Avoid OOM while deserializing DelegationTokenIdentifer. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349561 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 22:10:12 +00:00
Alejandro Abdelnur
4d4661802e HDFS-3228. Move DelegationTokenRenewer to common (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349555 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 21:52:46 +00:00
Eli Collins
797c8548d0 Revert HADOOP-8491 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349133 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 06:22:06 +00:00
Tsz-wo Sze
45fafc2b8f HDFS-3504. Support configurable retry policy in DFSClient for RPC connections and RPC calls, and add MultipleLinearRandomRetry, a new retry policy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349124 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 05:27:15 +00:00
Eli Collins
6e3ebf4d73 HADOOP-8491. Check for short writes when using FileChannel#write and related methods. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349019 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-11 21:20:28 +00:00
Tsz-wo Sze
415ce38b82 HADOOP-8469. Make NetworkTopology class pluggable. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347867 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-08 02:29:40 +00:00
Robert Joseph Evans
8d559d2d9a HADOOP-8452. DN logs backtrace when running under jsvc and /jmx is loaded (Andy Isaacson via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344733 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-31 14:10:16 +00:00
Tsz-wo Sze
83cf475050 HDFS-744. Support hsync in HDFS. Contributed by Lars Hofhans 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344419 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-30 19:10:09 +00:00
Harsh J
d2b57e00bc HADOOP-8358. Config-related WARN for dfs.web.ugi can be avoided. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343290 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-28 15:36:00 +00:00