Commit Graph

2156 Commits

Author SHA1 Message Date
Arpit Agarwal
b99d160437 HDFS-5255. Distcp job fails with hsftp when https is enabled in insecure cluster.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1528279 13f79535-47bb-0310-9956-ffa450edef68
2013-10-02 00:03:15 +00:00
Kihwal Lee
4fe912df9c HDFS-4512. Cover package org.apache.hadoop.hdfs.server.common with tests. Contributed by Vadim Bondarev.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1528097 13f79535-47bb-0310-9956-ffa450edef68
2013-10-01 14:02:19 +00:00
Kihwal Lee
6d5577fe7b HDFS-4517. Cover class RemoteBlockReader with unit tests. Contributed by Vadim Bondarev and Dennis Y.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1527807 13f79535-47bb-0310-9956-ffa450edef68
2013-09-30 22:31:00 +00:00
Brandon Li
25cdbdb71a HDFS-5230. Introduce RpcInfo to decouple XDR classes from the RPC API. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1527726 13f79535-47bb-0310-9956-ffa450edef68
2013-09-30 19:21:17 +00:00
Arpit Agarwal
6331ff024c Merging r1526971 through r1527683 from trunk to branch HDFS-2832
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1527697 13f79535-47bb-0310-9956-ffa450edef68
2013-09-30 18:28:07 +00:00
Brandon Li
e4154fc83a HDFS-5256. Use guava LoadingCache to implement DFSClientCache. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1527452 13f79535-47bb-0310-9956-ffa450edef68
2013-09-30 06:06:06 +00:00
Chris Nauroth
eccdb9aa8b HDFS-5260. Merge zero-copy memory-mapped HDFS client reads to trunk and branch-2. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1527113 13f79535-47bb-0310-9956-ffa450edef68
2013-09-27 22:51:12 +00:00
Jing Zhao
b2e174c9a5 HDFS-5265. Namenode fails to start when dfs.https.port is unspecified. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1527093 13f79535-47bb-0310-9956-ffa450edef68
2013-09-27 21:45:00 +00:00
Brandon Li
027419832c HDFS-5268. NFS write commit verifier is not set in a few places. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1527087 13f79535-47bb-0310-9956-ffa450edef68
2013-09-27 21:28:06 +00:00
Arpit Agarwal
46099ce7f1 HDFS-4988. Datanode must support all the volumes as individual storages.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1526969 13f79535-47bb-0310-9956-ffa450edef68
2013-09-27 16:05:39 +00:00
Arpit Agarwal
8062d8c239 Merging r1526366 through r1526708 from trunk to branch HDFS-2832
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1526717 13f79535-47bb-0310-9956-ffa450edef68
2013-09-26 21:49:18 +00:00
Chris Nauroth
ae501ceeb7 HDFS-5186. TestFileJournalManager fails on Windows due to file handle leaks. Contributed by Chuan Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526615 13f79535-47bb-0310-9956-ffa450edef68
2013-09-26 17:33:07 +00:00
Chris Nauroth
269eb42b2f HDFS-5258. Skip tests in TestHDFSCLI that are not applicable on Windows. Contributed by Chuan Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526610 13f79535-47bb-0310-9956-ffa450edef68
2013-09-26 17:23:16 +00:00
Colin McCabe
8a66e493ba HADOOP-9998. Provide methods to clear only part of the DNSToSwitchMapping. (Junping Du via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526567 13f79535-47bb-0310-9956-ffa450edef68
2013-09-26 15:24:30 +00:00
Brandon Li
f2e6091bb2 HDFS-5041. Add the time of last heartbeat to dead server Web UI. Contributed by Shinichi Yamashita
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526368 13f79535-47bb-0310-9956-ffa450edef68
2013-09-26 04:11:12 +00:00
Arpit Agarwal
77856140f4 Merging r1525759 through r1526365 from trunk to branch HDFS-2832
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1526366 13f79535-47bb-0310-9956-ffa450edef68
2013-09-26 03:41:09 +00:00
Brandon Li
3582026204 HDFS-5246. Make Hadoop nfs server port and mount daemon port configurable. Contributed by Jinghui Wang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526316 13f79535-47bb-0310-9956-ffa450edef68
2013-09-25 21:59:35 +00:00
Colin McCabe
464470e715 HADOOP-9981. globStatus should minimize its listStatus and getFileStatus calls. (Contributed by Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526297 13f79535-47bb-0310-9956-ffa450edef68
2013-09-25 20:51:09 +00:00
Tsz-wo Sze
c6d09d8c0c HDFS-5222. Move block schedule information from DatanodeDescriptor to DatanodeStorageInfo.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1526215 13f79535-47bb-0310-9956-ffa450edef68
2013-09-25 16:03:20 +00:00
Siddharth Seth
10a4289ebf YARN-1229. Define constraints on Auxiliary Service names. Change ShuffleHandler service name from mapreduce.shuffle to mapreduce_shuffle. Contributed by Xuan Gong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526065 13f79535-47bb-0310-9956-ffa450edef68
2013-09-25 00:35:03 +00:00
Tsz-wo Sze
5827d1667c HDFS-5228. The RemoteIterator returned by DistributedFileSystem.listFiles may throw NullPointerException. Contributed by szetszwo and cnauroth
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525828 13f79535-47bb-0310-9956-ffa450edef68
2013-09-24 10:16:14 +00:00
Suresh Srinivas
b838ac89a6 HDFS-5251. Race between the initialization of NameNode and the http server. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525787 13f79535-47bb-0310-9956-ffa450edef68
2013-09-24 05:31:02 +00:00
Brandon Li
e3088e4aef HDFS-5249. Fix dumper thread which may die silently. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525770 13f79535-47bb-0310-9956-ffa450edef68
2013-09-24 04:11:15 +00:00
Arpit Agarwal
114aa229de Merging r1525409 through r1525758 from trunk to branch HDFS-2832
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1525759 13f79535-47bb-0310-9956-ffa450edef68
2013-09-24 00:57:43 +00:00
Jing Zhao
28e3d09230 HDFS-4971. Move IO operations out of locking in OpenFileCtx. Contributed by Jing Zhao and Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525681 13f79535-47bb-0310-9956-ffa450edef68
2013-09-23 20:02:38 +00:00
Arpit Agarwal
be565473da HDFS-5139. Remove redundant -R option from setrep (update CHANGES.txt).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525665 13f79535-47bb-0310-9956-ffa450edef68
2013-09-23 18:18:41 +00:00
Arpit Agarwal
eef16dadaf HDFS-5139. Remove redundant -R option from setrep.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525659 13f79535-47bb-0310-9956-ffa450edef68
2013-09-23 17:57:23 +00:00
Daryn Sharp
7094738d84 HDFS-5240. Separate formatting from logging in the audit logger API (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525626 13f79535-47bb-0310-9956-ffa450edef68
2013-09-23 15:33:11 +00:00
Daryn Sharp
3dfadca6f5 HDFS-5239. Allow FSNamesystem lock fairness to be configurable (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525624 13f79535-47bb-0310-9956-ffa450edef68
2013-09-23 15:27:08 +00:00
Arpit Agarwal
5133d78c1a Merging r1524587 through r1525408 from trunk to branch HDFS-2832.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1525410 13f79535-47bb-0310-9956-ffa450edef68
2013-09-22 18:23:22 +00:00
Arpit Agarwal
4551da302d HDFS-5233. Use Datanode UUID to identify Datanodes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1525407 13f79535-47bb-0310-9956-ffa450edef68
2013-09-22 18:03:02 +00:00
Arpit Agarwal
eb9f1b6707 HDFS-5232. Protocol changes to transmit StorageUuid.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1525153 13f79535-47bb-0310-9956-ffa450edef68
2013-09-20 22:06:09 +00:00
Jing Zhao
ab22245dc8 HDFS-5231. Fix broken links in the document of HDFS Federation. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525133 13f79535-47bb-0310-9956-ffa450edef68
2013-09-20 20:34:55 +00:00
Brandon Li
d8d3d3eaed HDFS-5234 Move RpcFrameDecoder out of the public API. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525104 13f79535-47bb-0310-9956-ffa450edef68
2013-09-20 19:03:51 +00:00
Colin McCabe
1c4f4a38ca HADOOP-9929. Insufficient permission for a path reported as file not found. (Contributed by Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524611 13f79535-47bb-0310-9956-ffa450edef68
2013-09-19 02:09:43 +00:00
Arpit Agarwal
a80b826eef Merging r1523878 through r1524586 from trunk to branch HDFS-2832
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1524590 13f79535-47bb-0310-9956-ffa450edef68
2013-09-18 21:54:21 +00:00
Jing Zhao
f7eb75fa89 Move HDFS-5122 from Release 2.1.1-beta to Release 2.3.0 in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524581 13f79535-47bb-0310-9956-ffa450edef68
2013-09-18 21:33:07 +00:00
Jing Zhao
7a2443e9f8 HDFS-5122. Support failover and retry in WebHdfsFileSystem for NN HA. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524562 13f79535-47bb-0310-9956-ffa450edef68
2013-09-18 20:47:16 +00:00
Arpit Agarwal
22b401284b HDFS-5031. BlockScanner scans the block multiple times. (Vinay via Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524553 13f79535-47bb-0310-9956-ffa450edef68
2013-09-18 20:08:50 +00:00
Jing Zhao
f278a491dc HDFS-5219. Add configuration keys for retry policy in WebHDFSFileSystem. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524498 13f79535-47bb-0310-9956-ffa450edef68
2013-09-18 17:29:27 +00:00
Tsz-wo Sze
abf09f090f HDFS-4990. Change BlockPlacementPolicy to choose storages instead of datanodes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1524444 13f79535-47bb-0310-9956-ffa450edef68
2013-09-18 15:12:52 +00:00
Jing Zhao
5e18410e06 HDFS-5212. Refactor RpcMessage and NFS3Response to support different types of authentication information. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524298 13f79535-47bb-0310-9956-ffa450edef68
2013-09-18 06:08:23 +00:00
Arun Murthy
492ecd34c4 Preparing for hadoop-2.1.1-beta release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523890 13f79535-47bb-0310-9956-ffa450edef68
2013-09-17 05:16:21 +00:00
Tsz-wo Sze
0398943572 Merge r1523804 through r1523877 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1523878 13f79535-47bb-0310-9956-ffa450edef68
2013-09-17 02:59:14 +00:00
Tsz-wo Sze
f98c343c7f HDFS-5207. In BlockPlacementPolicy.chooseTarget(..), change the writer and the excludedNodes parameter types respectively to Node and Set. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523875 13f79535-47bb-0310-9956-ffa450edef68
2013-09-17 02:38:47 +00:00
Arpit Agarwal
3e3a454bd2 Merging r1523402 through r1523803 from trunk to branch HDFS-2832
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1523804 13f79535-47bb-0310-9956-ffa450edef68
2013-09-16 20:59:02 +00:00
Alejandro Abdelnur
27e7feb777 HADOOP-9961. versions of a few transitive dependencies diverged between hadoop subprojects. (rvs via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523596 13f79535-47bb-0310-9956-ffa450edef68
2013-09-16 11:30:47 +00:00
Tsz-wo Sze
959635f0e7 Merge r1523109 through r1523401 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1523402 13f79535-47bb-0310-9956-ffa450edef68
2013-09-15 04:32:39 +00:00
Tsz-wo Sze
d01caeee77 HDFS-5188. In BlockPlacementPolicy, reduce the number of chooseTarget(..) methods; replace HashMap with Map in parameter declarations and cleanup some related code.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523400 13f79535-47bb-0310-9956-ffa450edef68
2013-09-15 04:15:57 +00:00
Brandon Li
a56a4b6ef0 HDFS-5199 Add more debug trace for NFS READ and WRITE. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523140 13f79535-47bb-0310-9956-ffa450edef68
2013-09-13 23:14:52 +00:00
Arpit Agarwal
06eb46eda3 Merging r1521566 through r1523108 from trunk to branch HDFS-2832
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1523110 13f79535-47bb-0310-9956-ffa450edef68
2013-09-13 21:27:58 +00:00
Jing Zhao
1260d598d3 HDFS-4096. Add snapshot information to namenode WebUI. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523091 13f79535-47bb-0310-9956-ffa450edef68
2013-09-13 20:41:11 +00:00
Jing Zhao
965ce2041a HDFS-5192. NameNode may fail to start when dfs.client.test.drop.namenode.response.number is set. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1522775 13f79535-47bb-0310-9956-ffa450edef68
2013-09-13 04:29:50 +00:00
Brandon Li
ede10b8a1f HDFS-5067 Support symlink operations in NFS gateway. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1522774 13f79535-47bb-0310-9956-ffa450edef68
2013-09-13 04:21:46 +00:00
Andrew Wang
b6d9ef18c4 Move HDFS-4680 in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1522049 13f79535-47bb-0310-9956-ffa450edef68
2013-09-11 21:17:30 +00:00
Andrew Wang
e4374d8036 HDFS-4680. Audit logging of delegation tokens for MR tracing. (Andrew Wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1522012 13f79535-47bb-0310-9956-ffa450edef68
2013-09-11 19:57:37 +00:00
Tsz-wo Sze
b2976af140 HDFS-5157. Add StorageType to FsVolume. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1521743 13f79535-47bb-0310-9956-ffa450edef68
2013-09-11 06:30:01 +00:00
Jing Zhao
613979c8fd HDFS-5085. Refactor o.a.h.nfs to support different types of authentications. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1521601 13f79535-47bb-0310-9956-ffa450edef68
2013-09-10 19:29:45 +00:00
Arpit Agarwal
23bf148a2f Merging r1520450 through r1521565 from trunk to branch HDFS-2832
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1521566 13f79535-47bb-0310-9956-ffa450edef68
2013-09-10 18:03:08 +00:00
Andrew Wang
4f2bf68b73 HDFS-5170. BlockPlacementPolicyDefault uses the wrong classname when alerting to enable debug logging. (Andrew Wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520961 13f79535-47bb-0310-9956-ffa450edef68
2013-09-09 04:54:57 +00:00
Tsz-wo Sze
282be1b38e HDFS-5134. Move blockContentsStale, heartbeatedSinceFailover and firstBlockReport from DatanodeDescriptor to DatanodeStorageInfo; and fix a synchronization problem in DatanodeStorageInfo.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1520938 13f79535-47bb-0310-9956-ffa450edef68
2013-09-08 22:53:36 +00:00
Andrew Wang
efc1048ffe Revert HADOOP-9877 because of breakage reported in HADOOP-9912
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520713 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 22:57:44 +00:00
Colin McCabe
6431192c0e HDFS-4879. Add BlockedArrayList collection to avoid CMS full GCs (Contributed by Todd Lipcon)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520667 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 19:05:26 +00:00
Jing Zhao
4065c842ab Move HDFS-5118 to 2.1.1-beta section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520650 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 18:16:30 +00:00
Jing Zhao
36d0b822ef HDS-5118. Provide testing support for DFSClient to drop RPC responses. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520637 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 17:17:30 +00:00
Colin McCabe
a628391955 HDFS-5164. DeleteSnapshot should check if OperationCategory.WRITE is possible before taking write lock (contributed by Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520492 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 05:23:54 +00:00
Chris Nauroth
e10dbf41bc HDFS-4491. Add/delete files missed in prior commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520482 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 03:14:20 +00:00
Chris Nauroth
5eb618ee1f HDFS-4491. Parallel testing HDFS. Contributed by Andrey Klochkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520479 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 03:06:41 +00:00
Arpit Agarwal
bbce64c8c5 Merging r1519884 through r1520449 from trunk to branch HDFS-2832
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1520454 13f79535-47bb-0310-9956-ffa450edef68
2013-09-05 23:01:00 +00:00
Aaron Myers
8aea748ec3 HDFS-5159. Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520363 13f79535-47bb-0310-9956-ffa450edef68
2013-09-05 16:21:26 +00:00
Arpit Agarwal
f353769d0c Merging r1518852 through r1519883 from trunk to branch HDFS-2832
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1519885 13f79535-47bb-0310-9956-ffa450edef68
2013-09-03 23:20:45 +00:00
Arpit Agarwal
ec57e3019f Merge r1518851 from trunk (reconcile branch conflicts with the fix for HDFS-5077)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1519882 13f79535-47bb-0310-9956-ffa450edef68
2013-09-03 23:15:28 +00:00
Tsz-wo Sze
336c0344f5 Merge r1517887 through r1518850 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1519796 13f79535-47bb-0310-9956-ffa450edef68
2013-09-03 19:01:19 +00:00
Tsz-wo Sze
3f070e83b1 HDFS-5009. Include storage information in the LocatedBlock.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1519691 13f79535-47bb-0310-9956-ffa450edef68
2013-09-03 14:03:35 +00:00
Kihwal Lee
c28c964612 HDFS-5150. Allow per NN SPN for internal SPNEGO. Contributed By Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1519681 13f79535-47bb-0310-9956-ffa450edef68
2013-09-03 13:49:25 +00:00
Tsz-wo Sze
f7e3bc553d HDFS-5154. Fix TestBlockManager and TestDatanodeDescriptor after HDFS-4987. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1519548 13f79535-47bb-0310-9956-ffa450edef68
2013-09-03 04:04:22 +00:00
Brandon Li
cbca166831 HDFS-5136 MNT EXPORT should give the full group list which can mount the exports. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1519222 13f79535-47bb-0310-9956-ffa450edef68
2013-08-31 21:12:22 +00:00
Suresh Srinivas
28ac26bc43 HADOOP-5144. Move change from 3.0 to 2.3.0 release section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1518907 13f79535-47bb-0310-9956-ffa450edef68
2013-08-30 08:07:54 +00:00
Jing Zhao
25d4c2fd53 HDFS-5140. Too many safemode monitor threads being created in the standby namenode causing it to fail with out of memory error. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1518899 13f79535-47bb-0310-9956-ffa450edef68
2013-08-30 07:36:45 +00:00
Suresh Srinivas
daa0713eb0 HDFS-5144. Document time unit to NameNodeMetrics. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1518895 13f79535-47bb-0310-9956-ffa450edef68
2013-08-30 07:01:47 +00:00
Konstantin Shvachko
eb484bb562 HDFS-5077. NPE in FSNamesystem.commitBlockSynchronization(). Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1518851 13f79535-47bb-0310-9956-ffa450edef68
2013-08-29 23:08:02 +00:00
Arpit Agarwal
b305f1ff08 Update CHANGES_HDFS-2832.txt with HDFS-4985, HDFS-5115 and HDFS-5000.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1518426 13f79535-47bb-0310-9956-ffa450edef68
2013-08-29 00:21:08 +00:00
Brandon Li
30b8ef91a3 HDFS-5078 Support file append in NFSv3 gateway to enable data streaming to HDFS. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1518292 13f79535-47bb-0310-9956-ffa450edef68
2013-08-28 17:23:55 +00:00
Tsz-wo Sze
5d9d702607 HDFS-4987. Namenode changes to track multiple storages per datanode.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1518087 13f79535-47bb-0310-9956-ffa450edef68
2013-08-28 06:30:15 +00:00
Kihwal Lee
dfaa2e305d Adding the new test file for HDFS-3245 that was accidentally dropped
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1517994 13f79535-47bb-0310-9956-ffa450edef68
2013-08-27 21:14:12 +00:00
Kihwal Lee
1bfcab9689 HDFS-5132. Deadlock in NameNode between SafeModeMonitor#run and DatanodeManager#handleHeartbeat. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1517989 13f79535-47bb-0310-9956-ffa450edef68
2013-08-27 21:04:24 +00:00
Kihwal Lee
10a62366a5 HDFS-5128. Allow multiple net interfaces to be used with HA namenode RPC server. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1517981 13f79535-47bb-0310-9956-ffa450edef68
2013-08-27 20:53:31 +00:00
Kihwal Lee
39252995c4 HDFS-3245. Add metrics and web UI for cluster version summary. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1517937 13f79535-47bb-0310-9956-ffa450edef68
2013-08-27 19:21:15 +00:00
Arpit Agarwal
8a9db6782e Merge all changes from trunk to branch HDFS-2832.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1517887 13f79535-47bb-0310-9956-ffa450edef68
2013-08-27 17:05:13 +00:00
Arpit Agarwal
395f0ae567 HDFS-5000. DataNode configuration should allow specifying storage type (Adding file missed in last commit
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1517499 13f79535-47bb-0310-9956-ffa450edef68
2013-08-26 11:32:26 +00:00
Arpit Agarwal
73d14311bc HDFS-5000. DataNode configuration should allow specifying storage type
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1517417 13f79535-47bb-0310-9956-ffa450edef68
2013-08-26 03:18:40 +00:00
Brandon Li
15632cd76f HDFS-4947 Add NFS server export table to control export by hostname or IP range. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1517040 13f79535-47bb-0310-9956-ffa450edef68
2013-08-23 21:14:43 +00:00
Arpit Agarwal
c41df254fe Merge all changes from trunk to branch HDFS-2832
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1517030 13f79535-47bb-0310-9956-ffa450edef68
2013-08-23 20:57:00 +00:00
Jonathan Turner Eagles
e588ffe3c0 HDFS-4329. DFSShell issues with directories with spaces in name (Cristina L. Abad via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516904 13f79535-47bb-0310-9956-ffa450edef68
2013-08-23 15:48:43 +00:00
Jing Zhao
7cfbfe52f1 HDFS-5124. DelegationTokenSecretManager#retrievePassword can cause deadlock in NameNode. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516671 13f79535-47bb-0310-9956-ffa450edef68
2013-08-23 00:55:53 +00:00
Arpit Agarwal
6f699e8ea5 HDFS-5115. Make StorageID a UUID.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1516666 13f79535-47bb-0310-9956-ffa450edef68
2013-08-22 23:21:07 +00:00
Jing Zhao
6fd8766a51 HDFS-5045. Add more unit tests for retry cache to cover all AtMostOnce methods. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516348 13f79535-47bb-0310-9956-ffa450edef68
2013-08-22 01:06:57 +00:00
Arpit Agarwal
5e27288c1e HDFS-4985. Add storage type to the protocol and expose it in block report and block locations
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1516323 13f79535-47bb-0310-9956-ffa450edef68
2013-08-21 23:07:29 +00:00
Kihwal Lee
2499a86664 HDFS-4994. Audit log getContentSummary() calls. Contributed by Robert Parker.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516237 13f79535-47bb-0310-9956-ffa450edef68
2013-08-21 18:15:26 +00:00
Brandon Li
270eaceba8 HDFS-5069 Include hadoop-nfs and hadoop-hdfs-nfs into hadoop dist for NFS deployment. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516232 13f79535-47bb-0310-9956-ffa450edef68
2013-08-21 17:54:08 +00:00