big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
12,303 Commits 2 Branches 2 Tags 264 MiB
2801b42a7e
Commit Graph

5032 Commits

Author SHA1 Message Date
Arpit Agarwal
2801b42a7e HDFS-9379. Make NNThroughputBenchmark support more than 10 datanodes. (Contributed by Mingliang Liu) 2015-11-06 18:58:49 -08:00
Kihwal Lee
bf6aa30a15 HDFS-9318. considerLoad factor can be improved. Contributed by Kuhu Shukla. 2015-11-06 13:30:33 -06:00
Yongjun Zhang
b64242c0d2 HDFS-9236. Missing sanity check for block size during block recovery. (Tony Wu via Yongjun Zhang) 2015-11-06 11:15:54 -08:00
Arpit Agarwal
0b18e5e8c6 HDFS-6481. DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs. (Contributed by szetszwo) 2015-11-06 10:15:23 -08:00
cnauroth
66c0967310 HDFS-9384. TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server. Contributed by Chris Nauroth. 2015-11-05 22:07:08 -08:00
Yongjun Zhang
286cc6483f HDFS-9377. Fix findbugs warnings in FSDirSnapshotOp. (Mingliang Liu via Yongjun Zhang) 2015-11-05 14:36:12 -08:00
Lei Xu
46e78a7a16 HDFS-9282. Make data directory count and storage raw capacity related tests FsDataset-agnostic. (Tony Wu via lei) 2015-11-05 10:47:33 -08:00
Haohui Mai
efc73d7896 HDFS-9372. Remove dead code in DataStorage.recoverTransitionRead. Contributed by Duo Zhang. 2015-11-05 10:00:01 -08:00
Kihwal Lee
ff47f35dee HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee. 2015-11-05 09:25:20 -06:00
cnauroth
c563401796 HDFS-9378. hadoop-hdfs-client tests do not write logs. Contributed by Chris Nauroth. 2015-11-05 06:47:58 -08:00
Xiaoyu Yao
ea5bb48326 HDFS-9360. Storage type usage isn't updated properly after file deletion. Contributed by Ming Ma. 2015-11-05 01:30:13 -08:00
Lei Xu
5667129276 HDFS-9363. Add fetchReplica to FsDatasetTestUtils to return FsDataset-agnostic replica. (Tony Wu via lei) 2015-11-04 10:49:28 -08:00
Lei Xu
e2a5441b06 HDFS-9331. Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use. (Tony Wu via lei) 2015-11-04 10:27:35 -08:00
Lei Xu
ec414600ed HDFS-9007. Fix HDFS Balancer to honor upgrade domain policy. (Ming Ma via lei) 2015-11-04 10:22:17 -08:00
Haohui Mai
88beb46cf6 Revert "HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou." 
This reverts commit 84cbd72afd.
 2015-11-04 10:21:13 -08:00
Kihwal Lee
3fb1ece4e9 fix up CHANGES.txt 2015-11-04 12:15:10 -06:00
Haohui Mai
0eed886a16 HDFS-9357. NN UI renders icons of decommissioned DN incorrectly. Contributed by Surendra Singh Lilhore. 2015-11-04 09:16:43 -08:00
Jason Lowe
0383a3973b Add 2.7.3 release to CHANGES.txt 2015-11-04 16:26:14 +00:00
Varun Vasudev
73b9c7b82b HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. Contributed by Allen Wittenauer. 2015-11-04 15:56:17 +05:30
Yongjun Zhang
194251c852 HDFS-9351. checkNNStartup() need to be called when fsck calls FSNamesystem.getSnapshottableDirs(). (Xiao Chen via Yongjun Zhang) 2015-11-03 17:16:17 -08:00
Zhe Zhang
dac0463a4e HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in commitBlock. Contributed by Chang Li. 
Change-Id: If5ce1b2d212bb0726bce52ad12a3de401bcec02d
 2015-11-03 13:34:24 -08:00
cnauroth
7e2829662b HDFS-9362. TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows. Contributed by Chris Nauroth. 2015-11-03 11:54:57 -08:00
cnauroth
095ac83402 HDFS-9354. Fix TestBalancer#testBalancerWithZeroThreadsForMove on Windows. Contributed by Xiaoyu Yao. 2015-11-03 11:21:08 -08:00
Ming Ma
d565480da2 HDFS-9313. Possible NullPointerException in BlockManager if no excess replica can be chosen. (mingma) 2015-11-02 19:36:37 -08:00
Lei Xu
8e05dbf2bd HDFS-9308. Add truncateMeta() and deleteMeta() to MiniDFSCluster. (Tony Wu via lei) 2015-11-02 18:05:43 -08:00
yliu
5ba2b98d0f HDFS-9275. Wait previous ErasureCodingWork to finish before schedule another one. (Walter Su via yliu) 2015-11-03 09:14:32 +08:00
Lei Xu
7632409482 HDFS-9312. Fix TestReplication to be FsDataset-agnostic. (lei) 2015-11-02 17:09:39 -08:00
Zhe Zhang
78d6890865 HDFS-9339. Extend full test of KMS ACLs. Contributed by Daniel Templeton. 
Change-Id: I61eeee8fa5e85250eabc1eef3d8c11f32700d6fb
 2015-11-02 13:51:45 -08:00
Zhe Zhang
259bea3b48 HDFS-9329. TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size. Contributed by Zhe Zhang. 
Change-Id: I09896c46e9ee0718b67c64fac5acfb3f7decf0b9
 2015-11-02 10:03:39 -08:00
Zhe Zhang
90e1405516 HDFS-8777. Erasure Coding: add tests for taking snapshots on EC files. Contributed by Rakesh R. 
Change-Id: Ia3ae582405e741ca8e90d9255ab9b95d085e5fa8
 2015-11-02 07:48:30 -08:00
Kihwal Lee
2529464f08 Fix CHANGES.txt 2015-11-02 09:09:33 -06:00
Walter Su
6e4f8a46c5 HADOOP-12047. Indicate preference not to affect input buffers during coding in erasure coder. (Contributed by Kai Zheng) 2015-11-02 10:40:14 +08:00
Arpit Agarwal
3cde6931cb HDFS-9343. Empty caller context considered invalid. (Contributed by Mingliang Liu) 2015-11-01 15:35:02 -08:00
yliu
7fd6416759 Revert "HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee." 
This reverts commit 43539b5ff4.
 2015-10-31 16:20:48 +08:00
yliu
2ea4413b15 Revert "fix CHANGES.txt" 
This reverts commit 3c0204a586.
 2015-10-31 16:20:37 +08:00
Sangjin Lee
a4a6b5b4b4 Updated the 2.6.2 final release date. 2015-10-30 18:47:16 -07:00
Jason Lowe
eadf7b3096 Creating 2.6.3 entries in CHANGES.txt files. 2015-10-30 14:50:50 +00:00
Kihwal Lee
3c0204a586 fix CHANGES.txt 2015-10-30 09:40:41 -05:00
Kihwal Lee
43539b5ff4 HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee. 2015-10-30 09:29:13 -05:00
Tsz-Wo Nicholas Sze
f072eb5a20 HDFS-9323. Randomize the DFSStripedOutputStreamWithFailure tests. 2015-10-30 15:41:03 +08:00
Andrew Wang
888c6245e2 HDFS-9332. Fix Precondition failures from NameNodeEditLogRoller while saving namespace. 2015-10-29 11:30:47 -07:00
Zhe Zhang
8def51a708 HDFS-9229. Expose size of NameNode directory as a metric. Contributed by Surendra Singh Lilhore. 
Change-Id: I985627a5d1400249d72d084283ef366d5ac6e07b
 2015-10-29 11:23:08 -07:00
Walter Su
5eca6dece6 HADOOP-12327. Initialize output buffers with ZERO bytes in erasure coder. Contributed by Kai Zheng. 2015-10-29 15:04:34 +08:00
Uma Mahesh
07ecdb877d HDFS-9261. Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group. (Rakesh R via umamahesh) 2015-10-28 23:33:11 -07:00
Vinayakumar B
588baab160 HDFS-9044. Give Priority to FavouredNodes , before selecting nodes from FavouredNode's Node Group (Contributed by J.Andreina) 2015-10-29 11:44:01 +05:30
Vinayakumar B
7d2d16f4ee HDFS-8545. Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path (Contributed by J.Andreina) 2015-10-29 11:28:17 +05:30
Sangjin Lee
b0c818b60d Set the release date for 2.6.2 2015-10-28 20:43:35 -07:00
Haohui Mai
65f53f246a HDFS-9168. Move client side unit test to hadoop-hdfs-client. Contributed by Haohui Mai. 2015-10-28 15:54:37 -07:00
Zhe Zhang
73bc65e02b HDFS-9295. Add a thorough test of the full KMS code path. Contributed by Daniel Templeton. 
Change-Id: Ife1abb2f8e9a30102c4f705c47646d9ac8328786
 2015-10-28 14:36:20 -07:00
Kihwal Lee
19a77f5466 HDFS-9279. Decomissioned capacity should not be considered for configured/used capacity. Contributed by Kihu Shukla . 2015-10-28 11:58:51 -05:00