big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
12,303 Commits 2 Branches 2 Tags 264 MiB
2801b42a7e
Commit Graph

2858 Commits

Author SHA1 Message Date
Arpit Agarwal
2801b42a7e HDFS-9379. Make NNThroughputBenchmark support more than 10 datanodes. (Contributed by Mingliang Liu) 2015-11-06 18:58:49 -08:00
Kihwal Lee
bf6aa30a15 HDFS-9318. considerLoad factor can be improved. Contributed by Kuhu Shukla. 2015-11-06 13:30:33 -06:00
Yongjun Zhang
b64242c0d2 HDFS-9236. Missing sanity check for block size during block recovery. (Tony Wu via Yongjun Zhang) 2015-11-06 11:15:54 -08:00
Arpit Agarwal
0b18e5e8c6 HDFS-6481. DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs. (Contributed by szetszwo) 2015-11-06 10:15:23 -08:00
Lei Xu
46e78a7a16 HDFS-9282. Make data directory count and storage raw capacity related tests FsDataset-agnostic. (Tony Wu via lei) 2015-11-05 10:47:33 -08:00
Xiaoyu Yao
ea5bb48326 HDFS-9360. Storage type usage isn't updated properly after file deletion. Contributed by Ming Ma. 2015-11-05 01:30:13 -08:00
Lei Xu
5667129276 HDFS-9363. Add fetchReplica to FsDatasetTestUtils to return FsDataset-agnostic replica. (Tony Wu via lei) 2015-11-04 10:49:28 -08:00
Lei Xu
e2a5441b06 HDFS-9331. Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use. (Tony Wu via lei) 2015-11-04 10:27:35 -08:00
Lei Xu
ec414600ed HDFS-9007. Fix HDFS Balancer to honor upgrade domain policy. (Ming Ma via lei) 2015-11-04 10:22:17 -08:00
Haohui Mai
88beb46cf6 Revert "HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou." 
This reverts commit 84cbd72afd.
 2015-11-04 10:21:13 -08:00
Zhe Zhang
dac0463a4e HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in commitBlock. Contributed by Chang Li. 
Change-Id: If5ce1b2d212bb0726bce52ad12a3de401bcec02d
 2015-11-03 13:34:24 -08:00
cnauroth
7e2829662b HDFS-9362. TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows. Contributed by Chris Nauroth. 2015-11-03 11:54:57 -08:00
cnauroth
095ac83402 HDFS-9354. Fix TestBalancer#testBalancerWithZeroThreadsForMove on Windows. Contributed by Xiaoyu Yao. 2015-11-03 11:21:08 -08:00
Ming Ma
d565480da2 HDFS-9313. Possible NullPointerException in BlockManager if no excess replica can be chosen. (mingma) 2015-11-02 19:36:37 -08:00
Lei Xu
8e05dbf2bd HDFS-9308. Add truncateMeta() and deleteMeta() to MiniDFSCluster. (Tony Wu via lei) 2015-11-02 18:05:43 -08:00
yliu
5ba2b98d0f HDFS-9275. Wait previous ErasureCodingWork to finish before schedule another one. (Walter Su via yliu) 2015-11-03 09:14:32 +08:00
Lei Xu
7632409482 HDFS-9312. Fix TestReplication to be FsDataset-agnostic. (lei) 2015-11-02 17:09:39 -08:00
Zhe Zhang
78d6890865 HDFS-9339. Extend full test of KMS ACLs. Contributed by Daniel Templeton. 
Change-Id: I61eeee8fa5e85250eabc1eef3d8c11f32700d6fb
 2015-11-02 13:51:45 -08:00
Zhe Zhang
259bea3b48 HDFS-9329. TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size. Contributed by Zhe Zhang. 
Change-Id: I09896c46e9ee0718b67c64fac5acfb3f7decf0b9
 2015-11-02 10:03:39 -08:00
Zhe Zhang
90e1405516 HDFS-8777. Erasure Coding: add tests for taking snapshots on EC files. Contributed by Rakesh R. 
Change-Id: Ia3ae582405e741ca8e90d9255ab9b95d085e5fa8
 2015-11-02 07:48:30 -08:00
Arpit Agarwal
3cde6931cb HDFS-9343. Empty caller context considered invalid. (Contributed by Mingliang Liu) 2015-11-01 15:35:02 -08:00
Tsz-Wo Nicholas Sze
f072eb5a20 HDFS-9323. Randomize the DFSStripedOutputStreamWithFailure tests. 2015-10-30 15:41:03 +08:00
Zhe Zhang
8def51a708 HDFS-9229. Expose size of NameNode directory as a metric. Contributed by Surendra Singh Lilhore. 
Change-Id: I985627a5d1400249d72d084283ef366d5ac6e07b
 2015-10-29 11:23:08 -07:00
Vinayakumar B
588baab160 HDFS-9044. Give Priority to FavouredNodes , before selecting nodes from FavouredNode's Node Group (Contributed by J.Andreina) 2015-10-29 11:44:01 +05:30
Vinayakumar B
7d2d16f4ee HDFS-8545. Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path (Contributed by J.Andreina) 2015-10-29 11:28:17 +05:30
Haohui Mai
65f53f246a HDFS-9168. Move client side unit test to hadoop-hdfs-client. Contributed by Haohui Mai. 2015-10-28 15:54:37 -07:00
Zhe Zhang
73bc65e02b HDFS-9295. Add a thorough test of the full KMS code path. Contributed by Daniel Templeton. 
Change-Id: Ife1abb2f8e9a30102c4f705c47646d9ac8328786
 2015-10-28 14:36:20 -07:00
Kihwal Lee
19a77f5466 HDFS-9279. Decomissioned capacity should not be considered for configured/used capacity. Contributed by Kihu Shukla . 2015-10-28 11:58:51 -05:00
Zhe Zhang
e287e7d14b HDFS-9255. Consolidate block recovery related implementation into a single class. Contributed by Walter Su. 
Change-Id: I7a1c03f50123d79ac0a78c981d9721617e3229d1
 2015-10-28 07:34:06 -07:00
yliu
c201cf951d HADOOP-12040. Adjust inputs order for the decode API in raw erasure coder. (Kai Zheng via yliu) 2015-10-28 16:18:23 +08:00
Yongjun Zhang
97913f430c HDFS-9231. fsck doesn't list correct file path when Bad Replicas/Blocks are in a snapshot. (Xiao Chen via Yongjun Zhang) 2015-10-27 23:31:50 -07:00
cnauroth
bf8e452982 HDFS-9311. Support optional offload of NameNode HA service health checks to a separate RPC server. Contributed by Chris Nauroth. 2015-10-27 23:07:14 -07:00
Ming Ma
aa09880ab8 HDFS-9259. Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario. (Mingliang Liu via mingma) 2015-10-27 09:28:40 -07:00
Lei Xu
399ad00915 HDFS-9292. Make TestFileConcorruption independent to underlying FsDataset Implementation. (lei) 2015-10-26 16:09:22 -07:00
Arpit Agarwal
d8736eb9ca HDFS-9305. Delayed heartbeat processing causes storm of subsequent heartbeats. (Contributed by Arpit Agarwal) 2015-10-26 15:54:14 -07:00
Lei Xu
37bf6141f1 HDFS-9291. Fix TestInterDatanodeProtocol to be FsDataset-agnostic. (lei) 2015-10-26 15:18:24 -07:00
Haohui Mai
67e3d75aed HDFS-9304. Add HdfsClientConfigKeys class to TestHdfsConfigFields#configurationClasses. Contributed by Mingliang Liu. 2015-10-26 12:02:52 -07:00
Arpit Agarwal
86c92227fc HDFS-4015. Safemode should count and report orphaned blocks. (Contributed by Anu Engineer) 2015-10-23 18:07:17 -07:00
Lei Xu
5679e46b7f HDFS-9297. Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile(). (Tony Wu via lei) 2015-10-23 17:42:23 -07:00
Zhe Zhang
ab3c4cff4a HDFS-8808. dfs.image.transfer.bandwidthPerSec should not apply to -bootstrapStandby. Contributed by Zhe Zhang. 2015-10-23 14:01:49 -07:00
Jitendra Pandey
600ad7bf41 HDFS-9184. Logging HDFS operation's caller context into audit logs. Contributed by Mingliang Liu. 2015-10-23 12:15:01 -07:00
Andrew Wang
3dadf369d5 HDFS-7087. Ability to list /.reserved. Contributed by Xiao Chen. 2015-10-21 16:58:47 -07:00
cnauroth
1b525a9c32 HDFS-9273. ACLs on root directory may be lost after NN restart. Contributed by Xiao Chen. 2015-10-21 16:39:02 -07:00
Andrew Wang
3e50f478b9 HDFS-9225. Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack. Contributed by Masatake Iwasaki. 2015-10-21 14:55:23 -07:00
Jing Zhao
d806a5bf07 HDFS-9070. Allow fsck display pending replica location information for being-written blocks. Contributed by Gao Rui. 2015-10-21 14:44:05 -07:00
Ming Ma
e27c2ae8ba HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. (Brahma Reddy Battula via mingma) 2015-10-21 08:06:58 -07:00
Andrew Wang
6c8b6f3646 HDFS-3059. ssl-server.xml causes NullPointer. Contributed by Xiao Chen. 2015-10-20 13:44:53 -07:00
Colin Patrick Mccabe
6381ddc096 HDFS-9270. TestShortCircuitLocalRead should not leave socket after unit test (Masatake Iwasaki via Colin P. McCabe) 2015-10-20 10:51:18 -07:00
Lei Xu
71e533a153 HDFS-9251. Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in the tests code. (lei) 2015-10-20 10:08:02 -07:00
yliu
9cb5d35353 HDFS-9208. Disabling atime may fail clients like distCp. (Kihwal Lee via yliu) 2015-10-20 11:33:04 +08:00