big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
12,506 Commits 2 Branches 2 Tags 264 MiB
f910e4f639
Commit Graph

12506 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Allen Wittenauer
b76b0ce51e HADOOP-12366. expose calculated paths (aw) 2015-11-07 08:32:56 -08:00
cnauroth
1ee2db5c41 HDFS-9394. branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing. Contributed by Mingliang Liu. 2015-11-07 07:38:42 -08:00
Tsz-Wo Nicholas Sze
9614dea71a HDFS-9398. Make ByteArraryManager log message in one-line format. Contributed by Mingliang Liu 2015-11-07 22:21:28 +08:00
Arpit Agarwal
2801b42a7e HDFS-9379. Make NNThroughputBenchmark support more than 10 datanodes. (Contributed by Mingliang Liu) 2015-11-06 18:58:49 -08:00
Kihwal Lee
bf6aa30a15 HDFS-9318. considerLoad factor can be improved. Contributed by Kuhu Shukla. 2015-11-06 13:30:33 -06:00
Yongjun Zhang
b64242c0d2 HDFS-9236. Missing sanity check for block size during block recovery. (Tony Wu via Yongjun Zhang) 2015-11-06 11:15:54 -08:00
Arpit Agarwal
0b18e5e8c6 HDFS-6481. DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs. (Contributed by szetszwo) 2015-11-06 10:15:23 -08:00
Jason Lowe
74a9a51886 Update CHANGES.txt for commit of HADOOP 12413 to 2.7.3 and 2.6.3 2015-11-06 17:16:14 +00:00
cnauroth
66c0967310 HDFS-9384. TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server. Contributed by Chris Nauroth. 2015-11-05 22:07:08 -08:00
Lei Xu
bff7c90a56 HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei) 2015-11-05 18:35:15 -08:00
Allen Wittenauer
19a0c2660c MAPREDUCE-1125. SerialUtils.cc: deserializeFloat is out of sync with SerialUtils.hh (Simone Leo via aw) 2015-11-05 16:57:22 -08:00
Allen Wittenauer
fc7cd46faf MAPREDUCE-3914. Mismatched free() / delete / delete [] in HadoopPipes (Joe Mudd via aw) 2015-11-05 16:53:32 -08:00
Yongjun Zhang
286cc6483f HDFS-9377. Fix findbugs warnings in FSDirSnapshotOp. (Mingliang Liu via Yongjun Zhang) 2015-11-05 14:36:12 -08:00
Colin Patrick Mccabe
21c0e3eda5 CHANGES.txt: move HADOOP-11887 to trunk 2015-11-05 11:12:24 -08:00
Lei Xu
46e78a7a16 HDFS-9282. Make data directory count and storage raw capacity related tests FsDataset-agnostic. (Tony Wu via lei) 2015-11-05 10:47:33 -08:00
Colin Patrick Mccabe
482e35c55a HADOOP-11887. Introduce Intel ISA-L erasure coding library for native erasure encoding support (Kai Zheng via Colin P. McCabe) 2015-11-05 10:44:47 -08:00
Haohui Mai
efc73d7896 HDFS-9372. Remove dead code in DataStorage.recoverTransitionRead. Contributed by Duo Zhang. 2015-11-05 10:00:01 -08:00
Kihwal Lee
ff47f35dee HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee. 2015-11-05 09:25:20 -06:00
cnauroth
c563401796 HDFS-9378. hadoop-hdfs-client tests do not write logs. Contributed by Chris Nauroth. 2015-11-05 06:47:58 -08:00
Xiaoyu Yao
ea5bb48326 HDFS-9360. Storage type usage isn't updated properly after file deletion. Contributed by Ming Ma. 2015-11-05 01:30:13 -08:00
Lei Xu
5667129276 HDFS-9363. Add fetchReplica to FsDatasetTestUtils to return FsDataset-agnostic replica. (Tony Wu via lei) 2015-11-04 10:49:28 -08:00
cnauroth
0fb1867fd6 HADOOP-12540. TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. Contributed by Gaurav Kanade. 2015-11-04 10:28:44 -08:00
Lei Xu
e2a5441b06 HDFS-9331. Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use. (Tony Wu via lei) 2015-11-04 10:27:35 -08:00
Lei Xu
ec414600ed HDFS-9007. Fix HDFS Balancer to honor upgrade domain policy. (Ming Ma via lei) 2015-11-04 10:22:17 -08:00
Haohui Mai
88beb46cf6 Revert "HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou." 
This reverts commit 84cbd72afd.
 2015-11-04 10:21:13 -08:00
Kihwal Lee
3fb1ece4e9 fix up CHANGES.txt 2015-11-04 12:15:10 -06:00
Haohui Mai
0eed886a16 HDFS-9357. NN UI renders icons of decommissioned DN incorrectly. Contributed by Surendra Singh Lilhore. 2015-11-04 09:16:43 -08:00
Jason Lowe
b9d25c3ee2 HADOOP-12296. when setnetgrent returns 0 in linux, exception should be thrown. Contributed by Chang Li 2015-11-04 16:34:01 +00:00
Jason Lowe
0383a3973b Add 2.7.3 release to CHANGES.txt 2015-11-04 16:26:14 +00:00
Varun Vasudev
73b9c7b82b HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. Contributed by Allen Wittenauer. 2015-11-04 15:56:17 +05:30
Zhe Zhang
3e1745d8e8 HADOOP-12544. Erasure Coding: create dummy raw coder to isolate performance issues in testing. Contributed by Rui Li. 
Change-Id: I9856456b59ed881c5ba2acce51e4d9bd01dc6f48
 2015-11-03 22:26:27 -08:00
Yongjun Zhang
194251c852 HDFS-9351. checkNNStartup() need to be called when fsck calls FSNamesystem.getSnapshottableDirs(). (Xiao Chen via Yongjun Zhang) 2015-11-03 17:16:17 -08:00
Zhe Zhang
dac0463a4e HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in commitBlock. Contributed by Chang Li. 
Change-Id: If5ce1b2d212bb0726bce52ad12a3de401bcec02d
 2015-11-03 13:34:24 -08:00
cnauroth
7e2829662b HDFS-9362. TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows. Contributed by Chris Nauroth. 2015-11-03 11:54:57 -08:00
cnauroth
095ac83402 HDFS-9354. Fix TestBalancer#testBalancerWithZeroThreadsForMove on Windows. Contributed by Xiaoyu Yao. 2015-11-03 11:21:08 -08:00
Wangda Tan
0783184f4b YARN-4326. Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188. (Meng Ding via wangda) 2015-11-03 11:18:34 -08:00
cnauroth
957f0311a1 HADOOP-12542. TestDNS fails on Windows after HADOOP-12437. Contributed by Chris Nauroth. 2015-11-02 22:25:05 -08:00
Allen Wittenauer
6e0d353235 HADOOP-12541. make re2j dependency consistent (Matthew Paduano via aw) 2015-11-02 20:39:46 -08:00
Ming Ma
d565480da2 HDFS-9313. Possible NullPointerException in BlockManager if no excess replica can be chosen. (mingma) 2015-11-02 19:36:37 -08:00
Lei Xu
8e05dbf2bd HDFS-9308. Add truncateMeta() and deleteMeta() to MiniDFSCluster. (Tony Wu via lei) 2015-11-02 18:05:43 -08:00
yliu
5ba2b98d0f HDFS-9275. Wait previous ErasureCodingWork to finish before schedule another one. (Walter Su via yliu) 2015-11-03 09:14:32 +08:00
Lei Xu
7632409482 HDFS-9312. Fix TestReplication to be FsDataset-agnostic. (lei) 2015-11-02 17:09:39 -08:00
Zhe Zhang
78d6890865 HDFS-9339. Extend full test of KMS ACLs. Contributed by Daniel Templeton. 
Change-Id: I61eeee8fa5e85250eabc1eef3d8c11f32700d6fb
 2015-11-02 13:51:45 -08:00
cnauroth
9e7dcab185 HADOOP-12508. delete fails with exception when lease is held on blob. Contributed by Gaurav Kanade. 2015-11-02 10:21:39 -08:00
cnauroth
3ce0a6502e HADOOP-12533. Introduce FileNotFoundException in WASB for read and seek API. Contributed by Dushyanth. 2015-11-02 10:17:41 -08:00
Zhe Zhang
259bea3b48 HDFS-9329. TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size. Contributed by Zhe Zhang. 
Change-Id: I09896c46e9ee0718b67c64fac5acfb3f7decf0b9
 2015-11-02 10:03:39 -08:00
Akira Ajisaka
04d97f8abb MAPREDUCE-6525. Fix test failure of TestMiniMRClientCluster.testRestart. Contributed by Masatake Iwasaki. 2015-11-03 01:50:07 +09:00
Zhe Zhang
90e1405516 HDFS-8777. Erasure Coding: add tests for taking snapshots on EC files. Contributed by Rakesh R. 
Change-Id: Ia3ae582405e741ca8e90d9255ab9b95d085e5fa8
 2015-11-02 07:48:30 -08:00
Kihwal Lee
2529464f08 Fix CHANGES.txt 2015-11-02 09:09:33 -06:00
Walter Su
6e4f8a46c5 HADOOP-12047. Indicate preference not to affect input buffers during coding in erasure coder. (Contributed by Kai Zheng) 2015-11-02 10:40:14 +08:00