big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
13,141 Commits 2 Branches 2 Tags 264 MiB
ed1e23fe8f
Commit Graph

3768 Commits

Author SHA1 Message Date
Haohui Mai
8a3f0cb255 HDFS-7166. SbNN Web UI shows #Under replicated blocks and #pending deletion blocks. Contributed by Wei-Chiu Chuang. 2016-03-20 17:21:25 -07:00
Sangjin Lee
cd8b6889a7 HDFS-9579. Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level (Ming Ma via sjlee) 2016-03-19 14:02:04 -07:00
Akira Ajisaka
9b623fbaf7 HDFS-3677. dfs.namenode.edits.dir.required is missing from hdfs-default.xml. Contributed by Mark Yang. 2016-03-19 01:11:15 +09:00
Kihwal Lee
63c966a3fb HDFS-9874. Long living DataXceiver threads cause volume shutdown to block. Contributed by Rushabh Shah. 2016-03-18 10:24:59 -05:00
Andrew Wang
02a250db9f HDFS-10173. Typo in DataXceiverServer. Contributed by Michael Han. 2016-03-16 18:49:57 -07:00
Zhe Zhang
32d043d9c5 HDFS-9857. Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]. Contributed by Rakesh R. 2016-03-16 16:53:58 -07:00
Ravi Prakash
bd5556ba12 Download File from UI broken after pagination. Contributed by Brahma Reddy Battula 2016-03-14 14:30:13 -07:00
Chris Nauroth
5644137ada HDFS-9941. Do not log StandbyException on NN, other minor logging fixes. Contributed by Arpit Agarwal. 2016-03-14 09:54:54 -07:00
Arpit Agarwal
e01c6ea688 HDFS-1477. Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart. (Contributed by Xiaobing Zhou) 2016-03-10 19:03:55 -08:00
Colin Patrick Mccabe
79961ecea8 HDFS-9933. ReverseXML should be capitalized in oiv usage message (cmccabe) 2016-03-10 13:43:27 -08:00
Colin Patrick Mccabe
bd49354c6d HDFS-9934. ReverseXML oiv processor should bail out if the XML file's layoutVersion doesn't match oiv's (cmccabe) 2016-03-10 13:41:06 -08:00
Zhe Zhang
7600e3c48f HDFS-7866. Erasure coding: NameNode manages multiple erasure coding policies. Contributed by Rui Li. 2016-03-08 22:30:30 -08:00
Jing Zhao
743a99f2db HDFS-8786. Erasure coding: use simple replication for internal blocks on decommissioning datanodes. Contributed by Rakesh R. 2016-03-08 10:24:57 -08:00
Arpit Agarwal
c2140d05ef HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:24 -08:00
Arpit Agarwal
724d2299cd HDFS-9906. Remove spammy log spew when a datanode is restarted. (Contributed by Brahma Reddy Battula) 2016-03-07 12:19:53 -08:00
Harsh J
fd1c09be3e HDFS-9521. TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk. Contributed by Wellington Chevreuil 2016-03-07 17:14:51 +05:30
Chris Nauroth
2759689d7d HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth. 2016-03-04 15:29:50 -08:00
Arpit Agarwal
27941a1811 HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-03-02 18:35:28 -08:00
Colin Patrick Mccabe
700b0e4019 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe) 2016-03-02 17:56:11 -08:00
Xiaoyu Yao
5abf051249 HDFS-9887. WebHdfs socket timeouts should be configurable. Contributed by Austin Donnelly and Chris Douglas. 2016-03-02 09:23:17 -08:00
Akira Ajisaka
27e0681f28 HDFS-9851. NameNode throws NPE when setPermission is called on a path that does not exist. Contributed by Brahma Reddy Battula. 2016-03-02 14:43:03 +09:00
Jing Zhao
f2ba7da4f0 HDFS-9876. shouldProcessOverReplicated should not count number of pending replicas. Contributed by Jing Zhao. 2016-03-01 18:41:57 -08:00
Kihwal Lee
2c8496ebf3 HDFS-8791. block ID-based DN storage layout can be very slow for datanode on ext4. Contributed by Chris Trezzo. 2016-03-01 15:04:59 -06:00
Chris Nauroth
2137e8feeb HDFS-9870. Remove unused imports from DFSUtil. Contributed by Brahma Reddy Battula. 2016-03-01 11:15:13 -08:00
Uma Maheswara Rao G
307ec80aca HDFS-9733. Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum. Contributed by Kai Zheng 2016-02-29 21:52:20 -08:00
Jing Zhao
2151716832 HDFS-7964. Add support for async edit logging. Contributed by Daryn Sharp. 2016-02-29 15:34:43 -08:00
Jing Zhao
408f2c807b HDFS-9866. BlockManager#chooseExcessReplicasStriped may weaken rack fault tolerance. Contributed by Jing Zhao. 2016-02-28 14:54:49 -08:00
Tsz-Wo Nicholas Sze
d1d4e16690 HDFS-9710. DN can be configured to send block receipt IBRs in batches. 2016-02-26 15:32:25 -08:00
Xiaoyu Yao
eab52dfb35 HDFS-9831. Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122. Contributed by Xiaobing Zhou. 2016-02-26 14:14:12 -08:00
Zhe Zhang
8808779db3 HDFS-9734. Refactoring of checksum failure report related codes. Contributed by Kai Zheng. 
Change-Id: Ie69a77e3498a360959f8e213c51fb2b17c28b64a
 2016-02-25 09:55:50 -08:00
Zhe Zhang
ccff6035f5 HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen. 
Change-Id: I54b82e0b11929082057b4d21bfcf285222c94cdb
 2016-02-25 09:24:32 -08:00
Tsz-Wo Nicholas Sze
6979cbfc1f HDFS-9838. Refactor the excessReplicateMap to a class. 2016-02-24 19:42:47 -08:00
Jing Zhao
47b92f2b6f HDFS-9837. BlockManager#countNodes should be able to detect duplicated internal blocks. Contributed by Jing Zhao. 2016-02-24 15:13:56 -08:00
cnauroth
d1dd248b75 HDFS-9854. Log cipher suite negotiation more verbosely. Contributed by Wei-Chiu Chuang. 2016-02-24 12:11:35 -08:00
Kihwal Lee
d27d7fc72e HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla. 2016-02-24 12:04:01 -06:00
Zhe Zhang
def754ec06 HDFS-9816. Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]. Contributed by Rui Li. 
Change-Id: I64b57bab4722cdc6e1e3148c3a3a401370249afe
 2016-02-23 14:05:17 -08:00
Colin Patrick Mccabe
211c78c090 HDFS-9549. TestCacheDirectives#testExceedsCapacity is flaky (Xiao Chen via cmccabe) 2016-02-23 12:01:20 -08:00
Tsuyoshi Ozawa
48c61cd6aa HDFS-9084. Pagination, sorting and filtering of files/directories in the HDFS Web UI. (Contributed by Ravi Prakash) 2016-02-23 19:30:58 +09:00
Tsz-Wo Nicholas Sze
66289a3bf4 HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo 2016-02-22 15:01:15 -08:00
Zhe Zhang
a2fdfff02d HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh. 
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
 2016-02-22 14:13:54 -08:00
Arpit Agarwal
a63301a864 HDFS-9842. dfs.datanode.balance.bandwidthPerSec should accept friendly size units. (Contributed by Lin Yiqun) 2016-02-22 11:34:09 -08:00
Vinayakumar B
342c9572bf HDFS-9425. Expose number of blocks per volume as a metric (Contributed by Brahma Reddy Battula) 2016-02-22 09:29:23 +05:30
Vinayakumar B
f313516731 HDFS-7452. skip StandbyException log for getCorruptFiles() (Contributed by Bramha Reddy Battula) 2016-02-22 09:21:46 +05:30
Arpit Agarwal
d5abd293a8 HDFS-9839. Reduce verbosity of processReport logging. (Contributed by Arpit Agarwal) 
This closes #78
 2016-02-20 23:19:09 -08:00
Jing Zhao
e54cc29312 HDFS-9818. Correctly handle EC reconstruction work caused by not enough racks. Contributed by Jing Zhao. 2016-02-19 19:02:23 -08:00
Jing Zhao
6546d9e7ff HDFS-9829. Erasure Coding: Improve few exception handling logic of ErasureCodingWorker. Contributed by Rakesh R. 2016-02-19 10:40:28 -08:00
Tsz-Wo Nicholas Sze
46f7790236 HDFS-8923. Add -source flag to balancer usage message. Contributed by Chris Trezzo 2016-02-18 18:18:12 -08:00
Kihwal Lee
ba6d5ed955 HDFS-4946. Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable. Contributed by James Kinley and Nathan Roberts. 2016-02-18 13:21:51 -06:00
cnauroth
5d1889a66d HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth. 2016-02-18 10:07:28 -08:00
Akira Ajisaka
e78d8e66f7 HDFS-6832. Fix the usage of 'hdfs namenode' command. Contributed by Manjunath Ballur. 2016-02-19 01:35:06 +09:00