big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,065 Commits 2 Branches 2 Tags 264 MiB
4dd4f3a4bb
Commit Graph

4171 Commits

Author SHA1 Message Date
Kihwal Lee
4dd4f3a4bb HDFS-11198. NN UI should link DN web address using hostnames. Contributed by Weiwei Yang. 2016-12-06 08:06:50 -06:00
Andrew Wang
08a7253bc0 Revert "HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang" 
This reverts commit c7ff34f8dc.
 2016-12-05 23:09:35 -08:00
Andrew Wang
8e63fa98ea HDFS-10581. Hide redundant table on NameNode WebUI when no nodes are decomissioning. Contributed by Weiwei Yang. 2016-12-05 18:13:53 -08:00
Xiaoyu Yao
dcedb72af4 Revert "HADOOP-10930. Refactor: Wrap Datanode IO related operations. Contributed by Xiaoyu Yao." 
This reverts commit aeecfa24f4.
 2016-12-05 12:44:20 -08:00
Mingliang Liu
8c4680852b HDFS-11094. Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter. Contributed by Eric Badger 2016-12-05 11:48:58 -08:00
Wei-Chiu Chuang
1b5cceaffb Revert "HDFS-11201. Spelling errors in the logging, help, assertions and exception messages. Contributed by Grant Sohn." 
This reverts commit b9522e86a5.
 2016-12-05 10:54:43 -08:00
Wei-Chiu Chuang
b9522e86a5 HDFS-11201. Spelling errors in the logging, help, assertions and exception messages. Contributed by Grant Sohn. 2016-12-05 10:48:25 -08:00
Mingliang Liu
c7ff34f8dc HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang 2016-12-02 11:10:13 -08:00
Kihwal Lee
96c574927a HDFS-8674. Improve performance of postponed block scans. Contributed by Daryn Sharp. 2016-12-01 12:11:27 -06:00
Akira Ajisaka
e0fa49234f HDFS-11180. Intermittent deadlock in NameNode when failover happens. 2016-12-01 23:08:59 +09:00
Andrew Wang
7226a71b1f HDFS-5517. Lower the default maximum number of blocks per file. Contributed by Aaron T. Myers and Andrew Wang. 2016-11-30 15:58:31 -08:00
Ravi Prakash
625df87c7b HDFS-8678. Bring back the feature to view chunks of files in the HDFS file browser. Contributed by Ivo Udelsmann. 2016-11-30 09:12:15 -08:00
Kai Zheng
51e6c1cc3f HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen 2016-11-30 15:52:56 +08:00
Kai Zheng
cfd8076f81 Revert due to an error "HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen" 
This reverts commit 5614f847b2ef2a5b70bd9a06edc4eba06174c6.
 2016-11-30 15:44:52 +08:00
Xiaoyu Yao
aeecfa24f4 HADOOP-10930. Refactor: Wrap Datanode IO related operations. Contributed by Xiaoyu Yao. 2016-11-29 20:52:36 -08:00
Arpit Agarwal
eaaa32950c HDFS-11149. Support for parallel checking of FsVolumes. 2016-11-29 20:31:02 -08:00
Andrew Wang
b407d53195 Revert "HDFS-5517. Lower the default maximum number of blocks per file. Contributed by Aaron T. Myers." 
This reverts commit 09451252fa.
 2016-11-29 10:50:10 -08:00
Andrew Wang
09451252fa HDFS-5517. Lower the default maximum number of blocks per file. Contributed by Aaron T. Myers. 2016-11-29 00:12:35 -08:00
Robert Kanter
47ca9e26fb HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter) 2016-11-28 18:08:09 -08:00
Kai Zheng
5d5614f847 HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen 2016-11-28 14:34:44 +08:00
Andrew Wang
de4894936a HDFS-11368. Erasure Coding: Deprecate replication-related config keys. Contributed by Rakesh R. 2016-11-23 16:42:06 -08:00
Arpit Agarwal
613b902b98 HDFS-11148. Update DataNode to use StorageLocationChecker at startup. 2016-11-22 10:50:25 -08:00
Brahma Reddy Battula
afcf8d38e7 HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula. 2016-11-22 19:45:45 +05:30
Kihwal Lee
49a09179e3 HDFS-10966. Enhance Dispatcher logic on deciding when to give up a source DataNode. Contributed by Mark Wagner and Zhe Zhang. 2016-11-21 10:13:24 -06:00
Akira Ajisaka
d232625f73 HDFS-11113. Document dfs.client.read.striped configuration in hdfs-default.xml. Contributed by Rakesh R. 2016-11-21 14:05:15 +09:00
Arpit Agarwal
04a024b683 HDFS-11147. Remove confusing log output in FsDatasetImpl#getInitialVolumeFailureInfos. Contributed by Chen Liang. 2016-11-16 14:47:34 -08:00
Zhe Zhang
ff0b99eafe HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen. 2016-11-14 11:05:29 -08:00
Arpit Agarwal
3d26717777 HDFS-11119. Support for parallel checking of StorageLocations on DataNode startup. 
This closes #155.
 2016-11-11 15:02:52 -08:00
Xiaoyu Yao
4484b48498 HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. Contributed by Chen Liang. 2016-11-11 14:31:23 -08:00
Brahma Reddy Battula
1ae57f0f75 HDFS-11128. CreateEditsLog throws NullPointerException. Contributed by Hanisha Koneru. 2016-11-11 20:08:15 +05:30
Vinayakumar B
ca68f9cb5b HDFS-9337. Validate required params for WebHDFS requests (Contributed by Jagadesh Kiran N) 2016-11-10 16:51:33 +05:30
Wei-Chiu Chuang
c619e9b43f HDFS-11056. Concurrent append and read operations lead to checksum error. Contributed by Wei-Chiu Chuang. 2016-11-09 09:16:50 -08:00
Brahma Reddy Battula
ed0bebabaa HDFS-9482. Replace DatanodeInfo constructors with a builder pattern. Contributed by Brahma Reddy Battula. 2016-11-08 18:17:07 -08:00
Arpit Agarwal
3fff158587 HDFS-11114. Support for running async disk checks in DataNode. 
This closes #153.
 2016-11-07 18:45:53 -08:00
Akira Ajisaka
049e7d27be HDFS-10970. Update jackson from 1.9.13 to 2.x in hadoop-hdfs. 2016-11-07 11:16:31 +09:00
Xiao Chen
d8bab3dcb6 HDFS-10756. Expose getTrashRoot to HTTPFS and WebHDFS. Contributed by Yuanbo Liu. 2016-11-04 18:06:55 -07:00
Vinayakumar B
69dd5fa2d4 HDFS-11098. Datanode in tests cannot start in Windows after HDFS-10638 (Contributed by Vinayakumar B) 2016-11-04 08:31:43 +05:30
Andrew Wang
5cad93d5c7 HADOOP-11088. Quash unnecessary safemode WARN message during NameNode startup. Contributed by Yiqun Lin. 2016-11-03 15:31:07 -07:00
Arpit Agarwal
b71907b2ae HDFS-11097. Fix warnings for deprecated StorageReceivedDeletedBlocks constructor. Contributed by Yiqun Lin. 2016-11-03 10:27:52 -07:00
Anu Engineer
730cb0cff6 HDFS-10566. Submit plan request should throw exception if Datanode is in non-REGULAR status. Contributed by Xiaobing Zhou. 2016-11-02 17:46:56 -07:00
Lei Xu
b59206190e HDFS-10909. De-duplicate code in ErasureCodingWorker#initializeStripedReadThreadPool and DFSClient#initThreadsNumForStripedReads. (Manoj Govindassamy via lei) 2016-11-02 16:45:25 -07:00
Mingliang Liu
9b0c17f852 HDFS-11095. BlockManagerSafeMode should respect extension period default config value (30s). Contributed by Mingliang Liu 2016-11-02 14:58:24 -07:00
Andrew Wang
f2800f523d Revert "HADOOP-13717. Normalize daemonization behavior of the diskbalancer with balancer and mover." 
This reverts commit bd7f5911c7.
 2016-11-02 13:46:33 -07:00
Andrew Wang
bd7f5911c7 HADOOP-13717. Normalize daemonization behavior of the diskbalancer with balancer and mover. 2016-11-01 16:48:45 -07:00
Anu Engineer
34173a42d4 HDFS-10633. DiskBalancer : Add the description for the new setting dfs.disk.balancer.plan.threshold.percent in HDFSDiskbalancer.md. Contributed by Yiqun Lin. 2016-11-01 11:14:03 -07:00
Arpit Agarwal
a9d68d2e8e HDFS-11074. Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage. Contributed by Hanisha Koneru. 2016-10-31 12:39:30 -07:00
Brahma Reddy Battula
e9c7a97089 HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Rakesh R. 2016-10-31 00:22:51 +05:30
Mingliang Liu
8a9388e5f6 HDFS-11048. Audit Log should escape control characters. Contributed by Eric Badger 2016-10-28 10:53:14 -07:00
Xiao Chen
57187fdb93 HDFS-11064. Mention the default NN rpc ports in hdfs-default.xml. Contributed by Yiqun Lin. 2016-10-27 18:13:06 -07:00
Robert Kanter
5877f20f9c HADOOP-10075. Update jetty dependency to version 9 (rkanter) 2016-10-27 16:09:00 -07:00