big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
14,834 Commits 2 Branches 2 Tags 264 MiB
7154a20bcb
Commit Graph

5956 Commits

Author SHA1 Message Date
Arpit Agarwal
b71907b2ae HDFS-11097. Fix warnings for deprecated StorageReceivedDeletedBlocks constructor. Contributed by Yiqun Lin. 2016-11-03 10:27:52 -07:00
Andrew Wang
7e521c5a49 HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory. 2016-11-02 19:11:05 -07:00
Anu Engineer
730cb0cff6 HDFS-10566. Submit plan request should throw exception if Datanode is in non-REGULAR status. Contributed by Xiaobing Zhou. 2016-11-02 17:46:56 -07:00
Lei Xu
b59206190e HDFS-10909. De-duplicate code in ErasureCodingWorker#initializeStripedReadThreadPool and DFSClient#initThreadsNumForStripedReads. (Manoj Govindassamy via lei) 2016-11-02 16:45:25 -07:00
Mingliang Liu
9b0c17f852 HDFS-11095. BlockManagerSafeMode should respect extension period default config value (30s). Contributed by Mingliang Liu 2016-11-02 14:58:24 -07:00
Andrew Wang
f2800f523d Revert "HADOOP-13717. Normalize daemonization behavior of the diskbalancer with balancer and mover." 
This reverts commit bd7f5911c7.
 2016-11-02 13:46:33 -07:00
Brahma Reddy Battula
cb5cc0dc53 HDFS-11031. Add additional unit test for DataNode startup behavior when volumes fail. Contributed by Mingliang Liu. 2016-11-02 10:35:47 +05:30
Andrew Wang
bd7f5911c7 HADOOP-13717. Normalize daemonization behavior of the diskbalancer with balancer and mover. 2016-11-01 16:48:45 -07:00
Mingliang Liu
fa1512a740 HDFS-11065. Add space quota tests for heterogenous storages. Contributed by Xiaobing Zhou 2016-11-01 14:42:03 -07:00
Anu Engineer
34173a42d4 HDFS-10633. DiskBalancer : Add the description for the new setting dfs.disk.balancer.plan.threshold.percent in HDFSDiskbalancer.md. Contributed by Yiqun Lin. 2016-11-01 11:14:03 -07:00
Brahma Reddy Battula
808f5d8985 HDFS-10499. TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently. Contributed by Yiqun Lin. 2016-11-01 21:32:52 +05:30
Mingliang Liu
0c49f73a6c HDFS-11030. TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing). Contributed by Mingliang Liu 2016-10-31 16:00:33 -07:00
Arpit Agarwal
a9d68d2e8e HDFS-11074. Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage. Contributed by Hanisha Koneru. 2016-10-31 12:39:30 -07:00
Brahma Reddy Battula
e9c7a97089 HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Rakesh R. 2016-10-31 00:22:51 +05:30
Mingliang Liu
8a9388e5f6 HDFS-11048. Audit Log should escape control characters. Contributed by Eric Badger 2016-10-28 10:53:14 -07:00
Kai Zheng
8fa2195697 HDFS-10926. Update staled configuration properties related to erasure coding. Contributed by Sammi Chen 2016-10-28 12:37:30 +06:00
Xiao Chen
57187fdb93 HDFS-11064. Mention the default NN rpc ports in hdfs-default.xml. Contributed by Yiqun Lin. 2016-10-27 18:13:06 -07:00
Robert Kanter
5877f20f9c HADOOP-10075. Update jetty dependency to version 9 (rkanter) 2016-10-27 16:09:00 -07:00
Mingliang Liu
9e03ee5279 HDFS-11047. Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode. Contributed by Xiaobing Zhou 2016-10-27 16:00:27 -07:00
Erik Krogen
f3ac1f41b8 HDFS-9500. Fix software version counts for DataNodes during rolling upgrade. Contributed by Erik Krogen. 2016-10-27 15:58:25 -07:00
Wei-Chiu Chuang
31ff42b510 HDFS-11055. Update default-log4j.properties for httpfs to imporve test logging. Contributed by Wei-Chiu Chuang. 2016-10-27 13:37:00 -07:00
Kihwal Lee
ae48c496dc HDFS-11069. Tighten the authorization of datanode RPC. Contributed by Kihwal Lee 2016-10-27 14:17:16 -05:00
Kihwal Lee
db41965996 Revert "HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Tianyin Xiu" 
This reverts commit ac35ee9393.
 2016-10-27 14:07:28 -05:00
Brahma Reddy Battula
ac35ee9393 HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Tianyin Xiu 2016-10-27 20:20:56 +05:30
Vinayakumar B
1cf6ec4ad4 HDFS-8492. DN should notify NN when client requests a missing block (Contributed by Walter Su) 2016-10-27 16:44:00 +05:30
Vinayakumar B
77f2684dd3 HDFS-10769. BlockIdManager.clear doesn't reset the counter for blockGroupIdGenerator (Contributed by Yiqun Lin and Rakesh R) 2016-10-27 14:16:03 +05:30
Akira Ajisaka
9c680d0b05 HDFS-11049. The description of dfs.block.replicator.classname is not clear. Contributed by Yiqun Lin. 2016-10-27 16:30:57 +09:00
Vinayakumar B
a895c66255 HDFS-9929. Duplicate keys in NAMENODE_SPECIFIC_KEYS (Contributed by Akira Ajisaka) 2016-10-27 12:20:15 +05:30
Masatake Iwasaki
0bdd263d82 HADOOP-13017. Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0. Contributed by Steve Loughran. 2016-10-27 15:46:59 +09:00
Anu Engineer
9f32364d28 HDFS-11038. DiskBalancer: support running multiple commands in single test. Contributed by Xiaobing Zhou. 2016-10-26 19:39:02 -07:00
Mingliang Liu
55e1fb8e32 HDFS-10921. TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode. Contributed by Eric Badger 2016-10-26 14:11:38 -07:00
Lei Xu
f209e93566 HDFS-10638. Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode. (Virajith Jalaparti via lei) 2016-10-26 10:32:35 -07:00
Kihwal Lee
e90af4a89b HDFS-11053. Unnecessary superuser check in versionRequest(). Contributed by Kihwal Lee. 2016-10-26 09:16:13 -05:00
Kihwal Lee
ce6bbfb23c HDFS-11050. Change log level to 'warn' when ssl initialization fails and defaults to DEFAULT_TIMEOUT_CONN_CONFIGURATOR. Contributed by Kuhu Shukla. 2016-10-26 08:07:53 -05:00
Kai Zheng
287effff93 HDFS-10935. TestFileChecksum fails in some cases. Contributed by Sammi Chen 2016-10-26 09:40:31 +06:00
Arpit Agarwal
9dce9011ad HDFS-11054. Suppress verbose log message in BlockPlacementPolicyDefault. Contributed by Chen Liang. 2016-10-25 19:50:56 -07:00
Xiaoyu Yao
9a8a386458 HDFS-11011. Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'. Contributed by Xiaobing Zhou. 2016-10-25 11:24:03 -07:00
Zhe Zhang
f6367c5f44 HDFS-11015. Enforce timeout in balancer. Contributed by Kihwal Lee. 2016-10-25 10:19:13 -07:00
Akira Ajisaka
dc3272bfe8 HDFS-11046. Duplicate '-' in the daemon log name. 2016-10-25 10:07:43 +09:00
Kihwal Lee
9d175853b0 HDFS-10997. Reduce number of path resolving methods. Contributed by Daryn Sharp. 2016-10-24 17:14:51 -05:00
Kihwal Lee
b18f35f097 HDFS-11042. Add missing cleanupSSLConfig() call for tests that use setupSSLConfig(). Contributed by Kuhu Shukla. 2016-10-24 08:28:44 -05:00
Wei-Chiu Chuang
25438526ed HDFS-11033. Add documents for native raw erasure coder in XOR codes. Contributed by SammiChen. 2016-10-21 16:20:07 -07:00
Wei-Chiu Chuang
df857f0d10 HDFS-10975. fsck -list-corruptfileblocks does not report corrupt EC files. Contributed by Takanobu Asanuma. 2016-10-21 15:43:12 -07:00
Andrew Wang
61e30cf83c HDFS-8410. Add computation time metrics to datanode for ECWorker. Contributed by SammiChen. 2016-10-21 13:12:41 -07:00
Chris Douglas
ae8bccd509 HADOOP-13702. Add instrumented ReadWriteLock. Contributed by Jingcheng Du 2016-10-21 12:59:54 -07:00
Brahma Reddy Battula
f63cd78f60 HDFS-10730. Fix some failed tests due to BindException. Contributed by Yiqun Lin 2016-10-21 18:16:39 +05:30
Mingliang Liu
d7d87deece HDFS-10998. Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA. Contributed by Xiaobing Zhou 2016-10-20 19:51:48 -07:00
Wei-Chiu Chuang
5e83a21cb6 HDFS-10976. Report erasure coding policy of EC files in Fsck. Contributed by Wei-Chiu Chuang. 2016-10-20 13:06:43 -07:00
Wei-Chiu Chuang
6d2da38d16 HDFS-11018. Incorrect check and message in FsDatasetImpl#invalidate. Contributed by Yiqun Lin. 2016-10-20 10:56:39 -07:00
Brahma Reddy Battula
f872c6bc03 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 2016-10-20 21:47:17 +05:30