big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
14,764 Commits 2 Branches 2 Tags 264 MiB
7e3c327d31
Commit Graph

5144 Commits

Author SHA1 Message Date
Kihwal Lee
ae48c496dc HDFS-11069. Tighten the authorization of datanode RPC. Contributed by Kihwal Lee 2016-10-27 14:17:16 -05:00
Kihwal Lee
db41965996 Revert "HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Tianyin Xiu" 
This reverts commit ac35ee9393.
 2016-10-27 14:07:28 -05:00
Brahma Reddy Battula
ac35ee9393 HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Tianyin Xiu 2016-10-27 20:20:56 +05:30
Vinayakumar B
1cf6ec4ad4 HDFS-8492. DN should notify NN when client requests a missing block (Contributed by Walter Su) 2016-10-27 16:44:00 +05:30
Vinayakumar B
77f2684dd3 HDFS-10769. BlockIdManager.clear doesn't reset the counter for blockGroupIdGenerator (Contributed by Yiqun Lin and Rakesh R) 2016-10-27 14:16:03 +05:30
Akira Ajisaka
9c680d0b05 HDFS-11049. The description of dfs.block.replicator.classname is not clear. Contributed by Yiqun Lin. 2016-10-27 16:30:57 +09:00
Vinayakumar B
a895c66255 HDFS-9929. Duplicate keys in NAMENODE_SPECIFIC_KEYS (Contributed by Akira Ajisaka) 2016-10-27 12:20:15 +05:30
Anu Engineer
9f32364d28 HDFS-11038. DiskBalancer: support running multiple commands in single test. Contributed by Xiaobing Zhou. 2016-10-26 19:39:02 -07:00
Mingliang Liu
55e1fb8e32 HDFS-10921. TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode. Contributed by Eric Badger 2016-10-26 14:11:38 -07:00
Lei Xu
f209e93566 HDFS-10638. Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode. (Virajith Jalaparti via lei) 2016-10-26 10:32:35 -07:00
Kihwal Lee
e90af4a89b HDFS-11053. Unnecessary superuser check in versionRequest(). Contributed by Kihwal Lee. 2016-10-26 09:16:13 -05:00
Kai Zheng
287effff93 HDFS-10935. TestFileChecksum fails in some cases. Contributed by Sammi Chen 2016-10-26 09:40:31 +06:00
Arpit Agarwal
9dce9011ad HDFS-11054. Suppress verbose log message in BlockPlacementPolicyDefault. Contributed by Chen Liang. 2016-10-25 19:50:56 -07:00
Xiaoyu Yao
9a8a386458 HDFS-11011. Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'. Contributed by Xiaobing Zhou. 2016-10-25 11:24:03 -07:00
Zhe Zhang
f6367c5f44 HDFS-11015. Enforce timeout in balancer. Contributed by Kihwal Lee. 2016-10-25 10:19:13 -07:00
Akira Ajisaka
dc3272bfe8 HDFS-11046. Duplicate '-' in the daemon log name. 2016-10-25 10:07:43 +09:00
Kihwal Lee
9d175853b0 HDFS-10997. Reduce number of path resolving methods. Contributed by Daryn Sharp. 2016-10-24 17:14:51 -05:00
Kihwal Lee
b18f35f097 HDFS-11042. Add missing cleanupSSLConfig() call for tests that use setupSSLConfig(). Contributed by Kuhu Shukla. 2016-10-24 08:28:44 -05:00
Wei-Chiu Chuang
25438526ed HDFS-11033. Add documents for native raw erasure coder in XOR codes. Contributed by SammiChen. 2016-10-21 16:20:07 -07:00
Wei-Chiu Chuang
df857f0d10 HDFS-10975. fsck -list-corruptfileblocks does not report corrupt EC files. Contributed by Takanobu Asanuma. 2016-10-21 15:43:12 -07:00
Andrew Wang
61e30cf83c HDFS-8410. Add computation time metrics to datanode for ECWorker. Contributed by SammiChen. 2016-10-21 13:12:41 -07:00
Chris Douglas
ae8bccd509 HADOOP-13702. Add instrumented ReadWriteLock. Contributed by Jingcheng Du 2016-10-21 12:59:54 -07:00
Brahma Reddy Battula
f63cd78f60 HDFS-10730. Fix some failed tests due to BindException. Contributed by Yiqun Lin 2016-10-21 18:16:39 +05:30
Mingliang Liu
d7d87deece HDFS-10998. Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA. Contributed by Xiaobing Zhou 2016-10-20 19:51:48 -07:00
Wei-Chiu Chuang
5e83a21cb6 HDFS-10976. Report erasure coding policy of EC files in Fsck. Contributed by Wei-Chiu Chuang. 2016-10-20 13:06:43 -07:00
Wei-Chiu Chuang
6d2da38d16 HDFS-11018. Incorrect check and message in FsDatasetImpl#invalidate. Contributed by Yiqun Lin. 2016-10-20 10:56:39 -07:00
Brahma Reddy Battula
f872c6bc03 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 2016-10-20 21:47:17 +05:30
Brahma Reddy Battula
6fb6b651e8 HDFS-10699. Log object instance get incorrectly in TestDFSAdmin. Contributed by Yiqun Lin 2016-10-20 21:28:16 +05:30
Kihwal Lee
5c0bffddc0 HDFS-10627. Volume Scanner marks a block as "suspect" even if the exception is network-related. Contributed by Rushabh S Shah. 2016-10-20 10:48:35 -05:00
Brahma Reddy Battula
4c73be135c HDFS-9480. Expose nonDfsUsed via StorageTypeStats. Contributed by Brahma Reddy Battula 2016-10-20 20:45:45 +05:30
Brahma Reddy Battula
73504b1bdc HDFS-11025. TestDiskspaceQuotaUpdate fails in trunk due to Bind exception. Contributed by Yiqun Lin 2016-10-20 10:41:18 +05:30
Arpit Agarwal
b4564103e4 HDFS-10752. Several log refactoring/improvement suggestion in HDFS. Contributed by Hanisha Koneru. 2016-10-19 17:20:07 -07:00
Xiao Chen
c5573e6a75 HDFS-11009. Add a tool to reconstruct block meta file from CLI. 2016-10-18 22:42:28 -07:00
Xiaoyu Yao
c62ae7107f HDFS-10906. Add unit tests for Trash with HDFS encryption zones. Contributed by Hanisha Koneru. 2016-10-18 14:05:43 -07:00
Kai Zheng
d26a1bb9d6 HDFS-10920. TestStorageMover#testNoSpaceDisk is failing intermittently. Contributed by Rakesh R 2016-10-18 14:51:08 +06:00
Kai Zheng
c023c74886 HADOOP-13061. Refactor erasure coders. Contributed by Kai Sasaki 2016-10-18 12:02:53 +06:00
Akira Ajisaka
bedfec0c10 HADOOP-13522. Add %A and %a formats for fs -stat command to print permissions. Contributed by Alex Garbarini. 2016-10-18 15:00:44 +09:00
Ming Ma
b61fb267b9 HDFS-9390. Block management for maintenance states. 2016-10-17 17:45:41 -07:00
Xiaoyu Yao
8fd4c37c45 HDFS-10922. Adding additional unit tests for Trash (II). Contributed by Weiwei Yang. 2016-10-17 14:21:36 -07:00
Brahma Reddy Battula
5f4ae85bd8 HDFS-11003. Expose XmitsInProgress through DataNodeMXBean. Contributed By Brahma Reddy Battula 2016-10-15 22:28:33 +05:30
Vinitha Reddy Gankidi
391ce535a7 HDFS-10301. Remove FBR tracking state to fix false zombie storage detection for interleaving block reports. Contributed by Vinitha Gankidi. 2016-10-14 18:13:54 -07:00
Anu Engineer
30bb1970cc HDFS-10558. DiskBalancer: Print the full path to plan file. Contributed by Xiaobing Zhou. 2016-10-14 17:07:59 -07:00
Mingliang Liu
76cc84e6d4 HDFS-11008. Change unit test for testing parsing "-source" parameter in Balancer CLI. Contributed by Mingliang Liu 2016-10-14 14:29:02 -07:00
Lei Xu
8c520a27cb HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei) 2016-10-14 13:41:59 -07:00
Jing Zhao
adb96e109f HDFS-10827. When there are unrecoverable ec block groups, Namenode Web UI doesn't show the block names. Contributed by Takanobu Asanuma. 2016-10-14 13:21:53 -07:00
Andrew Wang
0007360c33 HDFS-10883. 's behavior is not consistent in DFS after enabling EZ. Contributed by Yuanbo Liu. 2016-10-14 11:41:29 -07:00
Kihwal Lee
8a9f6635a3 HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin. 2016-10-14 11:38:48 -05:00
Andrew Wang
8c721aa00a Revert "HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin." 
This reverts commit fdce515091.
 2016-10-13 13:23:28 -07:00
Kihwal Lee
332a61fd74 HDFS-10987. Make Decommission less expensive when lot of blocks present. Contributed by Brahma Reddy Battula. 2016-10-13 13:52:49 -05:00
Andrew Wang
fdce515091 HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin. 2016-10-13 11:41:37 -07:00