big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
19,681 Commits 2 Branches 2 Tags 264 MiB
5692887395
Commit Graph

4306 Commits

Author SHA1 Message Date
Kai Zheng
5692887395 HDFS-10794. [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work. Contributed by Rakesh R 2018-08-12 03:05:52 -07:00
Virajith Jalaparti
15241c6349 HDFS-13795. Fix potential NPE in InMemoryLevelDBAliasMapServer. 2018-08-10 09:38:40 -07:00
Xiao Chen
9499df7b81 HDFS-13658. Expose HighestPriorityLowRedundancy blocks statistics. Contributed by Kitti Nanasi. 2018-08-08 10:40:20 -07:00
Ewan Higgs
2ec97abb2e HADOOP-15576. S3A Multipart Uploader to work with S3Guard and encryption Originally contributed by Ewan Higgs with refinements by Steve Loughran. 2018-08-08 13:50:23 +02:00
Xiao Chen
6677717c68 HDFS-13728. Disk Balancer should not fail if volume usage is greater than capacity. Contributed by Stephen O'Donnell. 2018-08-07 22:05:17 -07:00
Vinayakumar B
2b0f977241 HDFS-13786. EC: Display erasure coding policy for sub-directories is not working. Contributed by Ayush Saxena. 2018-08-08 07:53:17 +05:30
Brahma Reddy Battula
3108d27edd HDFS-12716. 'dfs.datanode.failed.volumes.tolerated' to support minimum number of volumes to be available. Contributed by Ranith Sardar and usharani 2018-07-30 15:50:04 +05:30
Xiao Chen
be150a17b1 HDFS-13622. mkdir should print the parent directory in the error message when parent directories do not exist. Contributed by Shweta. 2018-07-26 10:24:32 -07:00
Wei-Chiu Chuang
e95c5e9f62 HDFS-11060. make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable. Contributed by Lantao Jin. 2018-07-25 11:04:18 -07:00
Daniel Templeton
849c45db18 HDFS-13448. HDFS Block Placement - Ignore Locality for First Block Replica 
(Contributed by BELUGA BEHR via Daniel Templeton)

Change-Id: I965d1cfa642ad24296038b83e3d5c9983545267d
 2018-07-24 16:05:27 -07:00
Wei-Chiu Chuang
88b2794244 HDFS-13524. Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize. Contributed by Siyao Meng. 2018-07-16 10:51:23 -07:00
Akira Ajisaka
88625f5cd9
HADOOP-15531. Use commons-text instead of commons-lang in some classes to fix deprecation warnings. Contributed by Takanobu Asanuma. 2018-07-13 11:42:12 -04:00
Xiao Chen
b37074be5a HDFS-12837. Intermittent failure in TestReencryptionWithKMS. 2018-07-11 21:03:19 -07:00
Wei-Chiu Chuang
162228e8db HDFS-13723. Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh. Contributed by Siyao Meng. 2018-07-11 10:02:08 -07:00
Xiao Chen
936e0df0d3 HDFS-13721. NPE in DataNode due to uninitialized DiskBalancer. 2018-07-06 21:00:32 -07:00
Wei-Chiu Chuang
0247cb6318 HDFS-13121. NPE when request file descriptors when SC read. Contributed by Zsolt Venczel. 2018-07-06 14:59:49 -07:00
Bharat Viswanadham
59a3038bc3 HDFS-13715:diskbalancer does not work if one of the blockpools are empty on a Federated cluster. Contributed by Bharat Viswanadham 2018-07-02 21:43:18 -07:00
Inigo Goiri
7296b644f7 HDFS-13714. Fix TestNameNodePrunesMissingStorages test failures on Windows. Contributed by Lukas Majercak. 2018-07-02 16:36:25 -07:00
Inigo Goiri
1804a31515 HDFS-13536. [PROVIDED Storage] HA for InMemoryAliasMap. Contributed by Virajith Jalaparti. 2018-07-02 10:48:20 -07:00
Andrew Wang
5d748bd056 HDFS-13702. Remove HTrace hooks from DFSClient to reduce CPU usage. Contributed by Todd Lipcon. 2018-07-02 12:11:06 +02:00
Xiao Chen
32f867a6a9 HDFS-13682. Cannot create encryption zone after KMS auth token expires. 2018-06-20 15:58:26 -07:00
Akira Ajisaka
fba9d7cd74
HDFS-13621. Upgrade commons-lang version to 3.7 in hadoop-hdfs-project. Contributed by Takanobu Asanuma. 2018-06-18 10:17:07 -07:00
Chris Douglas
980031bb04 HADOOP-13186. Multipart Uploader API. Contributed by Ewan Higgs 2018-06-17 11:54:26 -07:00
Inigo Goiri
8762e9cf10 HDFS-13681. Fix TestStartup.testNNFailToStartOnReadOnlyNNDir test failure on Windows. Contributed by Xiao Liang. 2018-06-15 16:49:06 -07:00
Inigo Goiri
d31a3ce767 HDFS-13686. Add overall metrics for FSNamesystemLock. Contributed by Lukas Majercak. 2018-06-15 15:59:19 -07:00
Wei-Chiu Chuang
c966a3837a HDFS-13174. hdfs mover -p /path times out after 20 min. Contributed by Istvan Fajth. 2018-06-15 13:36:46 -07:00
Inigo Goiri
eebeb6033f HDFS-13676. TestEditLogRace fails on Windows. Contributed by Zuoming Zhang. 2018-06-15 13:07:54 -07:00
Inigo Goiri
43d994e4a6 HDFS-13673. TestNameNodeMetrics fails on Windows. Contributed by Zuoming Zhang. 2018-06-15 10:33:28 -07:00
Inigo Goiri
5d7449d2b8 HDFS-13675. Speed up TestDFSAdminWithHA. Contributed by Lukas Majercak. 2018-06-14 13:43:14 -07:00
Inigo Goiri
8d4926f38b HDFS-13563. TestDFSAdminWithHA times out on Windows. Contributed by Lukas Majercak. 2018-06-14 09:58:50 -07:00
Yiqun Lin
8e7548d33b HDFS-13641. Add metrics for edit log tailing. Contributed by Chao Sun. 2018-06-13 20:05:55 +08:00
Inigo Goiri
2e5cfe6df3 HDFS-13653. Make dfs.client.failover.random.order a per nameservice configuration. Contributed by Ekanth Sethuramalingam. 2018-06-11 11:20:29 -07:00
Xiao Chen
cf4108313d HDFS-13642. Creating a file with block size smaller than EC policy's cell size should fail. 2018-06-08 15:14:11 -07:00
Wei-Chiu Chuang
e39b113db0 HDFS-13659. Add more test coverage for contentSummary for snapshottable path. Contributed by Wei-Chiu Chuang. 2018-06-07 08:30:06 -07:00
Brahma Reddy Battula
9654dd1f47 HDFS-12950. [oiv] ls will fail in secure cluster. Contributed by Wei-Chiu Chuang. 2018-06-07 10:16:02 +05:30
Inigo Goiri
8d31ddcfeb HDFS-13650. Randomize baseDir for MiniDFSCluster in TestDFSStripedInputStream and TestDFSStripedInputStreamWithRandomECPolicy. Contributed by Anbang Hu. 2018-06-04 18:28:11 -07:00
Inigo Goiri
16316b6011 HDFS-13649. Randomize baseDir for MiniDFSCluster in TestReconstructStripedFile and TestReconstructStripedFileWithRandomECPolicy. Contributed by Anbang Hu. 2018-06-04 18:21:38 -07:00
Inigo Goiri
a28848104f HDFS-13652. Randomize baseDir for MiniDFSCluster in TestBlockScanner. Contributed by Anbang Hu. 2018-06-04 18:12:43 -07:00
Rushabh Shah
e2289c8d14 HDFS-13281 Namenode#createFile should be /.reserved/raw/ aware.. Contributed by Rushabh S Shah 2018-06-04 09:19:03 -05:00
Xiao Chen
9efb4b7db0 HDFS-13339. Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume. Contributed by liaoyuxiangqin and Zsolt Venczel. 2018-06-03 22:33:34 -07:00
Inigo Goiri
8f83b9abf9 HDFS-13648. Fix TestGetConf#testGetJournalNodes on Windows due to a mismatch line separator. Contributed by Giovanni Matteo Fumarola. 2018-06-02 20:19:59 -07:00
Inigo Goiri
e308ac88d3 HDFS-13651. TestReencryptionHandler fails on Windows. Contributed by Anbang Hu. 2018-06-02 20:12:35 -07:00
Konstantin V Shvachko
ebe5853a45 HDFS-12978. Fine-grained locking while consuming journal stream. Contributed by Konstantin Shvachko. 2018-05-31 14:56:32 -07:00
Inigo Goiri
1f324e9661 HDFS-13631. TestDFSAdmin#testCheckNumOfBlocksInReportCommand should use a separate MiniDFSCluster path. Contributed by Anbang Hu. 2018-05-31 10:12:38 -07:00
Sean Mackrory
1361030e59 HDFS-13582. Improve backward compatibility for HDFS-13176 (WebHdfs file path gets truncated when having semicolon (;) inside). Contributed by Zsolt Venczel. 2018-05-31 07:59:21 -06:00
Inigo Goiri
47c31ff16b HDFS-13629. Some tests in TestDiskBalancerCommand fail on Windows due to MiniDFSCluster path conflict and improper path usage. Contributed by Anbang Hu. 2018-05-30 10:22:04 -07:00
Inigo Goiri
8197b9b560 HDFS-13632. Randomize baseDir for MiniJournalCluster in MiniQJMHACluster for TestDFSAdminWithHA. Contributed by Anbang Hu. 2018-05-30 10:13:52 -07:00
Yiqun Lin
b24098bc8f HDFS-13626. Fix incorrect username when deny the setOwner operation. Contributed by Zsolt Venczel. 2018-05-30 16:52:21 +08:00
Inigo Goiri
9dbf4f0166 HDFS-13591. TestDFSShell#testSetrepLow fails on Windows. Contributed by Anbang Hu. 2018-05-28 16:34:02 -07:00
Inigo Goiri
91d7c74e6a HDFS-13627. TestErasureCodingExerciseAPIs fails on Windows. Contributed by Anbang Hu. 2018-05-28 10:26:47 -07:00