big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
20,670 Commits 2 Branches 2 Tags 264 MiB
300f560fcc
Commit Graph

5382 Commits

Author SHA1 Message Date
Giovanni Matteo Fumarola
300f560fcc HDFS-14102. Performance improvement in BlockPlacementPolicyDefault. Contributed by Beluga Behr. 2018-11-28 11:33:22 -08:00
Giovanni Matteo Fumarola
4ca3a6b21a HDFS-14108. Performance improvement in BlockManager Data Structures. Contributed by Beluga Behr. 2018-11-28 11:25:47 -08:00
Vinayakumar B
b098281454 HDFS-13816. dfs.getQuotaUsage() throws NPE on non-existent dir instead of FileNotFoundException. Contributed by Vinayakumar B. 2018-11-26 18:22:32 +05:30
Brahma Reddy Battula
892b33e054 HDFS-14064. WEBHDFS: Support Enable/Disable EC Policy. Contributed by Ayush Saxena. 2018-11-22 00:13:56 +05:30
Vinayakumar B
68d5dfdc78 HDFS-14056. Fix error messages in HDFS-12716. Contributed by Ayush Saxena. 2018-11-16 18:05:10 +05:30
Vinayakumar B
8571507efa HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena. 2018-11-16 17:26:36 +05:30
Inigo Goiri
460a94a10f HDFS-14045. Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN. Contributed by Jiandan Yang. 2018-11-15 10:58:57 -08:00
Xiao Chen
9da6054ca4 Revert "HDFS-13732. ECAdmin should print the policy name when an EC policy is set. Contributed by Zsolt Venczel." 
This reverts commit 7dc79a8b5b.
 2018-11-13 12:44:25 -08:00
Brahma Reddy Battula
e7b63baca1 HDFS-14070. Refactor NameNodeWebHdfsMethods to allow better extensibility. Contributed by CR Hota 2018-11-13 12:45:44 +05:30
Arpit Agarwal
b6d4e19f34 HDFS-14065. Failed Storage Locations shows nothing in the Datanode Volume Failures. Contributed by Ayush Saxena. 2018-11-12 15:31:42 -08:00
Kitti Nanasi
8d99648c20 HDFS-14039. ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3). Contributed by Kitti Nanasi. 
Signed-off-by: Xiao Chen <xiao@apache.org>
 2018-11-08 10:01:19 -08:00
Inigo Goiri
f0ce072934 HDFS-14051. Refactor NameNodeHttpServer#initWebHdfs to specify local keytab. Contributed by CR Hota. 2018-11-06 10:05:58 -08:00
Akira Ajisaka
6430c9890a
HADOOP-15904. [JDK 11] Javadoc build failed due to bad use of '>' in hadoop-hdfs. 2018-11-06 18:42:38 +09:00
Xiao Chen
ffc9c50e07 HDFS-14053. Provide ability for NN to re-replicate based on topology changes. Contributed by Hrishikesh Gadre. 2018-11-05 21:38:39 -08:00
Inigo Goiri
f3296501e0 HDFS-14043. Tolerate corrupted seen_txid file. Contributed by Lukas Majercak. 2018-11-05 16:48:37 -08:00
Giovanni Matteo Fumarola
f3f5e7ad00 HDFS-14042. Fix NPE when PROVIDED storage is missing. Contributed by Virajith Jalaparti. 2018-11-05 11:02:31 -08:00
Siyao Meng
8fe85af63b HDFS-13996. Make HttpFS' ACLs RegEx configurable. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2018-11-01 17:36:50 -07:00
Pranay Singh
d98b881e9a HDFS-14008. NN should log snapshotdiff report. Contributed by Pranay Singh. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2018-11-01 17:26:00 -07:00
Akira Ajisaka
fac9f91b29
HDFS-13942. [JDK10] Fix javadoc errors in hadoop-hdfs module. Contributed by Dinesh Chitlangia. 2018-10-31 14:43:58 +09:00
Anu Engineer
4f10d7e23f HDFS-14028. HDFS OIV temporary dir deletes folder. 
Contributed by Adam Antal.
 2018-10-26 16:41:23 -07:00
Ajay Kumar
97bd49fc36 HDFS-14026. Overload BlockPoolTokenSecretManager.checkAccess to make storageId and storageType optional. Contributed by Arpit Agarwal. 2018-10-24 21:55:42 -07:00
Chen Liang
635786a511 HDFS-13566. Add configurable additional RPC listener to NameNode. Contributed by Chen Liang. 2018-10-23 14:53:45 -07:00
Arpit Agarwal
c58811c77d HDFS-13941. make storageId in BlockPoolTokenSecretManager.checkAccess optional. Contributed by Ajay Kumar. 2018-10-22 14:44:28 -07:00
Inigo Goiri
f069d38c8d HDFS-13983. TestOfflineImageViewer crashes in windows. Contributed by Vinayakumar B. 2018-10-19 17:16:04 -07:00
Inigo Goiri
88cce32551 HDFS-9872. HDFS bytes-default configurations should accept multiple size units. Contributed by Yiqun Lin. 2018-10-19 10:38:04 -07:00
Inigo Goiri
8b64fbab1a HDFS-13994. Improve DataNode BlockSender waitForMinLength. Contributed by BELUGA BEHR. 2018-10-19 10:36:03 -07:00
Inigo Goiri
0e56c883cd HDFS-14003. Fix findbugs warning in trunk for FSImageFormatPBINode. Contributed by Yiqun Lin. 2018-10-18 10:53:30 -07:00
Vinayakumar B
b60ca37914 Fix potential FSImage corruption. Contributed by Daryn Sharp. 2018-10-15 15:48:26 +05:30
Shweta
c0118105b7 HDFS-13973. getErasureCodingPolicy should log path in audit event. Contributed by Shweta. 
Signed-off-by: Xiao Chen <xiao@apache.org>
 2018-10-11 20:39:41 -07:00
Inigo Goiri
3532aa3886 HDFS-13968. BlockReceiver Array-Based Queue. Contributed by BELUGA BEHR. 2018-10-11 13:49:39 -07:00
Steve Loughran
2addebb94f
HDFS-13951. HDFS DelegationTokenFetcher can't print non-HDFS tokens in a tokenfile. 
Contributed by Steve Loughran.
 2018-10-11 20:03:56 +01:00
Hrishikesh Gadre
bf3d591f0c HDFS-13956. iNotify should include information to identify a file as either replicated or erasure coded. Contributed by Hrishikesh Gadre. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2018-10-10 10:23:07 -07:00
Weiwei Yang
3ead525c71 HDFS-12459. Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2018-10-10 10:11:10 -07:00
Kitti Nanasi
10185d9a77 HDFS-13882. Set a maximum delay for retrying locateFollowingBlock. Contributed by Kitti Nanasi. 
Signed-off-by: Xiao Chen <xiao@apache.org>
 2018-10-10 08:55:32 -07:00
Nanda kumar
b39b802422 HDFS-13949. Correct the description of dfs.datanode.disk.check.timeout in hdfs-default.xml. Contributed by Toshihiro Suzuki. 2018-10-10 12:29:07 +05:30
Hrishikesh Gadre
08bb6c49a5 HDFS-13926. ThreadLocal aggregations for FileSystem.Statistics are incorrect with striped reads. 
Contributed by Xiao Chen, Hrishikesh Gadre.

Signed-off-by: Xiao Chen <xiao@apache.org>
 2018-10-08 20:31:57 -07:00
Yiqun Lin
1043795f7f HDFS-13962. Add null check for add-replica pool to avoid lock acquiring. Contributed by Surendra Singh Lilhore. 2018-10-09 10:33:13 +08:00
Inigo Goiri
73c660b43f HDFS-13958. Miscellaneous Improvements for FsVolumeSpi. Contributed by BELUGA BEHR. 2018-10-05 09:32:19 -07:00
Inigo Goiri
1dc0adfac0 HDFS-13947. Review of DirectoryScanner Class. Contributed by BELUGA BEHR. 2018-10-03 11:19:57 -07:00
Yiqun Lin
5689355783 HDFS-13768. Adding replicas to volume map makes DataNode start slowly. Contributed by Surendra Singh Lilhore. 2018-10-02 09:43:14 +08:00
Takanobu Asanuma
e2113500df HDFS-8196. Post enabled Erasure Coding Policies on NameNode UI. Contributed by Kitti Nanasi and Kai Sasaki. 2018-09-29 00:53:35 +09:00
Brahma Reddy Battula
e0ff8e2c10 HDFS-13840. RBW Blocks which are having less GS should be added to Corrupt. Contributed by Brahma Reddy Battula 2018-09-26 23:44:16 +05:30
Arpit Agarwal
2eb597b151 HADOOP-15772. Remove the 'Path ... should be specified as a URI' warnings on startup. Contributed by Ayush Saxena. 2018-09-19 13:48:27 -07:00
Chen Liang
a30b4f9e71 HADOOP-15726. Create utility to limit frequency of log statements. Contributed by Erik Krogen. 2018-09-19 13:22:37 -07:00
Inigo Goiri
090272d7de HADOOP-15684. triggerActiveLogRoll stuck on dead name node, when ConnectTimeoutException happens. Contributed by Rong Tang. 2018-09-19 13:00:30 -07:00
Wei-Chiu Chuang
28ceb34a72 HDFS-13868. WebHDFS: GETSNAPSHOTDIFF API NPE when param "snapshotname" is given but "oldsnapshotname" is not. Contributed by Pranay Singh. 2018-09-19 03:12:20 -07:00
Shweta
27978bcb66 HDFS-13833. Improve BlockPlacementPolicyDefault's consider load logic. Contributed by Shweta. 
Signed-off-by: Xiao Chen <xiao@apache.org>
 2018-09-18 20:23:50 -07:00
Mingliang Liu
6ff509c32a HDFS-11719. Arrays.fill() wrong index in BlockSender.readChecksum() exception handling. Contributed by Tao Zhang 2018-09-18 10:25:28 -07:00
Inigo Goiri
d1541932db HDFS-13844. Fix the fmt_bytes function in the dfs-dust.js. Contributed by yanghuafeng. 2018-09-17 14:42:03 -07:00
Inigo Goiri
e1b242a984 HDFS-13914. Fix DN UI logs link broken when https is enabled after HDFS-13902. Contributed by Jianfei Jiang. 2018-09-13 09:16:58 -07:00