Hui Fei
|
e2c1268ebd
|
HDFS-15240. Erasure Coding: dirty buffer causes reconstruction block error. Contributed by HuangTao.
|
2020-12-04 09:20:09 +08:00 |
|
Wei-Chiu Chuang
|
42a29199c0
|
HDFS-15705. Fix a typo in SecondaryNameNode.java. Contributed by Sixiang Ma.
|
2020-12-02 21:32:02 -08:00 |
|
LeonGao
|
6ff2409b31
|
HDFS-14904. Add Option to let Balancer prefer highly utilized nodes in each iteration (#2483). Contributed by Leon Gao.
|
2020-12-02 15:53:09 -08:00 |
|
Ahmed Hussein
|
60201cbf69
|
HDFS-15703. Don't generate edits for set operations that are no-op (#2508). Contributed by Daryn Sharp and Ahmed Hussein
|
2020-12-02 15:38:20 -06:00 |
|
Ahmed Hussein
|
2b5b556dd7
|
HDFS-15695. NN should not let the balancer run in safemode (#2489). Contributed by Daryn Sharp and Ahmed Hussein
|
2020-12-02 13:59:00 -06:00 |
|
Ahmed Hussein
|
918ba9e82f
|
HDFS-15694. Avoid calling UpdateHeartBeatState inside DataNodeDescriptor. (#2487) Contributed by Kuhu Shukla and Ahmed Hussein
|
2020-12-01 15:02:53 -06:00 |
|
Hui Fei
|
68442b48c8
|
HDFS-15698. Fix the typo of dfshealth.html after HDFS-15358 (#2495)
|
2020-11-28 12:19:57 +08:00 |
|
Takanobu Asanuma
|
f56cd88d7d
|
HDFS-15538. Fix the documentation for dfs.namenode.replication.max-streams in hdfs-default.xml. Contributed by Xieming Li.
|
2020-11-13 11:02:26 +09:00 |
|
jianghuazhu
|
e6d2dccbef
|
HDFS-15469. Dynamically configure the size of PacketReceiver#MAX_PACKET_SIZE. (#2138)
|
2020-11-10 16:34:17 -08:00 |
|
Yizhong Zhang
|
82de07c794
|
HADOOP-17142. Fix outdated properties of JournalNode when performing rollback. Contributed by Deegue.
|
2020-11-10 09:11:31 -08:00 |
|
maobaolong
|
95c96605b3
|
HDFS-15667. Audit log record the unexpected allowed result when delete (#2437)
|
2020-11-10 13:01:10 +08:00 |
|
LeonGao
|
9a9ab5b48e
|
HDFS-15548. Allow configuring DISK/ARCHIVE storage types on same device mount (#2288). Contributed by Leon Gao.
|
2020-11-09 15:06:16 -08:00 |
|
He Xiaoqiao
|
3067a25fa1
|
HDFS-15651. Client could not obtain block when DN CommandProcessingThread exit. Contributed by Aiphago.
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Yiqun Lin <yqlin@apache.org>
|
2020-11-04 13:53:46 +08:00 |
|
Ayush Saxena
|
7ac7840fc3
|
HDFS-15643. EC: Fix checksum computation in case of native encoders. (#2424). Contributed by Ayush Saxena.
|
2020-11-04 09:28:44 +05:30 |
|
Konstantin V Shvachko
|
d07dc7afb4
|
HDFS-15665. Balancer logging improvements. Contributed by Konstantin V Shvachko.
|
2020-11-03 12:02:40 -08:00 |
|
Akira Ajisaka
|
3848b44b37
|
HDFS-15580. [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails (#2309)
|
2020-10-27 19:18:08 +09:00 |
|
Hui Fei
|
12c908c827
|
HDFS-15641. DataNode could meet deadlock if invoke refreshNameNode. Contributed by Hongbing Wang.
|
2020-10-26 22:12:27 +08:00 |
|
Wei-Chiu Chuang
|
74634eb002
|
HDFS-15644. Failed volumes can cause DNs to stop block reporting. Contributed by Ahmed Hussein.
|
2020-10-23 12:05:53 -07:00 |
|
Kihwal Lee
|
da1b6e3cc2
|
HDFS-15622. Deleted blocks linger in the replications queue. Contributed by Ahmed Hussein.
|
2020-10-22 16:59:49 -05:00 |
|
Kihwal Lee
|
88a9f42f32
|
HDFS-15618. Improve datanode shutdown latency. Contributed by Ahmed Hussein.
|
2020-10-21 00:59:35 -05:00 |
|
Ayush Saxena
|
2e8cafac3b
|
HDFS-14383. Compute datanode load based on StoragePolicy. Contributed by Ayush Saxena.
|
2020-10-19 10:48:47 +05:30 |
|
Ayush Saxena
|
173310e2f5
|
HDFS-15629. Add seqno when warning slow mirror/disk in BlockReceiver. Contributed by Haibin Huang.
|
2020-10-19 10:34:17 +05:30 |
|
Ayush Saxena
|
1e3a6efcef
|
HADOOP-17288. Use shaded guava from thirdparty. (#2342). Contributed by Ayush Saxena.
|
2020-10-17 12:01:18 +05:30 |
|
Kihwal Lee
|
740a2c4635
|
HDFS-15627. Log delete audits before collecting blocks.
|
2020-10-16 11:13:41 -05:00 |
|
Siyao Meng
|
a308a1ec22
|
HDFS-15614. Initialize snapshot trash root during NameNode startup if enabled (#2370)
|
2020-10-13 10:59:42 -07:00 |
|
Uma Maheswara Rao G
|
b76b36ebbc
|
HDFS-15625: Namenode trashEmptier should not init ViewFs on startup (#2378). Contributed by Uma Maheswara Rao G.
|
2020-10-12 14:22:44 -07:00 |
|
Karthik Palanisamy
|
735e85a1d2
|
HDFS-15610 Reduced datanode upgrade/hardlink thread from 12 to 6 (#2365)
|
2020-10-08 12:51:04 +05:30 |
|
Karthik Palanisamy
|
df4006eb81
|
HDFS-15253 Default checkpoint transfer speed, 50mb per second (#2366)
|
2020-10-07 22:09:04 +05:30 |
|
bshashikant
|
16aea11c94
|
HDFS-15611. Add list Snapshot command in WebHDFS. (#2355)
|
2020-10-07 10:34:32 +05:30 |
|
Siyao Meng
|
43b0c0b054
|
HDFS-15607. Create trash dir when allowing snapshottable dir (#2352)
|
2020-10-05 05:02:00 -07:00 |
|
Ye Ni
|
00c4de63cf
|
HDFS-15594. Lazy calculate live datanodes in safe mode tip (#2332)
|
2020-09-25 09:47:54 -07:00 |
|
Aryan Gupta
|
486ddb73f9
|
HADOOP-17283. Hadoop - Upgrade to jQuery 3.5.1 (#2330)
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2020-09-24 21:15:55 +09:00 |
|
huangtianhua
|
ff59fbb8b0
|
HDFS-15025. Applying NVDIMM storage media to HDFS (#2189)
* HDFS-15025. Applying NVDIMM storage media to HDFS
Co-authored-by: YaYun-Wang <yywangyayun@163.com>
Co-authored-by: YaYun-Wang <34060507+YaYun-Wang@users.noreply.github.com>
|
2020-09-24 14:27:04 +05:30 |
|
bshashikant
|
368f2f637e
|
HDFS-15590. namenode fails to start when ordered snapshot deletion feature is disabled (#2326)
|
2020-09-24 14:00:41 +05:30 |
|
Ye Ni
|
ae089f2db7
|
HDFS-15557. Log the reason why a storage log file can't be deleted (#2274)
|
2020-09-22 13:23:20 -07:00 |
|
Ayush Saxena
|
2377df38ad
|
HDFS-15438. Setting dfs.disk.balancer.max.disk.errors = 0 will fail the block copy. Contributed by AMC-team.
|
2020-09-18 17:28:11 +05:30 |
|
S O'Donnell
|
20a0e6278d
|
HDFS-15415. Reduce locking in Datanode DirectoryScanner. Contributed by Stephen O'Donnell
|
2020-09-17 14:11:42 +01:00 |
|
bshashikant
|
425f48799c
|
HDFS-15568. namenode start failed to start when dfs.namenode.max.snapshot.limit set. (#2296)
|
2020-09-17 14:50:08 +05:30 |
|
hemanthboyina
|
f4ed9f3f91
|
HDFS-15574. Remove unnecessary sort of block list in DirectoryScanner. Contributed by Stephen O'Donnell.
|
2020-09-15 10:10:21 +05:30 |
|
He Xiaoqiao
|
924959088e
|
HDFS-15559. Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables. Contributed by Lisheng Sun.
|
2020-09-15 12:05:04 +08:00 |
|
Mingliang Liu
|
f59f7f2175
|
HDFS-15573. Only log warning if considerLoad and considerStorageType are both true. Contributed by Stephen O'Donnell
|
2020-09-12 01:41:38 -07:00 |
|
1996fanrui
|
56ebabd426
|
HADOOP-17222. Create socket address leveraging URI cache (#2241)
Contributed by fanrui.
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2020-09-10 22:30:52 -07:00 |
|
Vivek Ratnavel Subramanian
|
06793da100
|
HDFS-15531. Namenode UI: List snapshots in separate table for each snapshottable directory (#2230)
|
2020-08-27 11:36:30 -07:00 |
|
Tsz-Wo Nicholas Sze
|
41182a9b6d
|
HDFS-15500. In-order deletion of snapshots: Diff lists must be update only in the last snapshot. (#2233)
|
2020-08-27 14:54:52 +05:30 |
|
Stephen O'Donnell
|
2ffe00fc46
|
HDFS-15540. Directories protected from delete can still be moved to the trash. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2020-08-26 23:05:32 -07:00 |
|
S O'Donnell
|
6a49bf9bff
|
HDFS-14852. Removing from LowRedundancyBlocks does not remove the block from all queues. Contributed by Fei Hui.
|
2020-08-25 15:18:36 +01:00 |
|
He Xiaoqiao
|
a7830423c5
|
HDFS-15448. Remove duplicate BlockPoolManager starting when run DataNode. Contriubted by jianghua zhu.
|
2020-08-24 21:16:00 +08:00 |
|
hemanthboyina
|
83fd15b412
|
HDFS-14504. Rename with Snapshots does not honor quota limit.
|
2020-08-23 16:10:47 +05:30 |
|
Chen Liang
|
f734455e5d
|
HDFS-15290. NPE in HttpServer during NameNode startup. Contributed by Simbarashe Dzinamarira.
|
2020-08-20 15:25:10 -07:00 |
|
Uma Maheswara Rao G
|
dd013f2fdf
|
HDFS-15533: Provide DFS API compatible class, but use ViewFileSystemOverloadScheme inside. (#2229). Contributed by Uma Maheswara Rao G.
|
2020-08-19 09:30:41 -07:00 |
|
Siyao Meng
|
b65e43fe38
|
HDFS-15525. Make trash root inside each snapshottable directory for WebHDFS (#2220)
|
2020-08-18 19:28:19 +09:00 |
|
bshashikant
|
092bfe7c8e
|
HDFS-15483. Ordered snapshot deletion: Disallow rename between two snapshottable directories. (#2172)
* HDFS-15483. Ordered snapshot deletion: Disallow rename between two snapshottable directories.
* Addressed review comments.
* Rebased to latest trunk and added snapshotTrashRoot config check.
* Addressed review comments.
* Removede empty line added in SnapshotManager.Java.
* Addressed whitespace issues.
|
2020-08-17 12:56:13 +05:30 |
|
Ayush Saxena
|
e3d1966f58
|
HDFS-15439. Setting dfs.mover.retry.max.attempts to negative value will retry forever. Contributed by AMC-team.
|
2020-08-15 15:07:58 +05:30 |
|
Tsz-Wo Nicholas Sze
|
b93dd7c281
|
HDFS-15519. Check inaccessible INodes in FsImageValidation. (#2224)
|
2020-08-14 10:10:01 -07:00 |
|
bshashikant
|
15a76e8d65
|
HDFS-15524. Add edit log entry for Snapshot deletion GC thread snapshot deletion. (#2219)
|
2020-08-14 20:46:48 +05:30 |
|
Vivek Ratnavel Subramanian
|
cb50e3fcf7
|
HDFS-15496. Add UI for deleted snapshots (#2212)
|
2020-08-13 22:36:15 +05:30 |
|
Aryan Gupta
|
e592ec5f8b
|
HDFS-15518. Wrong operation name in FsNamesystem for listSnapshots. (#2217)
* HDFS-15518. Fixed String operationName = ListSnapshot.
* HDFS-15518. Changed ListSnapshot to operationName.
Co-authored-by: Aryan Gupta <aryan.gupta@cloudera.com>
|
2020-08-13 00:09:38 +05:30 |
|
S O'Donnell
|
10716040a8
|
HDFS-15493. Update block map and name cache in parallel while loading fsimage. Contributed by Chengwei Wang
|
2020-08-12 09:02:47 +01:00 |
|
Tsz-Wo Nicholas Sze
|
11cec9ab94
|
HDFS-15523. Fix findbugs warnings from HDFS-15520. (#2218)
|
2020-08-11 21:41:28 -07:00 |
|
Siyao Meng
|
3fd3aeb621
|
HDFS-15492. Make trash root inside each snapshottable directory (#2176)
|
2020-08-11 08:52:16 -07:00 |
|
Tsz-Wo Nicholas Sze
|
592127bdc2
|
HDFS-15520 Use visitor pattern to visit namespace tree (#2203)
|
2020-08-11 12:30:30 +05:30 |
|
Akira Ajisaka
|
7938ebfb9d
|
HDFS-15506. [JDK 11] Fix javadoc errors in hadoop-hdfs module. Contributed by Xieming Li.
|
2020-08-11 11:14:58 +09:00 |
|
Ayush Saxena
|
c2a17659d1
|
HDFS-15443. Setting dfs.datanode.max.transfer.threads to a very small value can cause strange failure. Contributed by AMC-team.
|
2020-08-08 14:33:53 +05:30 |
|
bshashikant
|
e072d33327
|
HDFS-15497. Make snapshot limit on global as well per snapshot root directory configurable (#2175)
|
2020-08-04 14:10:29 +05:30 |
|
hemanthboyina
|
82f3ffcd64
|
HDFS-15503. File and directory permissions are not able to be modified from WebUI.
|
2020-08-03 23:21:01 +05:30 |
|
bshashikant
|
d8a2df25ad
|
HDFS-15498. Show snapshots deletion status in snapList cmd. (#2181)
|
2020-08-02 21:59:56 +05:30 |
|
hemanthboyina
|
528a799a78
|
HDFS-15229. Truncate info should be logged at INFO level. Contributed by Ravuri Sushma sree.
|
2020-08-02 12:02:37 +05:30 |
|
Tsz-Wo Nicholas Sze
|
05b3337a46
|
HDFS-15481. Ordered snapshot deletion: garbage collect deleted snapshots (#2165)
|
2020-07-30 23:06:51 +05:30 |
|
bshashikant
|
68287371cc
|
HDFS-15488. Add a command to list all snapshots for a snaphottable root with snapshot Ids. (#2166)
|
2020-07-29 21:33:25 +05:30 |
|
touchida
|
026dce5334
|
HDFS-15465. Support WebHDFS accesses to the data stored in secure Datanode through insecure Namenode. (#2135)
|
2020-07-27 09:55:11 -07:00 |
|
bshashikant
|
2d12496643
|
HDFS-15480. Ordered snapshot deletion: record snapshot deletion in XAttr (#2163)
|
2020-07-22 16:16:27 -07:00 |
|
Masatake Iwasaki
|
1b29c9bfee
|
HADOOP-17138. Fix spotbugs warnings surfaced after upgrade to 4.0.6. (#2155)
|
2020-07-22 13:40:20 +09:00 |
|
Inigo Goiri
|
8b7695bb26
|
HDFS-15246. ArrayIndexOfboundsException in BlockManager CreateLocatedBlock. Contributed by Hemanth Boyina.
|
2020-07-21 09:00:07 -07:00 |
|
Tsz-Wo Nicholas Sze
|
d57462f2da
|
HDFS-15479. Ordered snapshot deletion: make it a configurable feature (#2156)
|
2020-07-21 11:36:24 +05:30 |
|
Chen Liang
|
3833c616e0
|
HDFS-15404. ShellCommandFencer should expose info about source. Contributed by Chen Liang.
|
2020-07-20 12:49:58 -07:00 |
|
Ayush Saxena
|
6cbd8854ee
|
HDFS-15381. Fix typos corrputBlocksFiles to corruptBlocksFiles. Contributed by bianqi.
|
2020-07-20 21:49:05 +05:30 |
|
Tsz-Wo Nicholas Sze
|
2cec50cf16
|
HDFS-15463. Add a tool to validate FsImage. (#2140)
|
2020-07-20 11:44:30 +05:30 |
|
Ahmed Hussein
|
1f71c4ae71
|
HADOOP-17099. Replace Guava Predicate with Java8+ Predicate
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
|
2020-07-15 11:39:06 -05:00 |
|
Ahmed Hussein
|
98fcffe93f
|
HADOOP-17101. Replace Guava Function with Java8+ Function
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
|
2020-07-15 09:53:18 -05:00 |
|
Shashikant Banerjee
|
85d4718ed7
|
HDFS-15319. Fix INode#isInLatestSnapshot() API. Contributed by Shashikant Banerjee.
|
2020-07-15 10:32:25 +05:30 |
|
zhaoyim
|
bdce75d737
|
HDFS-15371. Nonstandard characters exist in NameNode.java (#2032)
Contributed by zhaoyim
|
2020-07-14 14:42:12 +01:00 |
|
He Xiaoqiao
|
b97fea65e7
|
HDFS-14498 LeaseManager can loop forever on the file for which create has failed. Contributed by Stephen O'Donnell.
|
2020-07-13 14:12:48 +08:00 |
|
Xiaoyu Yao
|
f91a8ad88b
|
HADOOP-17079. Optimize UGI#getGroups by adding UGI#getGroupsSet. (#2085)
|
2020-07-09 11:33:37 -07:00 |
|
Ye Ni
|
f77bbc2123
|
HDFS-15312. Apply umask when creating directory by WebHDFS (#2096)
|
2020-07-06 19:01:46 -07:00 |
|
Shanyu Zhao
|
834372f404
|
HDFS-15451. Do not discard non-initial block report for provided storage. (#2119). Contributed by Shanyu Zhao.
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2020-07-06 23:43:34 +08:00 |
|
Uma Maheswara Rao G
|
55a2ae80dc
|
HDFS-15450. Fix NN trash emptier to work if ViewFSOveroadScheme enabled. Contributed by Uma Maheswara Rao G.
|
2020-07-04 13:45:49 -07:00 |
|
Ayush Saxena
|
f86f15cf20
|
HDFS-15446. CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path. Contributed by Stephen O'Donnell.
|
2020-07-04 13:00:43 +05:30 |
|
He Xiaoqiao
|
9ac498e300
|
HDFS-15416. Improve DataStorage#addStorageLocations() for empty locations. Contibuted by jianghua zhu.
|
2020-07-01 12:38:07 +08:00 |
|
Stephen O'Donnell
|
2a67e2b1a0
|
HDFS-15160. ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2020-06-30 07:10:17 -07:00 |
|
Akira Ajisaka
|
c71ce7ac33
|
HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
|
2020-06-28 16:02:47 +09:00 |
|
Stephen O'Donnell
|
d50e93ce7b
|
HDFS-15372. Files in snapshots no longer see attribute provider permissions. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2020-06-18 06:45:15 -07:00 |
|
Wei-Chiu Chuang
|
edf716a5c3
|
Revert "HDFS-15372. Files in snapshots no longer see attribute provider permissions. Contributed by Stephen O'Donnell."
This reverts commit 730a39d138.
|
2020-06-18 06:45:15 -07:00 |
|
S O'Donnell
|
123777823e
|
HDFS-15406. Improve the speed of Datanode Block Scan. Contributed by hemanthboyina
|
2020-06-18 12:26:22 +01:00 |
|
Stephen O'Donnell
|
730a39d138
|
HDFS-15372. Files in snapshots no longer see attribute provider permissions. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2020-06-16 15:59:13 -07:00 |
|
Takanobu Asanuma
|
f41a144077
|
HDFS-15403. NPE in FileIoProvider#transferToSocketFully. Contributed by hemanthboyina.
|
2020-06-15 09:15:53 +09:00 |
|
Inigo Goiri
|
719b53a79d
|
HDFS-15351. Blocks scheduled count was wrong on truncate. Contributed by hemanthboyina.
|
2020-06-13 09:35:05 -07:00 |
|
Vinayakumar B
|
e154084770
|
HADOOP-17046. Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes (#2026)
|
2020-06-12 23:16:33 +05:30 |
|
Ayush Saxena
|
cc671b16f7
|
HDFS-15389. DFSAdmin should close filesystem and dfsadmin -setBalancerBandwidth should work with ViewFSOverloadScheme. Contributed by Ayush Saxena
|
2020-06-05 22:19:38 -07:00 |
|
Ayush Saxena
|
2326123705
|
HDFS-15359. EC: Allow closing a file with committed blocks. Contributed by Ayush Saxena.
|
2020-06-05 19:15:05 +05:30 |
|
Toshihiro Suzuki
|
545a0a147c
|
HDFS-15386 ReplicaNotFoundException keeps happening in DN after removing multiple DN's data directories (#2052)
Contributed by Toshihiro Suzuki.
|
2020-06-05 11:11:49 +01:00 |
|