Ashutosh Gupta
|
ae47846a5b
|
HADOOP-16515. Update the link to compatibility guide (#4226)
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2022-05-08 07:38:32 +09:00 |
|
daimin
|
29401c8203
|
HDFS-16520. Improve EC pread: avoid potential reading whole block (#4104)
Reviewed-by: Hui Fei <ferhui@apache.org>
Reviewed-by: Takanobu Asanuma <tasanuma@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2022-05-07 01:30:32 +08:00 |
|
Murali Krishna
|
9807dfd25c
|
HDFS-16562. Upgrade moment.min.js to 2.29.2 (#4240)
|
2022-05-03 17:42:45 +05:30 |
|
Viraj Jasani
|
2dfa928a20
|
HDFS-16521. DFS API to retrieve slow datanodes (#4107)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2022-05-03 05:05:40 +08:00 |
|
smarthan
|
7bd7725532
|
HDFS-16553. Fix checkstyle for the length of BlockManager construction method over limit. (#4211). Contributed by Chengwei Wang.
|
2022-04-29 22:59:23 +08:00 |
|
Viraj Jasani
|
b9ade7a4cd
|
HDFS-16528. Reconfigure slow peer enable for Namenode (#4186)
|
2022-04-29 17:00:17 +08:00 |
|
stack
|
9ed8d60511
|
HDFS-16540. Data locality is lost when DataNode pod restarts in kubernetes (#4170)
This reverts the previous commit 4e47eb66d1
undone so I could reapply with the '.' after the HDFS-16540 as is done
in all other commits.
|
2022-04-28 10:28:01 -07:00 |
|
stack
|
4e47eb66d1
|
Revert "HDFS-16540 Data locality is lost when DataNode pod restarts in kubernetes (#4170)"
Revert to add the '.' after HDFS-16540 so commit message format matches
precedent
This reverts commit bda0881bf9.
|
2022-04-28 10:26:46 -07:00 |
|
huaxiangsun
|
bda0881bf9
|
HDFS-16540 Data locality is lost when DataNode pod restarts in kubernetes (#4170)
When DN with the same UUID is registered with a different IP, host2DatanodeMap needs to be updated accordingly.
|
2022-04-28 10:24:37 -07:00 |
|
smarthan
|
f187e9bcd5
|
HDFS-16554. Remove unused configuration dfs.namenode.block.deletion.increment. (#4213). Contributed by Chengwei Wang.
|
2022-04-27 11:44:38 +08:00 |
|
litao
|
f1e5f8e764
|
HDFS-16488. [SPS]: Expose metrics to JMX for external SPS (#4234)
|
2022-04-26 11:48:06 +08:00 |
|
Hui Fei
|
17d64ba495
|
Revert "HDFS-16488. [SPS]: Expose metrics to JMX for external SPS (#4035)" (#4232)
|
2022-04-24 17:18:31 +08:00 |
|
litao
|
acc0e0a210
|
HDFS-16488. [SPS]: Expose metrics to JMX for external SPS (#4035)
|
2022-04-24 14:54:41 +08:00 |
|
daimin
|
aebd55f788
|
HDFS-16519. Add throttler to EC reconstruction (#4101)
Reviewed-by: litao <tomleescut@gmail.com>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2022-04-23 12:45:22 +09:00 |
|
litao
|
5ebbacc480
|
HDFS-16552. Fix NPE for TestBlockManager (#4210)
|
2022-04-23 12:14:06 +09:00 |
|
smarthan
|
bf4730b4d6
|
HDFS-16500. Make asynchronous blocks deletion lock and unlock durtion threshold configurable. (#4061). Contributed by Chengwei Wang.
|
2022-04-21 12:32:12 +08:00 |
|
S O'Donnell
|
a4683be65e
|
Revert "HDFS-16531. Avoid setReplication writing an edit record if old replication equals the new value (#4148). Contributed by Stephen O'Donnell."
This reverts commit dbeeee0363.
|
2022-04-20 20:34:43 +01:00 |
|
qinyuren
|
76bbd17374
|
HDFS-16544. EC decoding failed due to invalid buffer (#4179)
|
2022-04-20 15:04:27 +09:00 |
|
qinyuren
|
52e152f8b0
|
HDFS-16538. EC decoding failed due to not enough valid inputs (#4167)
Co-authored-by: liubingxing <liubingxing@bigo.sg>
|
2022-04-19 13:37:28 +09:00 |
|
Happy-shi
|
f74f241636
|
HDFS-16541. Fix a typo in NameNodeLayoutVersion (#4176)
|
2022-04-18 22:53:57 +05:30 |
|
jianghuazhu
|
900682e712
|
HDFS-16389.Improve NNThroughputBenchmark test mkdirs. (#3819)
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2022-04-18 11:21:51 +08:00 |
|
Quanlong Huang
|
35d4c02bcc
|
HDFS-16535. SlotReleaser should reuse the domain socket based on socket paths (#4158)
Reviewed-by: Lisheng Sun <sunlisheng@apache.org>
|
2022-04-18 10:32:29 +08:00 |
|
Stephen O'Donnell
|
dbeeee0363
|
HDFS-16531. Avoid setReplication writing an edit record if old replication equals the new value (#4148). Contributed by Stephen O'Donnell.
|
2022-04-17 20:05:11 +08:00 |
|
He Xiaoqiao
|
cb975c3df6
|
HDFS-16534. Split FsDatasetImpl from block pool locks to volume grain locks. (#4141) Contributed by limingxiang.
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2022-04-17 19:21:27 +08:00 |
|
Renukaprasad C
|
f14f305051
|
HDFS-16526. Add metrics for slow DataNode (#4162)
|
2022-04-15 21:37:05 +05:30 |
|
caozhiqiang
|
cee8c62498
|
HDFS-16456. EC: Decommission a rack with only on dn will fail when the rack number is equal with replication (#4126)
|
2022-04-14 18:42:39 +09:00 |
|
daimin
|
c65c383b7e
|
HDFS-16509. Fix decommission UnsupportedOperationException (#4077). Contributed by daimin.
|
2022-04-14 11:07:06 +08:00 |
|
Takanobu Asanuma
|
2efab92959
|
HDFS-16479. EC: NameNode should not send a reconstruction work when the source datanodes are insufficient (#4138)
|
2022-04-14 11:23:38 +09:00 |
|
qinyuren
|
45394433a1
|
HDFS-16484. [SPS]: Fix an infinite loop bug in SPSPathIdProcessor thread (#4032)
|
2022-04-13 11:27:37 +09:00 |
|
Takanobu Asanuma
|
37650ced81
|
HDFS-16497. EC: Add param comment for liveBusyBlockIndices with HDFS-14768. Contributed by caozhiqiang.
|
2022-04-08 18:38:40 +09:00 |
|
litao
|
5412fbf6d4
|
HDFS-16460. [SPS]: Handle failure retries for moving tasks (#4001)
|
2022-04-08 12:26:39 +08:00 |
|
singer-bin
|
807a428b55
|
HDFS-16457.Make fs.getspaceused.classname reconfigurable (#4069)
|
2022-04-08 10:27:35 +09:00 |
|
Viraj Jasani
|
f70935522b
|
HADOOP-18188. Support touch command for directory (#4135)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2022-04-07 17:29:45 +09:00 |
|
Viraj Jasani
|
7c20602b17
|
HDFS-16522. Set Http and Ipc ports for Datanodes in MiniDFSCluster (#4108)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2022-04-06 18:17:02 +09:00 |
|
wangzhaohui
|
61bbdfd3a7
|
HDFS-16529. Remove unnecessary setObserverRead in TestConsistentReadsObserver (#4131)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2022-04-06 17:29:43 +09:00 |
|
Stephen O'Donnell
|
bbfe3500cf
|
HDFS-16530. setReplication debug log creates a new string even if debug is disabled (#4142)
|
2022-04-06 08:49:52 +01:00 |
|
litao
|
34b3275bf4
|
HDFS-16477. [SPS]: Add metric PendingSPSPaths for getting the number of paths to be processed by SPS (#4009). Contributed by tomscut.
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2022-04-03 01:36:03 +05:30 |
|
Xing Lin
|
15a5ea2c95
|
HADOOP-18169. getDelegationTokens in ViewFs should also fetch the token from fallback FS (#4094)
HADOOP-18169. getDelegationTokens in ViewFs should also fetch the token from the fallback FS
|
2022-03-31 21:59:09 +00:00 |
|
litao
|
9a4dddd640
|
HDFS-16507. [SBN read] Avoid purging edit log which is in progress (#4082)
|
2022-03-30 23:01:48 -07:00 |
|
He Xiaoqiao
|
2bf78e2416
|
HDFS-16511. Improve lock type for ReplicaMap under fine-grain lock mode. (#4085). Contributed by limingxiang.
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2022-03-31 14:00:38 +08:00 |
|
litao
|
ac50657c37
|
HDFS-16413. Reconfig dfs usage parameters for datanode (#3863)
|
2022-03-31 00:51:17 +09:00 |
|
He Xiaoqiao
|
6eea28c3f3
|
HDFS-16498. Fix NPE for checkBlockReportLease #4057. Contributed by tomscut.
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2022-03-30 14:56:04 +08:00 |
|
Lei Yang
|
a9b43966c0
|
HDFS-16518: Add shutdownhook to invalidate the KeyProviders in the cache
Fixes #4100
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
|
2022-03-28 13:15:28 -07:00 |
|
Masatake Iwasaki
|
0fbd96a244
|
Make upstream aware of 3.2.3 release.
|
2022-03-28 08:07:50 +00:00 |
|
GuoPhilipse
|
046a6204b4
|
HDFS-16355. Improve the description of dfs.block.scanner.volume.bytes.per.second (#3724)
Co-authored-by: gf13871 <gf13871@ly.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2022-03-27 22:23:48 +09:00 |
|
litao
|
565e848d88
|
HDFS-16434. Add opname to read/write lock for remaining operations (#3915)
|
2022-03-25 20:19:01 +09:00 |
|
qinyuren
|
45ce1cce50
|
HDFS-16501. Print the exception when reporting a bad block (#4062)
Reviewed-by: tomscut <litao@bigo.sg>
|
2022-03-23 15:03:17 +09:00 |
|
He Xiaoqiao
|
ef8bff0df9
|
HDFS-15987. Improve oiv tool to parse fsimage file in parallel with delimited format. (#2918). Contributed by Hongbing Wang.
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2022-03-23 11:32:12 +08:00 |
|
He Xiaoqiao
|
26ba3846cc
|
Revert "HDFS-14617. Improve oiv tool to parse fsimage file in parallel with delimited format. (#2918). Contributed by Hongbing Wang."
This reverts commit 88975496d8.
|
2022-03-23 11:01:35 +08:00 |
|
He Xiaoqiao
|
88975496d8
|
HDFS-14617. Improve oiv tool to parse fsimage file in parallel with delimited format. (#2918). Contributed by Hongbing Wang.
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2022-03-22 22:28:09 +08:00 |
|