Li MingXiang
|
e17c96a40a
|
HDFS-16429. Add DataSetLockManager to manage fine-grain locks for FsDataSetImpl. (#3900). Contributed by limingxiang.
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2022-01-27 16:53:21 +08:00 |
|
litao
|
6136d630a3
|
HDFS-16427. Add debug log for BlockManager#chooseExcessRedundancyStriped (#3888)
|
2022-01-27 13:42:44 +09:00 |
|
litao
|
c2ff39006f
|
HDFS-16398. Reconfig block report parameters for datanode (#3831)
|
2022-01-26 17:24:09 +09:00 |
|
jianghuazhu
|
8c7c49d877
|
HDFS-16401.Remove the worthless DatasetVolumeChecker#numAsyncDatasetChecks. (#3838)
|
2022-01-25 21:51:17 +08:00 |
|
Bryan Beaudreault
|
94b884ae55
|
HDFS-16262. Async refresh of cached locations in DFSInputStream (#3527)
|
2022-01-25 11:42:35 +00:00 |
|
Thinker313
|
43153e80cb
|
HDFS-16428. Source path with storagePolicy cause wrong typeConsumed while rename (#3898). Contributed by lei w.
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2022-01-25 15:26:18 +08:00 |
|
daimin
|
5ef335da1e
|
HDFS-16430. Add validation to maximum blocks in EC group when adding an EC policy (#3899). Contributed by daimin.
Reviewed-by: tomscut <litao@bigo.sg>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2022-01-24 12:04:26 +05:30 |
|
litao
|
15b820c83c
|
HDFS-16402. Improve HeartbeatManager logic to avoid incorrect stats. (#3839). Contributed by tomscut.
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2022-01-24 14:26:30 +08:00 |
|
qinyuren
|
db2c3200e6
|
HDFS-16423. Balancer should not get blocks on stale storages (#3883)
Reviewed-by: litao <tomleescut@gmail.com>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2022-01-19 17:59:42 +09:00 |
|
litao
|
e355646330
|
HDFS-16399. Reconfig cache report parameters for datanode (#3841)
|
2022-01-19 15:10:39 +09:00 |
|
qinyuren
|
fcb1076699
|
HDFS-16426. Fix nextBlockReportTime when trigger full block report force (#3887)
|
2022-01-19 13:42:33 +09:00 |
|
Jackson Wang
|
d8862822d2
|
HDFS-16420. Avoid deleting unique data blocks when deleting redundancy striped blocks. (#3880)
Reviewed-by: litao <tomleescut@gmail.com>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2022-01-14 22:38:11 +09:00 |
|
litao
|
f02374df92
|
HDFS-16400. Reconfig DataXceiver parameters for datanode (#3843)
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2022-01-14 14:48:10 +09:00 |
|
Xiangyi Zhu
|
034dc8d03c
|
HDFS-16043. Add markedDeleteBlockScrubberThread to delete blocks asynchronously (#3063). Contributed by Xiangyi Zhu.
Reviewed-by: tomscut <litao@bigo.sg>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2022-01-13 12:56:19 +08:00 |
|
luoyuan3471
|
e2d620192a
|
HADOOP-18044. Hadoop - Upgrade to jQuery 3.6.0 (#3791)
Co-authored-by: luoyuan <luoyuan@shopee.com>
|
2022-01-12 11:40:32 +08:00 |
|
litao
|
46b02788bd
|
HDFS-16371. Exclude slow disks when choosing volume (#3753)
|
2022-01-06 09:31:00 +09:00 |
|
Ashutosh Gupta
|
43e5218a86
|
HDFS-16410. Insecure Xml parsing in OfflineEditsXmlLoader (#3854)
Contributed by Ashutosh Gupta
|
2022-01-05 15:51:14 +00:00 |
|
liever18
|
e1d0aa9ee5
|
HDFS-16408. Ensure LeaseRecheckIntervalMs is greater than zero (#3856)
|
2022-01-05 15:42:58 +00:00 |
|
Ashutosh Gupta
|
9eea0e28f2
|
HDFS-16409. Fix typo: testHasExeceptionsReturnsCorrectValue -> testHasExceptionsReturnsCorrectValue (#3835)
Reviewed-by: Fei Hui <feihui.ustc@gmail.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2022-01-04 13:25:16 +09:00 |
|
Symious
|
b225287913
|
HDFS-16348. Mark slownode as badnode to recover pipeline (#3704)
|
2021-12-30 00:27:11 +09:00 |
|
jianghuazhu
|
a5659fe0f7
|
HDFS-16395. Remove useless NNThroughputBenchmark#dummyActionNoSynch(). (#3823)
Reviewed-by: Fei Hui <feihui.ustc@gmail.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2021-12-24 17:24:12 +09:00 |
|
KevinWikant
|
d20b598f97
|
HDFS-16303. Improve handling of datanode lost while decommissioning (#3675)
Co-authored-by: Kevin Wikant <wikak@amazon.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2021-12-23 22:59:08 +09:00 |
|
secfree
|
cc07a5a186
|
HDFS-16392. Fix TestWebHdfsFileSystemContract#testResponseCode timeout (#3821)
|
2021-12-22 10:44:07 +08:00 |
|
Jackson Wang
|
9420cb6f8a
|
HDFS-16385. Fix Datanode retrieve slownode information bug. (#3803)
Reviewed-by: Symious <yiyang0203@gmail.com>
Reviewed-by: Hui Fei <ferhui@apache.org>
Reviewed-by: litao <tomleescut@gmail.com>
|
2021-12-21 11:04:02 +09:00 |
|
jianghuazhu
|
746b328554
|
HDFS-16386. Reduce DataNode load when FsDatasetAsyncDiskService is working. (#3806)
|
2021-12-20 11:28:55 +00:00 |
|
secfree
|
32a78e0b9e
|
HDFS-16168. Fix TestHDFSFileSystemContract.testAppend timeout (#3815)
|
2021-12-20 18:16:22 +08:00 |
|
Viraj Jasani
|
04b6b9a87b
|
HADOOP-16908. Prune Jackson 1 from the codebase and restrict it's usage for future (#3789)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2021-12-20 16:01:34 +09:00 |
|
liubingxing
|
d8dea6f52a
|
HDFS-16352. return the real datanode numBlocks in #getDatanodeStorageReport (#3714). Contributed by liubingxing.
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2021-12-17 13:31:28 +08:00 |
|
litao
|
22f5e1885d
|
HDFS-16377. Should CheckNotNull before access FsDatasetSpi (#3784)
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2021-12-16 13:49:50 +09:00 |
|
litao
|
10cdde59b4
|
HDFS-16375. The FBR lease ID should be exposed to the log (#3769)
|
2021-12-16 13:29:32 +09:00 |
|
litao
|
59c650802d
|
HDFS-16378. Add datanode address to BlockReportLeaseManager logs (#3786). Contributed by tomscut.
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2021-12-15 11:16:32 +08:00 |
|
Ayush Saxena
|
d29f0e83a9
|
HDFS-16373. Fix MiniDFSCluster restart in case of multiple namenodes. (#3756)
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: litao <tomleescut@gmail.com>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2021-12-14 17:21:51 +09:00 |
|
litao
|
c56a07f36b
|
HDFS-16327. Make DFS_NAMENODE_MAX_SLOWPEER_COLLECT_NODES_KEY reconfigurable (#3716)
|
2021-12-14 11:19:06 +09:00 |
|
Akira Ajisaka
|
9b9e2ef87f
|
HADOOP-18040. Use maven.test.failure.ignore instead of ignoreTestFailure (#3774)
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
|
2021-12-10 01:36:31 +09:00 |
|
qinyuren
|
35556ea043
|
HDFS-16333. fix balancer bug when transfer an EC block (#3679)
|
2021-12-09 13:24:09 +09:00 |
|
PHILO-HE
|
1364847fdd
|
HDFS-15788. Correct the statement for pmem cache to reflect cache persistence support (#3761)
|
2021-12-08 17:52:40 +05:30 |
|
GuoPhilipse
|
00d483d6de
|
HDFS-16324. Fix error log in BlockManagerSafeMode (#3661)
Reviewed-by: tomscut <litao@bigo.sg>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2021-12-08 21:21:48 +09:00 |
|
GuoPhilipse
|
25849ff7b7
|
HDFS-16345. Fix test case fail in TestBlockStoragePolicy (#3696). Contributed by guophilipse.
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2021-12-08 16:34:54 +05:30 |
|
Masatake Iwasaki
|
e9526042a2
|
HDFS-16354. Add description of GETSNAPSHOTDIFFLISTING to WebHDFS doc. (#3740)
|
2021-12-07 21:39:04 +09:00 |
|
GuoPhilipse
|
80cccc5376
|
HDFS-16351. Add path exception information in FSNamesystem (#3713). Contributed by guophilipse.
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2021-12-07 14:19:27 +05:30 |
|
GuoPhilipse
|
1509ea5de2
|
HDFS-16338. Correct fsimage error configuration message (#3684). Contributed by guophilipse.
Reviewed-by: cxorm <lianp964@gmail.com>
Reviewed-by: tomscut <litao@bigo.sg>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2021-12-06 14:00:50 +05:30 |
|
Takanobu Asanuma
|
e8e69de106
|
HDFS-16293. Client sleeps and holds 'dataQueue' when DataNodes are congested. Contributed by Yuanxin Zhu.
|
2021-12-06 10:44:36 +09:00 |
|
litao
|
c2afb6a00b
|
HDFS-16370. Fix assert message for BlockInfo (#3747). Contributed by tomscut.
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2021-12-04 22:54:44 +05:30 |
|
huhaiyang
|
c0f405a46b
|
HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable (#3664)
Reviewed-by: Fei Hui <feihui.ustc@gmail.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2021-12-04 02:19:36 +09:00 |
|
bitterfox
|
dd6b987c93
|
HDFS-16332. Handle invalid token exception in sasl handshake (#3677)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2021-12-03 23:30:13 +09:00 |
|
wangzhaohui
|
0cb6c28d19
|
HDFS-16364. Remove unnecessary brackets in NameNodeRpcServer#L453 (#3742)
|
2021-12-03 16:51:04 +05:30 |
|
litao
|
52ec65fd10
|
HDFS-16331. Make dfs.blockreport.intervalMsec reconfigurable (#3676)
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2021-12-03 14:12:05 +09:00 |
|
litao
|
1ebdac2cd6
|
HDFS-16361. Fix log format for QueryCommand (#3732). Contributed by tomscut.
|
2021-12-01 12:48:21 +05:30 |
|
litao
|
829af89dc4
|
HDFS-16344. Improve DirectoryScanner.Stats#toString (#3695)
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Reviewed-by: Hui Fei <ferhui@apache.org>
|
2021-11-29 17:48:10 +09:00 |
|
litao
|
86705eda82
|
HDFS-16339. Show the threshold when mover threads quota is exceeded (#3689)
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Hui Fei <ferhui@apache.org>
|
2021-11-26 19:52:14 +09:00 |
|