Chentao Yu
|
19d90e62fb
|
HADOOP-18109. Ensure that default permissions of directories under internal ViewFS directories are the same as directories on target filesystems. Contributed by Chentao Yu. (3953)
|
2022-02-15 15:58:24 -08:00 |
|
litao
|
0c194f2157
|
HDFS-16396. Reconfig slow peer parameters for datanode (#3827)
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
|
2022-02-15 13:40:46 +09:00 |
|
secfree
|
bf0cefb0d8
|
HDFS-16406. ReadsFromLocalClient counts short-circuit reads (#3847)
|
2022-02-09 10:07:05 +08:00 |
|
singer-bin
|
125e3b6160
|
HDFS-16437 ReverseXML processor doesn't accept XML files without the … (#3926)
|
2022-02-06 13:05:57 +08:00 |
|
litao
|
bd50b9117e
|
HDFS-16444. Show start time of JournalNode on Web (#3943)
|
2022-01-30 16:13:58 +08:00 |
|
secfree
|
39cad5f28f
|
HDFS-16169. Fix TestBlockTokenWithDFSStriped#testEnd2End failure (#3850)
Reviewed-by: Fei Hui <feihui.ustc@gmail.com>
Reviewed-by: litao <tomleescut@gmail.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2022-01-28 17:04:11 +09:00 |
|
Li MingXiang
|
e17c96a40a
|
HDFS-16429. Add DataSetLockManager to manage fine-grain locks for FsDataSetImpl. (#3900). Contributed by limingxiang.
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2022-01-27 16:53:21 +08:00 |
|
litao
|
c2ff39006f
|
HDFS-16398. Reconfig block report parameters for datanode (#3831)
|
2022-01-26 17:24:09 +09:00 |
|
Bryan Beaudreault
|
94b884ae55
|
HDFS-16262. Async refresh of cached locations in DFSInputStream (#3527)
|
2022-01-25 11:42:35 +00:00 |
|
Thinker313
|
43153e80cb
|
HDFS-16428. Source path with storagePolicy cause wrong typeConsumed while rename (#3898). Contributed by lei w.
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2022-01-25 15:26:18 +08:00 |
|
daimin
|
5ef335da1e
|
HDFS-16430. Add validation to maximum blocks in EC group when adding an EC policy (#3899). Contributed by daimin.
Reviewed-by: tomscut <litao@bigo.sg>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2022-01-24 12:04:26 +05:30 |
|
litao
|
15b820c83c
|
HDFS-16402. Improve HeartbeatManager logic to avoid incorrect stats. (#3839). Contributed by tomscut.
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2022-01-24 14:26:30 +08:00 |
|
qinyuren
|
db2c3200e6
|
HDFS-16423. Balancer should not get blocks on stale storages (#3883)
Reviewed-by: litao <tomleescut@gmail.com>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2022-01-19 17:59:42 +09:00 |
|
litao
|
e355646330
|
HDFS-16399. Reconfig cache report parameters for datanode (#3841)
|
2022-01-19 15:10:39 +09:00 |
|
qinyuren
|
fcb1076699
|
HDFS-16426. Fix nextBlockReportTime when trigger full block report force (#3887)
|
2022-01-19 13:42:33 +09:00 |
|
Jackson Wang
|
d8862822d2
|
HDFS-16420. Avoid deleting unique data blocks when deleting redundancy striped blocks. (#3880)
Reviewed-by: litao <tomleescut@gmail.com>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2022-01-14 22:38:11 +09:00 |
|
litao
|
f02374df92
|
HDFS-16400. Reconfig DataXceiver parameters for datanode (#3843)
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2022-01-14 14:48:10 +09:00 |
|
Xiangyi Zhu
|
034dc8d03c
|
HDFS-16043. Add markedDeleteBlockScrubberThread to delete blocks asynchronously (#3063). Contributed by Xiangyi Zhu.
Reviewed-by: tomscut <litao@bigo.sg>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2022-01-13 12:56:19 +08:00 |
|
litao
|
46b02788bd
|
HDFS-16371. Exclude slow disks when choosing volume (#3753)
|
2022-01-06 09:31:00 +09:00 |
|
Ashutosh Gupta
|
9eea0e28f2
|
HDFS-16409. Fix typo: testHasExeceptionsReturnsCorrectValue -> testHasExceptionsReturnsCorrectValue (#3835)
Reviewed-by: Fei Hui <feihui.ustc@gmail.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2022-01-04 13:25:16 +09:00 |
|
Symious
|
b225287913
|
HDFS-16348. Mark slownode as badnode to recover pipeline (#3704)
|
2021-12-30 00:27:11 +09:00 |
|
jianghuazhu
|
a5659fe0f7
|
HDFS-16395. Remove useless NNThroughputBenchmark#dummyActionNoSynch(). (#3823)
Reviewed-by: Fei Hui <feihui.ustc@gmail.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2021-12-24 17:24:12 +09:00 |
|
KevinWikant
|
d20b598f97
|
HDFS-16303. Improve handling of datanode lost while decommissioning (#3675)
Co-authored-by: Kevin Wikant <wikak@amazon.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2021-12-23 22:59:08 +09:00 |
|
secfree
|
cc07a5a186
|
HDFS-16392. Fix TestWebHdfsFileSystemContract#testResponseCode timeout (#3821)
|
2021-12-22 10:44:07 +08:00 |
|
secfree
|
32a78e0b9e
|
HDFS-16168. Fix TestHDFSFileSystemContract.testAppend timeout (#3815)
|
2021-12-20 18:16:22 +08:00 |
|
liubingxing
|
d8dea6f52a
|
HDFS-16352. return the real datanode numBlocks in #getDatanodeStorageReport (#3714). Contributed by liubingxing.
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2021-12-17 13:31:28 +08:00 |
|
Ayush Saxena
|
d29f0e83a9
|
HDFS-16373. Fix MiniDFSCluster restart in case of multiple namenodes. (#3756)
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: litao <tomleescut@gmail.com>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2021-12-14 17:21:51 +09:00 |
|
litao
|
c56a07f36b
|
HDFS-16327. Make DFS_NAMENODE_MAX_SLOWPEER_COLLECT_NODES_KEY reconfigurable (#3716)
|
2021-12-14 11:19:06 +09:00 |
|
qinyuren
|
35556ea043
|
HDFS-16333. fix balancer bug when transfer an EC block (#3679)
|
2021-12-09 13:24:09 +09:00 |
|
GuoPhilipse
|
00d483d6de
|
HDFS-16324. Fix error log in BlockManagerSafeMode (#3661)
Reviewed-by: tomscut <litao@bigo.sg>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2021-12-08 21:21:48 +09:00 |
|
GuoPhilipse
|
25849ff7b7
|
HDFS-16345. Fix test case fail in TestBlockStoragePolicy (#3696). Contributed by guophilipse.
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2021-12-08 16:34:54 +05:30 |
|
GuoPhilipse
|
80cccc5376
|
HDFS-16351. Add path exception information in FSNamesystem (#3713). Contributed by guophilipse.
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2021-12-07 14:19:27 +05:30 |
|
GuoPhilipse
|
1509ea5de2
|
HDFS-16338. Correct fsimage error configuration message (#3684). Contributed by guophilipse.
Reviewed-by: cxorm <lianp964@gmail.com>
Reviewed-by: tomscut <litao@bigo.sg>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2021-12-06 14:00:50 +05:30 |
|
Takanobu Asanuma
|
e8e69de106
|
HDFS-16293. Client sleeps and holds 'dataQueue' when DataNodes are congested. Contributed by Yuanxin Zhu.
|
2021-12-06 10:44:36 +09:00 |
|
huhaiyang
|
c0f405a46b
|
HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable (#3664)
Reviewed-by: Fei Hui <feihui.ustc@gmail.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2021-12-04 02:19:36 +09:00 |
|
bitterfox
|
dd6b987c93
|
HDFS-16332. Handle invalid token exception in sasl handshake (#3677)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2021-12-03 23:30:13 +09:00 |
|
litao
|
52ec65fd10
|
HDFS-16331. Make dfs.blockreport.intervalMsec reconfigurable (#3676)
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2021-12-03 14:12:05 +09:00 |
|
Takanobu Asanuma
|
9c887e5b82
|
HADOOP-18014. CallerContext should not include some characters. (#3698)
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
Reviewed-by: Hui Fei <ferhui@apache.org>
|
2021-11-25 14:05:04 +09:00 |
|
Viraj Jasani
|
cdc13e91b6
|
HDFS-16350. Datanode start time should be set after RPC server starts successfully (#3711)
|
2021-11-25 10:23:04 +08:00 |
|
huhaiyang
|
99b161dec7
|
HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson (#3708)
|
2021-11-25 10:20:42 +08:00 |
|
Viraj Jasani
|
e8566b3812
|
HDFS-16336. De-flake TestRollingUpgrade#testRollback (#3686)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2021-11-24 22:54:11 +09:00 |
|
litao
|
0ed817babb
|
HDFS-16337. Show start time of Datanode on Web (#3682)
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
|
2021-11-23 10:18:30 +08:00 |
|
Symious
|
c88640c4ad
|
HDFS-16320. Datanode retrieve slownode information from NameNode (#3654)
|
2021-11-22 18:04:32 +08:00 |
|
Hui Fei
|
8e9ad2d7af
|
Revert "HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson (#3630)" (#3697)
|
2021-11-22 10:05:21 +08:00 |
|
huhaiyang
|
91af256a5b
|
HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson (#3630)
|
2021-11-17 22:41:06 +08:00 |
|
Neil
|
5626734a36
|
HDFS-16182.numOfReplicas is given the wrong value in BlockPlacementPolicyDefault$chooseTarget can cause DataStreamer to fail with Heterogeneous Storage. (#3320)
|
2021-11-16 18:21:50 +08:00 |
|
litao
|
c9f95b01ef
|
HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode (#3643)
Reviewed-by: Hui Fei <ferhui@apache.org>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
|
2021-11-16 11:19:14 +09:00 |
|
GuoPhilipse
|
6e6f2e4baa
|
HDFS-16321. Fix invalid config in TestAvailableSpaceRackFaultTolerantBPP (#3655). Contributed by guo.
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2021-11-14 19:59:15 +05:30 |
|
huhaiyang
|
db89a9411e
|
HDFS-16287. Support to make dfs.namenode.avoid.read.slow.datanode reconfigurable (#3596)
|
2021-11-12 10:07:34 +08:00 |
|
jianghuazhu
|
b307f18a58
|
HDFS-16301. Improve BenchmarkThroughput#SIZE naming standardization. (#3622)
|
2021-11-10 11:32:52 +09:00 |
|