big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

HDFS-17359. EC: recheck failed streamers should only after flushing all packets. (#6503). Contributed by farmmamba.

Browse Source 
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
This commit is contained in:
hfutatzhanghb 2024-02-01 22:53:37 +08:00 committed by GitHub
parent 2f1718c363
commit 4f4b846986
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSStripedOutputStream.java
View File

@ -671,9 +671,9 @@ private void checkStreamerFailures(boolean isNeedFlushAllPackets)
// for healthy streamers, wait till all of them have fetched the new block // for healthy streamers, wait till all of them have fetched the new block
// and flushed out all the enqueued packets. // and flushed out all the enqueued packets.
flushAllInternals(); flushAllInternals();
// recheck failed streamers again after the flush
newFailed = checkStreamers();
} }
// recheck failed streamers again after the flush
newFailed = checkStreamers();
while (newFailed.size() > 0) { while (newFailed.size() > 0) {
failedStreamers.addAll(newFailed); failedStreamers.addAll(newFailed);
coordinator.clearFailureStates(); coordinator.clearFailureStates();