big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

HDDS-1850. ReplicationManager should consider inflight replication and deletion while picking datanode for re-replication.

Browse Source 
Signed-off-by: Anu Engineer <aengineer@apache.org>
This commit is contained in:
Nanda kumar 2019-07-25 15:07:07 +05:30 committed by Anu Engineer
parent b41ef61ebc
commit 2b1d8aedbb
1 changed files with 7 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/ReplicationManager.java
View File

@ -483,8 +483,14 @@ private void handleUnderReplicatedContainer(final ContainerInfo container,
final int replicationFactor = container final int replicationFactor = container
.getReplicationFactor().getNumber(); .getReplicationFactor().getNumber();
final int delta = replicationFactor - getReplicaCount(id, replicas); final int delta = replicationFactor - getReplicaCount(id, replicas);
final List<DatanodeDetails> excludeList = replicas.stream()
.map(ContainerReplica::getDatanodeDetails)
.collect(Collectors.toList());
inflightReplication.get(id).stream().map(r -> r.datanode)
.forEach(excludeList::add);
final List<DatanodeDetails> selectedDatanodes = containerPlacement final List<DatanodeDetails> selectedDatanodes = containerPlacement
.chooseDatanodes(source, null, delta, container.getUsedBytes()); .chooseDatanodes(excludeList, null, delta,
container.getUsedBytes());
LOG.info("Container {} is under replicated. Expected replica count" + LOG.info("Container {} is under replicated. Expected replica count" +
" is {}, but found {}.", id, replicationFactor, " is {}, but found {}.", id, replicationFactor,