big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

HDFS-16341. Fix BlockPlacementPolicy details in hdfs defaults. (#3691). Contributed by guophilipse.

Browse Source 
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
This commit is contained in:
GuoPhilipse 2022-09-21 01:46:24 +08:00 committed by GitHub
parent 2950c5405b
commit 40ab9c8ba7
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 6 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
View File

@ -4277,14 +4277,18 @@
<value>org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicyDefault</value> <value>org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicyDefault</value>
<description> <description>
Class representing block placement policy for non-striped files. Class representing block placement policy for non-striped files.
There are four block placement policies currently being supported: There are six block placement policies currently being supported:
BlockPlacementPolicyDefault, BlockPlacementPolicyWithNodeGroup, BlockPlacementPolicyDefault, BlockPlacementPolicyWithNodeGroup,
BlockPlacementPolicyRackFaultTolerant and BlockPlacementPolicyWithUpgradeDomain. BlockPlacementPolicyRackFaultTolerant, BlockPlacementPolicyWithUpgradeDomain,
AvailableSpaceBlockPlacementPolicy and AvailableSpaceRackFaultTolerantBlockPlacementPolicy.
BlockPlacementPolicyDefault chooses the desired number of targets BlockPlacementPolicyDefault chooses the desired number of targets
for placing block replicas in a default way. BlockPlacementPolicyWithNodeGroup for placing block replicas in a default way. BlockPlacementPolicyWithNodeGroup
places block replicas on environment with node-group layer. BlockPlacementPolicyRackFaultTolerant places block replicas on environment with node-group layer. BlockPlacementPolicyRackFaultTolerant
places the replicas to more racks. places the replicas to more racks.
BlockPlacementPolicyWithUpgradeDomain places block replicas that honors upgrade domain policy. BlockPlacementPolicyWithUpgradeDomain places block replicas that honors upgrade domain policy.
AvailableSpaceBlockPlacementPolicy places block replicas based on space balanced policy.
AvailableSpaceRackFaultTolerantBlockPlacementPolicy places block replicas based on
space balanced rack fault tolerant policy.
The details of placing replicas are documented in the javadoc of the corresponding policy classes. The details of placing replicas are documented in the javadoc of the corresponding policy classes.
The default policy is BlockPlacementPolicyDefault, and the corresponding class is The default policy is BlockPlacementPolicyDefault, and the corresponding class is
org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicyDefault. org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicyDefault.