big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

HDFS-14821. Make HDFS-14617 (fsimage sub-sections) off by default. Contributed by Stephen O'Donnell.

Browse Source 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
This commit is contained in:
Stephen O'Donnell 2019-09-13 10:35:10 -07:00 committed by Wei-Chiu Chuang
parent 4239007349
commit 06ad6540b3
2 changed files with 7 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
View File

@ -899,7 +899,7 @@ public class DFSConfigKeys extends CommonConfigurationKeys {
public static final String DFS_IMAGE_PARALLEL_LOAD_KEY = public static final String DFS_IMAGE_PARALLEL_LOAD_KEY =
"dfs.image.parallel.load"; "dfs.image.parallel.load";
public static final boolean DFS_IMAGE_PARALLEL_LOAD_DEFAULT = true; public static final boolean DFS_IMAGE_PARALLEL_LOAD_DEFAULT = false;
public static final String DFS_IMAGE_PARALLEL_TARGET_SECTIONS_KEY = public static final String DFS_IMAGE_PARALLEL_TARGET_SECTIONS_KEY =
"dfs.image.parallel.target.sections"; "dfs.image.parallel.target.sections";

7
hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
View File

@ -1393,7 +1393,7 @@
<property> <property>
<name>dfs.image.parallel.load</name> <name>dfs.image.parallel.load</name>
<value>true</value> <value>false</value>
<description> <description>
If true, write sub-section entries to the fsimage index so it can If true, write sub-section entries to the fsimage index so it can
be loaded in parallel. Also controls whether parallel loading be loaded in parallel. Also controls whether parallel loading
@ -1403,6 +1403,11 @@
Parallel loading is not compatible with image compression, Parallel loading is not compatible with image compression,
so if dfs.image.compress is set to true this setting will be so if dfs.image.compress is set to true this setting will be
ignored and no parallel loading will occur. ignored and no parallel loading will occur.
Enabling this feature may impact rolling upgrades and downgrades if
the previous version does not support this feature. If the feature was
enabled and a downgrade is required, first set this parameter to
false and then save the namespace to create a fsimage with no
sub-sections and then perform the downgrade.
</description> </description>
</property> </property>