hadoop/hadoop-common-project/hadoop-common
Steve Loughran ee71318d72
HADOOP-18636 LocalDirAllocator cannot recover from directory tree deletion (#5412)
Even though DiskChecker.mkdirsWithExistsCheck() will create the directory tree,
it is only called *after* the enumeration of directories with available
space has completed.

Directories which don't exist are reported as having 0 space, therefore
the mkdirs code is never reached.

Adding a simple mkdirs() -without bothering to check the outcome-
ensures that if a dir has been deleted then it will be reconstructed
if possible. If it can't it will still have 0 bytes of space
reported and so be excluded from the allocation.

Contributed by Steve Loughran
2023-02-22 11:50:17 +00:00
..
dev-support HADOOP-18401. No ARM binaries in branch-3.3.x releases. (#4953) 2022-10-07 15:58:51 +01:00
src HADOOP-18636 LocalDirAllocator cannot recover from directory tree deletion (#5412) 2023-02-22 11:50:17 +00:00
HadoopCommon.cmake Revert "HADOOP-17196. Fix C/C++ standard warnings (#2208)" 2022-06-30 00:57:52 +00:00
HadoopJNI.cmake HDFS-13822. speedup libhdfs++ build (enable parallel build). Contributed by Allen Wittenauer and Pradeep Ambati 2018-08-17 12:25:36 -05:00
pom.xml HADOOP-18515. Backport HADOOP-17612 to branch-3.3(Upgrade Zookeeper to 3.6.3 and Curator to 5.2.0) (#5097) 2022-11-05 09:28:24 -07:00