big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

HADOOP-15163. Fix S3ACommitter documentation

Browse Source 
Contributed by Alessandro Andrioni.

(cherry picked from commit 100e8a1ae1d930dde084af7d1281e491c7f124ec)
This commit is contained in:
Steve Loughran 2018-01-10 15:37:07 +00:00
parent afd8caba27
commit 1a09da7400
1 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/committers.md
View File

@ -402,11 +402,11 @@ directories listed in `fs.s3a.buffer.dir`.
The staging commmitter needs a path in the cluster filesystem The staging commmitter needs a path in the cluster filesystem
(e.g. HDFS). This must be declared in `fs.s3a.committer.tmp.path`. (e.g. HDFS). This must be declared in `fs.s3a.committer.staging.tmp.path`.
Temporary files are saved in HDFS (or other cluster filesystem) under the path Temporary files are saved in HDFS (or other cluster filesystem) under the path
`${fs.s3a.committer.tmp.path}/${user}` where `user` is the name of the user running the job. `${fs.s3a.committer.staging.tmp.path}/${user}` where `user` is the name of the user running the job.
The default value of `fs.s3a.committer.tmp.path` is `tmp/staging`, The default value of `fs.s3a.committer.staging.tmp.path` is `tmp/staging`,
Which will be converted at run time to a path under the current user's home directory, Which will be converted at run time to a path under the current user's home directory,
essentially `~/tmp/staging` essentially `~/tmp/staging`
so the temporary directory so the temporary directory