big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

HADOOP-18532. Update command usage in FileSystemShell.md (#5141)

Browse Source 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
This commit is contained in:
GuoPhilipse 2022-11-21 14:55:46 +08:00 committed by GitHub
parent 696d042054
commit 069bd973d8
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 10 additions and 7 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

17
hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md
View File

@ -59,7 +59,7 @@ Copies source paths to stdout.
Options Options
* The `-ignoreCrc` option disables checkshum verification. * The `-ignoreCrc` option disables checksum verification.
Example: Example:
@ -73,18 +73,19 @@ Returns 0 on success and -1 on error.
checksum checksum
-------- --------
Usage: `hadoop fs -checksum [-v] URI` Usage: `hadoop fs -checksum [-v] URI [URI ...]`
Returns the checksum information of a file. Returns the checksum information of the file(s).
Options Options
* The `-v` option displays blocks size for the file. * The `-v` option displays blocks size for the file(s).
Example: Example:
* `hadoop fs -checksum hdfs://nn1.example.com/file1` * `hadoop fs -checksum hdfs://nn1.example.com/file1`
* `hadoop fs -checksum file:///etc/hosts` * `hadoop fs -checksum file:///etc/hosts`
* `hadoop fs -checksum file:///etc/hosts hdfs://nn1.example.com/file1`
chgrp chgrp
----- -----
@ -177,7 +178,7 @@ Returns 0 on success and -1 on error.
cp cp
---- ----
Usage: `hadoop fs -cp [-f] [-p | -p[topax]] [-t <thread count>] [-q <thread pool queue size>] URI [URI ...] <dest>` Usage: `hadoop fs -cp [-f] [-p | -p[topax]] [-d] [-t <thread count>] [-q <thread pool queue size>] URI [URI ...] <dest>`
Copy files from source to destination. This command allows multiple sources as well in which case the destination must be a directory. Copy files from source to destination. This command allows multiple sources as well in which case the destination must be a directory.
@ -187,13 +188,14 @@ Options:
* `-f` : Overwrite the destination if it already exists. * `-f` : Overwrite the destination if it already exists.
* `-d` : Skip creation of temporary file with the suffix `._COPYING_`. * `-d` : Skip creation of temporary file with the suffix `._COPYING_`.
* `-p` : Preserve file attributes [topx] (timestamps, ownership, permission, ACL, XAttr). If -p is specified with no *arg*, then preserves timestamps, ownership, permission. If -pa is specified, then preserves permission also because ACL is a super-set of permission. Determination of whether raw namespace extended attributes are preserved is independent of the -p flag. * `-p` : Preserve file attributes [topax] (timestamps, ownership, permission, ACL, XAttr). If -p is specified with no *arg*, then preserves timestamps, ownership, permission. If -pa is specified, then preserves permission also because ACL is a super-set of permission. Determination of whether raw namespace extended attributes are preserved is independent of the -p flag.
* `-t <thread count>` : Number of threads to be used, default is 1. Useful when copying directories containing more than 1 file. * `-t <thread count>` : Number of threads to be used, default is 1. Useful when copying directories containing more than 1 file.
* `-q <thread pool queue size>` : Thread pool queue size to be used, default is 1024. It takes effect only when thread count greater than 1. * `-q <thread pool queue size>` : Thread pool queue size to be used, default is 1024. It takes effect only when thread count greater than 1.
Example: Example:
* `hadoop fs -cp /user/hadoop/file1 /user/hadoop/file2` * `hadoop fs -cp /user/hadoop/file1 /user/hadoop/file2`
* `hadoop fs -cp -f -d /user/hadoop/file1 /user/hadoop/file2`
* `hadoop fs -cp /user/hadoop/file1 /user/hadoop/file2 /user/hadoop/dir` * `hadoop fs -cp /user/hadoop/file1 /user/hadoop/file2 /user/hadoop/dir`
* `hadoop fs -cp -t 5 /user/hadoop/file1 /user/hadoop/file2 /user/hadoop/dir` * `hadoop fs -cp -t 5 /user/hadoop/file1 /user/hadoop/file2 /user/hadoop/dir`
* `hadoop fs -cp -t 10 -q 2048 /user/hadoop/file1 /user/hadoop/file2 /user/hadoop/dir` * `hadoop fs -cp -t 10 -q 2048 /user/hadoop/file1 /user/hadoop/file2 /user/hadoop/dir`
@ -403,7 +405,7 @@ Returns 0 on success and non-zero on error.
getmerge getmerge
-------- --------
Usage: `hadoop fs -getmerge [-nl] <src> <localdst>` Usage: `hadoop fs -getmerge [-nl] [-skip-empty-file] <src> <localdst>`
Takes a source directory and a destination file as input and concatenates files in src into the destination local file. Optionally -nl can be set to enable adding a newline character (LF) at the end of each file. Takes a source directory and a destination file as input and concatenates files in src into the destination local file. Optionally -nl can be set to enable adding a newline character (LF) at the end of each file.
-skip-empty-file can be used to avoid unwanted newline characters in case of empty files. -skip-empty-file can be used to avoid unwanted newline characters in case of empty files.
@ -412,6 +414,7 @@ Examples:
* `hadoop fs -getmerge -nl /src /opt/output.txt` * `hadoop fs -getmerge -nl /src /opt/output.txt`
* `hadoop fs -getmerge -nl /src/file1.txt /src/file2.txt /output.txt` * `hadoop fs -getmerge -nl /src/file1.txt /src/file2.txt /output.txt`
* `hadoop fs -getmerge -nl -skip-empty-file /src/file1.txt /src/file2.txt /output.txt`
Exit Code: Exit Code: