From 4c8f9e130230457fc897ed7a2a09e14d078be90a Mon Sep 17 00:00:00 2001 From: Chris Nauroth Date: Thu, 5 Jan 2017 15:04:47 -0800 Subject: [PATCH] HDFS-9483. Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS. Contributed by Surendra Singh Lilhore. --- hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md | 5 +++++ hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm | 1 + 2 files changed, 6 insertions(+) diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md index 27fd13af4f..50b4360291 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md +++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md @@ -211,6 +211,11 @@ In the REST API, the prefix "`/webhdfs/v1`" is inserted in the path and a query http://:/webhdfs/v1/?op=... +**Note** that if WebHDFS is secured with SSL, then the scheme should be "`swebhdfs://`". + + swebhdfs://:/ + + ### HDFS Configuration Options Below are the HDFS configuration options for WebHDFS. diff --git a/hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm b/hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm index fc263212b7..dbf0e8da66 100644 --- a/hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm +++ b/hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm @@ -417,6 +417,7 @@ $H3 Copying Between Versions of HDFS HftpFileSystem, as webhdfs is available for both read and write operations, DistCp can be run on both source and destination cluster. Remote cluster is specified as `webhdfs://:`. + (Use the "`swebhdfs://`" scheme when webhdfs is secured with SSL). When copying between same major versions of Hadoop cluster (e.g. between 2.X and 2.X), use hdfs protocol for better performance.