big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
24,154 Commits 2 Branches 2 Tags 264 MiB
26cd02fb29
Commit Graph

461 Commits

Author SHA1 Message Date
Andrew Wang
390c2b5df0 Revert "HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang." 
This reverts commit 7fcc73fc0d.

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
 2017-09-14 15:12:26 -07:00
Kai Zheng
e12f3e85bd HDFS-12438. Rename dfs.datanode.ec.reconstruction.stripedblock.threads.size to dfs.datanode.ec.reconstruction.threads. Contributed by Andrew Wang 2017-09-14 15:39:10 +08:00
ChenSammi
e0b3c644e1 HDFS-12414. Ensure to use CLI command to enable/disable erasure coding policy. Contributed by Sammi Chen 2017-09-14 09:15:29 +08:00
Arpit Agarwal
f153e60576 HADOOP-14867. Update HDFS Federation setup document, for incorrect property name for secondary name node http address. Contributed by Bharat Viswanadham. 2017-09-13 12:54:02 -07:00
Lei Xu
123342cd07 HDFS-12412. Change ErasureCodingWorker.stripedReadPool to cached thread pool. (Lei (Eddy) Xu) 2017-09-12 18:12:07 -07:00
Rakesh Radhakrishnan
200b11368d HDFS-12258. ec -listPolicies should list all policies in system, no matter it's enabled or disabled. Contributed by Wei Zhou. 2017-08-30 12:58:56 +05:30
Andrew Wang
f29a0fc288 HDFS-12303. Change default EC cell size to 1MB for better performance. Contributed by Wei Zhou. 2017-08-25 14:14:23 -07:00
Xiao Chen
1000a2af04 HDFS-10899. Add functionality to re-encrypt EDEKs. 2017-08-23 17:06:16 -07:00
Andrew Wang
96b3a6b972 HDFS-11082. Provide replicated EC policy to replicate files. Contributed by SammiChen. 2017-08-16 22:17:06 -07:00
Anu Engineer
d72124a442 HDFS-12162. Update listStatus document to describe the behavior when the argument is a file. Contributed by Ajay Kumar. 2017-08-14 11:32:49 -07:00
John Zhuge
312e57b954 HDFS-11957. Enable POSIX ACL inheritance by default. Contributed by John Zhuge. 2017-08-10 10:30:47 -07:00
Kai Zheng
a53b8b6fdc HDFS-11975. Provide a system-default EC policy. Contributed by Huichun Lu 2017-08-09 10:12:58 +08:00
Lei Xu
fe3341786a HDFS-12251. Add document for StreamCapabilities. (Lei (Eddy) Xu) 2017-08-04 11:21:58 -07:00
Wei-Chiu Chuang
e9d8bdfdf5 HADOOP-14297. Update the documentation about the new ec codecs config keys. Contributed by Kai Sasaki. 2017-06-28 13:53:54 -07:00
Wei-Chiu Chuang
f99b6d19de HDFS-11870. Add CLI cmd to enable/disable an erasure code policy. Contributed by lufei. 2017-06-28 10:54:25 -07:00
Kai Zheng
5db3f98468 HDFS-11606. Add CLI cmd to remove an erasure code policy. Contributed by Tim Yao 2017-06-21 14:01:55 +08:00
Wei-Chiu Chuang
2b654a493c HDFS-11978. Remove invalid '-usage' command of 'ec' and add missing commands 'addPolicies' 'listCodecs' in doc. Contributed by wenxin he. 2017-06-20 09:36:55 -07:00
Masatake Iwasaki
d954a64730 HDFS-11995. HDFS Architecture documentation incorrectly describes writing to a local temporary file. Contributed by Nandakumar. 2017-06-20 08:07:42 +09:00
Andrew Wang
fb68980959 HDFS-10480. Add an admin command to list currently open files. Contributed by Manoj Govindassamy. 2017-06-15 14:46:55 -07:00
Yiqun Lin
5ec71639cf HDFS-11929. Document missing processor of hdfs oiv_legacy command. Contributed by LiXin Ge. 2017-06-07 13:42:13 +08:00
Brahma Reddy Battula
056cc72885 HADOOP-14436. Remove the redundant colon in ViewFs.md. Contributed by maobaolong. 2017-06-02 22:39:10 +08:00
Yiqun Lin
8d9084eb62 HDFS-11359. DFSAdmin report command supports displaying maintenance state datanodes. Contributed by Yiqun Lin. 2017-06-02 12:48:30 +08:00
Kai Zheng
a62be38a5e HDFS-11793. Allow to enable user defined erasure coding policy. Contributed by Sammi Chen 2017-05-24 18:45:52 +08:00
Rakesh Radhakrishnan
1b5451bf05 HDFS-11794. Add ec sub command -listCodec to show currently supported ec codecs. Contributed by SammiChen. 2017-05-23 17:03:28 +05:30
Akira Ajisaka
1d1c52b42f
HDFS-11833. HDFS architecture documentation descibes outdated placement policy. Contributed by Chen Liang. 2017-05-16 11:52:55 -04:00
Kai Zheng
cb672a45a0 HDFS-11605. Allow user to customize new erasure code policies. Contributed by Huafeng Wang 2017-04-28 13:18:50 +08:00
Wei-Chiu Chuang
bbf8cac14d HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao. 2017-04-27 12:39:47 -07:00
Wei-Chiu Chuang
ddaeb3e497 Revert "HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao." 
This reverts commit 872088c6e7.
 2017-04-27 12:25:47 -07:00
Wei-Chiu Chuang
872088c6e7 HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao. 2017-04-27 11:59:33 -07:00
Akira Ajisaka
93fa48fcf2
HDFS-11417. Add datanode admin command to get the storage info. Contributed by Surendra Singh Lilhore. 2017-04-26 17:43:29 +09:00
Kai Zheng
b0803388fc HDFS-11604. Define and parse erasure code policies. Contributed by Lin Zeng 2017-04-21 13:33:33 +08:00
Allen Wittenauer
96cbb4fce2 HADOOP-14202. fix jsvc/secure user var inconsistencies 
Signed-off-by: John Zhuge <jzhuge@apache.org>
 2017-04-07 08:59:21 -07:00
Xiaobing Zhou
3db8d68d63 HDFS-11628. Clarify the behavior of HDFS Mover in documentation. Contributed by Xiaobing Zhou. 2017-04-05 15:33:08 -07:00
Andrew Wang
18432130a7 HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah. 2017-04-04 13:38:25 -07:00
Wei-Chiu Chuang
8c591b8d19 HDFS-10974. Document replication factor for EC files. Contributed by Yiqun Lin. 2017-03-30 11:16:05 -07:00
Yiqun Lin
3b908f71c5 HDFS-11358. DiskBalancer: Report command supports reading nodes from host file. Contributed by Yiqun Lin. 2017-03-21 17:44:17 +08:00
Yiqun Lin
4416a07c9c HDFS-11420. Edit file should not be processed by the same type processor in OfflineEditsViewer. Contributed by Yiqun Lin. 2017-03-15 18:05:03 +08:00
Andrew Wang
7515e75103 HDFS-11505. Do not enable any erasure coding policies by default. Contributed by Manoj Govindassamy. 2017-03-14 11:47:25 -07:00
Andrew Wang
33a38a5341 HDFS-11314. Enforce set of enabled EC policies on the NameNode. 2017-03-08 16:41:44 -08:00
Yiqun Lin
555d0c3995 HDFS-11478. Update EC commands in HDFSCommands.md. Contributed by Yiqun Lin. 2017-03-02 12:10:24 +08:00
Yiqun Lin
4a58870a04 HDFS-11433. Document missing usages of OfflineEditsViewer processors. Contributed by Yiqun Lin. 2017-02-25 10:00:05 +08:00
Andrew Wang
c1a52b04d0 HDFS-11427. Rename rs-default to rs. 2017-02-24 10:58:45 -08:00
Andrew Wang
132f758e3d HDFS-11426. Refactor EC CLI to be similar to storage policies CLI. 2017-02-23 16:00:11 -08:00
Andrew Wang
fc9ad3ce3a HDFS-11405. Rename "erasurecode" CLI subcommand to "ec". Contributed by Manoj Govindassamy. 2017-02-21 13:55:27 -08:00
Yiqun Lin
4164a2032a HDFS-11408. The config name of balance bandwidth is out of date. Contributed by Yiqun Lin. 2017-02-14 18:57:20 +08:00
Yiqun Lin
719df99c05 HDFS-11407. Document the missing usages of OfflineImageViewer processors. Contributed by Yiqun Lin. 2017-02-14 18:48:08 +08:00
Xiao Chen
69b23632c4 HDFS-10860. Switch HttpFS from Tomcat to Jetty. Contributed by John Zhuge. 2017-02-07 09:36:55 -08:00
Masatake Iwasaki
55c9f6d747 HDFS-9884. Use doxia macro to generate in-page TOC of HDFS site documentation. (iwasakims) 2017-01-27 08:06:39 +09:00
Lei Xu
78ae2aed8f HDFS-11259. Update fsck to display maintenance state info. (Manoj Govindassamy via lei) 2017-01-19 16:28:31 +08:00
Akira Ajisaka
e407449ddb HADOOP-13933. Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers. Contributed by Surendra Singh Lilhore. 2017-01-17 10:10:23 +09:00
Andrew Wang
e69231658d HDFS-11072. Add ability to unset and change directory EC policy. Contributed by Sammi Chen. 2017-01-10 11:32:48 -08:00
Chris Nauroth
4c8f9e1302 HDFS-9483. Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS. Contributed by Surendra Singh Lilhore. 2017-01-05 15:04:47 -08:00
Andrew Wang
7fcc73fc0d HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang. 2017-01-03 09:58:00 -08:00
Daniel Templeton
e216e8e233 HADOOP-13932. Fix indefinite article in comments (Contributed by LiXin Ge via Daniel Templeton) 2016-12-27 13:03:16 -08:00
Mingliang Liu
c0e0ef2969 HDFS-11270. Document the missing options of NameNode bootstrap command. Contributed by Yiqun Lin 2016-12-27 11:21:10 -08:00
Akira Ajisaka
72bff192cd HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin. 2016-12-14 18:50:43 +09:00
Andrew Wang
ea2895f4ed HDFS-8630. WebHDFS : Support get/set/unset StoragePolicy. Contributed by Surendra Singh Lilhore. 2016-12-07 15:52:16 -08:00
Andrew Wang
f53b481ffe HDFS-11172. Support an erasure coding policy using RS 10 + 4. Contributed by Wei Zhou. 2016-12-06 12:49:38 -08:00
Akira Ajisaka
636f7547b7 HDFS-11175. Document uppercase key names are not supported in TransparentEncryption.md. Contributed by Yiqun Lin. 2016-11-25 17:48:54 +09:00
Vinayakumar B
ca68f9cb5b HDFS-9337. Validate required params for WebHDFS requests (Contributed by Jagadesh Kiran N) 2016-11-10 16:51:33 +05:30
Xiao Chen
d8bab3dcb6 HDFS-10756. Expose getTrashRoot to HTTPFS and WebHDFS. Contributed by Yuanbo Liu. 2016-11-04 18:06:55 -07:00
Anu Engineer
34173a42d4 HDFS-10633. DiskBalancer : Add the description for the new setting dfs.disk.balancer.plan.threshold.percent in HDFSDiskbalancer.md. Contributed by Yiqun Lin. 2016-11-01 11:14:03 -07:00
Kai Zheng
8fa2195697 HDFS-10926. Update staled configuration properties related to erasure coding. Contributed by Sammi Chen 2016-10-28 12:37:30 +06:00
Wei-Chiu Chuang
25438526ed HDFS-11033. Add documents for native raw erasure coder in XOR codes. Contributed by SammiChen. 2016-10-21 16:20:07 -07:00
Xiao Chen
c5573e6a75 HDFS-11009. Add a tool to reconstruct block meta file from CLI. 2016-10-18 22:42:28 -07:00
Andrew Wang
0007360c33 HDFS-10883. 's behavior is not consistent in DFS after enabling EZ. Contributed by Yuanbo Liu. 2016-10-14 11:41:29 -07:00
Akira Ajisaka
901eca004d HDFS-11002. Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md. Contributed by Mingliang Liu. 2016-10-13 14:29:30 +09:00
Kai Zheng
af50da3298 HDFS-10895. Update HDFS Erasure Coding doc to add how to use ISA-L based coder. Contributed by Sammi Chen 2016-10-10 11:55:49 +06:00
Vinayakumar B
311954883f HDFS-10957. Retire BKJM from trunk (Vinayakumar B) 2016-10-06 19:28:25 +05:30
Brahma Reddy Battula
ef7f06f7d1 HDFS-10947. Correct the API name for truncate in webhdfs document. Contributed by Surendra Singh Lilhore 2016-10-04 18:46:42 +05:30
Xiao Chen
853d65a157 HDFS-10918. Add a tool to get FileEncryptionInfo from CLI. Contributed by Xiao Chen. 2016-10-03 16:01:54 -07:00
Wei-Chiu Chuang
7fad1221d6 HDFS-10907. Fix Erasure Coding documentation. Contributed by Manoj Govindassamy. 2016-09-30 12:51:27 -07:00
Wei-Chiu Chuang
ee33a02234 HDFS-10910. HDFS Erasure Coding doc should state its currently supported erasure coding policies. Contributed by Yiqun Lin. 2016-09-30 12:48:11 -07:00
Anu Engineer
9c9736463b HDFS-10900. DiskBalancer: Complete the documents for the report command. Contributed by Yiqun Lin. 2016-09-27 19:28:41 -07:00
Brahma Reddy Battula
df1d0f5d56 HDFS-10889. Remove outdated Fault Injection Framework documentaion. Contributed by Brahma Reddy Battula 2016-09-27 19:33:10 +05:30
Brahma Reddy Battula
bbdf350ff9 HDFS-10886. Replace fs.default.name with fs.defaultFS in viewfs document. 2016-09-23 19:21:34 +05:30
Brahma Reddy Battula
c4480f7f42 HDFS-10894. Remove the redundant charactors for command -saveNamespace in HDFSCommands.md Contributed by Yiqun Lin. 2016-09-23 19:11:02 +05:30
Xiao Chen
ea839bd48e HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen. 2016-09-17 22:25:39 -07:00
Anu Engineer
1c0d18f322 HDFS-10562. DiskBalancer: update documentation on how to report issues and debug. Contributed by Anu Engineer. 2016-09-13 12:42:10 -07:00
Andrew Wang
db6d243cf8 HDFS-10837. Standardize serializiation of WebHDFS DirectoryListing. 2016-09-13 11:02:36 -07:00
Anu Engineer
8a93f45a80 HDFS-10821. DiskBalancer: Report command support with multiple nodes. Contributed by Yiqun Lin. 2016-09-12 15:45:26 -07:00
Allen Wittenauer
58ed4fa544 HADOOP-13341. Deprecate HADOOP_SERVERNAME_OPTS; replace with (command)_(subcommand)_OPTS 
This commit includes the following changes:

	HADOOP-13356. Add a function to handle command_subcommand_OPTS
	HADOOP-13355. Handle HADOOP_CLIENT_OPTS in a function
	HADOOP-13554. Add an equivalent of hadoop_subcmd_opts for secure opts
	HADOOP-13562. Change hadoop_subcommand_opts to use only uppercase
	HADOOP-13358. Modify HDFS to use hadoop_subcommand_opts
	HADOOP-13357. Modify common to use hadoop_subcommand_opts
	HADOOP-13359. Modify YARN to use hadoop_subcommand_opts
	HADOOP-13361. Modify hadoop_verify_user to be consistent with hadoop_subcommand_opts (ie more granularity)
	HADOOP-13564. modify mapred to use hadoop_subcommand_opts
	HADOOP-13563. hadoop_subcommand_opts should print name not actual content during debug
	HADOOP-13360. Documentation for HADOOP_subcommand_OPTS

This closes apache/hadoop#126
 2016-09-12 11:10:00 -07:00
Xiao Chen
cc01ed7026 HDFS-10855. Fix typos in HDFS documents. Contributed by Yiqun Lin. 2016-09-10 23:24:49 -07:00
Akira Ajisaka
20a20c2f6e HDFS-10847. Complete the document for FileDistribution processor in OfflineImageViewer. Contributed by Yiqun Lin. 2016-09-09 01:34:34 +09:00
Akira Ajisaka
63f594892e HDFS-10778. Add -format option to make the output of FileDistribution processor human-readable in OfflineImageViewer. 2016-09-08 15:13:43 +09:00
Chris Nauroth
f0d5382ff3 HDFS-6962. ACL inheritance conflicts with umaskmode. Contributed by Chris Nauroth. 2016-09-06 11:02:39 -07:00
Andrew Wang
cbd909ce2a HDFS-10833. Fix JSON errors in WebHDFS.md examples. 2016-09-02 14:50:34 -07:00
Andrew Wang
85bab5fb57 HDFS-10784. Implement WebHdfsFileSystem#listStatusIterator. 2016-08-31 14:29:37 -07:00
Mingliang Liu
6742fb6e68 HDFS-10807. Doc about upgrading to a version of HDFS with snapshots may be confusing. (Contributed by Mingliang Liu) 2016-08-29 10:15:34 -07:00
Mingliang Liu
ef55fe1716 HDFS-10747. o.a.h.hdfs.tools.DebugAdmin usage message is misleading. (Contributed by Mingliang Liu) 2016-08-15 20:23:47 -07:00
Wei-Chiu Chuang
25f0a9b3ab HDFS-9937. Update dfsadmin command line help and HdfsQuotaAdminGuide. Contributed by Kai Sasaki. 2016-07-26 08:01:42 -07:00
Masatake Iwasaki
59466b8c18 HDFS-10671. Fix typo in HdfsRollingUpgrade.md. Contributed by Yiqun Lin. 2016-07-26 10:48:21 +09:00
Uma Maheswara Rao G
77ac04efe4 HDFS-10565: Erasure Coding: Document about the current allowed storage policies for EC Striped mode files 2016-07-22 11:08:20 -07:00
Akira Ajisaka
5b4a708704 HDFS-10639. Fix typos in HDFSDiskbalancer.md. Contributed by Yiqun Lin. 2016-07-15 21:41:57 -07:00
Andrew Wang
b8f93cd275 HDFS-10488. Update WebHDFS documentation regarding CREATE and MKDIR default permissions. Contributed by Wellington Chevreuil. 2016-07-07 10:36:55 -07:00
Akira Ajisaka
a3f93beaa1 HDFS-10582. Change deprecated configuration fs.checkpoint.dir to dfs.namenode.checkpoint.dir in HDFS Commands Doc. Contributed by Pan Yuxuan. 2016-07-06 17:51:42 -07:00
Allen Wittenauer
23c3ff85a9 HADOOP-13209. replace slaves with workers (John Smith via aw) 2016-06-28 05:53:03 -07:00
Arpit Agarwal
66fa34c839 HDFS-10557. Fix handling of the -fs Generic option. (Arpit Agarwal) 2016-06-23 18:27:01 -07:00
Anu Engineer
c6ed54808d HDFS-10547. DiskBalancer: fix whitespace issue in doc files. Contributed by Anu Engineer. 2016-06-23 18:27:01 -07:00
Anu Engineer
06a9799d84 HDFS-9547. DiskBalancer: Add user documentation. Contributed by Anu Engineer. 2016-06-23 18:21:08 -07:00
Arpit Agarwal
e983eafb44 HDFS-10532. Typo in RollingUpgrade docs. (Contributed by Yiqun Lin) 2016-06-16 10:10:33 -07:00
Ming Ma
7d521a29ee HDFS-9016. Display upgrade domain information in fsck. (mingma) 2016-06-14 20:05:50 -07:00
Allen Wittenauer
4b0f55b6ea HDFS-7766. Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect (Ravi Prakash via aw) 2016-05-23 15:52:01 -07:00
Masatake Iwasaki
12eb5a7b11 HDFS-10439. Update setOwner doc in HdfsPermissionsGuide. Contributed by John Zhuge. 2016-05-22 16:53:30 +09:00
Colin Patrick Mccabe
7cd5ae62f6 HDFS-10404. Fix formatting of CacheAdmin command usage help text (Yiqun Lin via cmccabe) 2016-05-17 11:10:48 -07:00
Masatake Iwasaki
6957e45699 HDFS-10374. typo in HDFSHighAvailabilityWithQJM doc. Contributed by Takashi Ohnishi. 2016-05-07 11:26:42 +09:00
Xiaoyu Yao
dacd1f50fe HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang. 2016-05-05 18:08:47 -07:00
Jing Zhao
63e5412f1a HDFS-9427. HDFS should not default to ephemeral ports. Contributed by Xiaobing Zhou. 2016-04-22 15:14:40 -07:00
Kai Zheng
b5d4c7dc76 HADOOP-12924. Configure raw erasure coders for supported codecs. Contributed by Rui Li. 2016-04-20 15:47:01 +08:00
Kihwal Lee
c970f1d005 HDFS-10280. Document new dfsadmin command -evictWriters. Contributed by Wei-Chiu Chuang. 2016-04-14 12:45:47 -05:00
Allen Wittenauer
0a74610d1c HADOOP-11393. Revert HADOOP_PREFIX, go back to HADOOP_HOME (aw) 2016-03-31 07:51:05 -07:00
Lei Xu
fde8ac5d85 Add missing files from HDFS-9005. (lei) 2016-03-25 17:11:35 -07:00
Andrew Wang
8f85e5d212 HDFS-10200. Docs for WebHDFS still describe GETDELEGATIONTOKENS operation. Contributed by Wellington Chevreuil. 2016-03-23 12:55:15 -07:00
Masatake Iwasaki
5de848cd5d HDFS-9928. Make HDFS commands guide up to date (Wei-Chiu Chuang via iwasakims) 2016-03-15 20:42:05 +09:00
Colin Patrick Mccabe
500875dfcc HDFS-9927. Document the new OIV ReverseXML processor (Wei-Chiu Chuang via cmccabe) 2016-03-10 13:38:00 -08:00
Yongjun Zhang
8e08861a14 HDFS-9889. Update balancer/mover document about HDFS-6133 feature. Contributed by Yongjun Zhang. 2016-03-04 13:25:29 -08:00
Masatake Iwasaki
cbd31328a6 HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims) 2016-03-04 14:11:36 +09:00
Masatake Iwasaki
f70e317ccc HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims) 2016-03-03 17:14:32 +09:00
Arpit Agarwal
27941a1811 HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-03-02 18:35:28 -08:00
Xiaoyu Yao
5abf051249 HDFS-9887. WebHdfs socket timeouts should be configurable. Contributed by Austin Donnelly and Chris Douglas. 2016-03-02 09:23:17 -08:00
Akira Ajisaka
8bc023b3b1 HDFS-9864. Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc. Contributed by Brahma Reddy Battula. 2016-02-29 18:42:21 +09:00
Xiaoyu Yao
eab52dfb35 HDFS-9831. Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122. Contributed by Xiaobing Zhou. 2016-02-26 14:14:12 -08:00
Chris Nauroth
dbbfc58c33 HDFS-9843. Document distcp options required for copying between encrypted locations. Contributed by Xiaoyu Yao. 2016-02-24 15:16:05 -08:00
Tsz-Wo Nicholas Sze
46f7790236 HDFS-8923. Add -source flag to balancer usage message. Contributed by Chris Trezzo 2016-02-18 18:18:12 -08:00
Akira Ajisaka
c7ac25e52c HDFS-9830. Remove references to hftp in ViewFs documentation in trunk. Contributed by Wei-Chiu Chuang. 2016-02-19 05:02:57 +09:00
cnauroth
5d1889a66d HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth. 2016-02-18 10:07:28 -08:00
Zhe Zhang
b21bbe9ed1 HDFS-9644. Update encryption documentation to reflect nested EZs. (zhz) 
Change-Id: I84ae96f4711a16ded46d501c51ca322bfca5151d
 2016-02-12 10:44:15 -08:00
Akira Ajisaka
60d2011b7c HDFS-9784. Example usage is not correct in Transparent Encryption document. Contributed by Ohnishi Takashi. 2016-02-10 03:30:26 +09:00
Akira Ajisaka
fa544020f6 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki. 2015-12-21 21:23:03 +09:00
cnauroth
932956458d HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal. 2015-12-18 16:24:53 -08:00
cnauroth
724e71f63b HDFS-9552. Document types of permission checks performed for HDFS operations. Contributed by Chris Nauroth. 2015-12-17 10:43:48 -08:00
Allen Wittenauer
8d278d8d2e HDFS-9570. Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's (Travis Campbell via aw) 2015-12-17 08:31:44 -08:00
Haohui Mai
2326171ea8 HDFS-3302. Review and improve HDFS trash documentation. Contributed by Harsh J. 2015-11-22 16:30:39 -08:00
Haohui Mai
0c7340f377 HDFS-8914. Document HA support in the HDFS HdfsDesign.md. Contributed by Lars Francke. 2015-11-22 16:10:27 -08:00
Xiaoyu Yao
41d3f8899d HDFS-9234. WebHdfs: getContentSummary() should give quota for storage types. Contributed by Surendra Singh Lilhore. 2015-11-09 09:57:56 -08:00
Andrew Wang
e8aefdf08b HDFS-8945. Update the description about replica placement in HDFS Architecture documentation. Contributed by Masatake Iwasaki. 2015-10-26 15:47:59 -07:00
Arpit Agarwal
86c92227fc HDFS-4015. Safemode should count and report orphaned blocks. (Contributed by Anu Engineer) 2015-10-23 18:07:17 -07:00
Zhe Zhang
aea26bf4dd HDFS-9280. Document NFS gateway export point parameter. Contributed by Xiao Chen. 
Change-Id: I1cea610c31301d793db3c9ca4dae86d0e5d2d64b
 2015-10-22 11:38:04 -07:00
Vinayakumar B
caa711b660 HDFS-9160. [OIV-Doc] : Missing details of 'delimited' for processor options (Contributed by nijel) 2015-10-13 18:13:01 +05:30
Vinayakumar B
b925cf1006 HDFS-9158. [OEV-Doc] : Document does not mention about '-f' and '-r' options (Contributed by nijel) 2015-10-05 18:23:18 +05:30
Zhe Zhang
8fd5520246 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/proto/hdfs.proto
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirStatAndListingOp.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFS.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java

Change-Id: Ic7946c4ea35bed587fe879ce58b959b25ecc0823
 2015-09-29 01:39:16 -07:00
Zhe Zhang
1080c37300 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Namesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java

Change-Id: I8511c4d64b0959e79129febc179845a3892fedcc
 2015-09-22 13:27:09 -07:00
Vinayakumar B
57003fa971 HDFS-9043. Doc updation for commands in HDFS Federation (Contributed by J.Andreina) 2015-09-22 16:27:24 +05:30
Zhe Zhang
82a88b92b4 HDFS-9086. Rename dfs.datanode.stripedread.threshold.millis to dfs.datanode.stripedread.timeout.millis. Contributed by Andrew Wang. 
Change-Id: Ice86c5d46d29e94087c0f186b941d5394e7ac0e6
 2015-09-18 10:45:29 -07:00
Zhe Zhang
607bda2a21 HDFS-9097. Erasure coding: update EC command "-s" flag to "-p" when specifying policy. Contributed by Zhe Zhang. 
Change-Id: I82919e55c4a0d8646d25a53aac757098a56b3029
 2015-09-17 14:52:37 -07:00
Zhe Zhang
e36129b61a HDFS-9088. Cleanup erasure coding documentation. Contributed by Andrew Wang. 
Change-Id: Ic3ec1f29fef0e27c46fff66fd28a51f8c4c61e71
 2015-09-17 09:56:32 -07:00
Andrew Wang
c2ebab67ac HDFS-7351. Document the HDFS Erasure Coding feature. Contributed by Uma Maheswara Rao G and Zhe Zhang. 2015-09-15 10:16:45 -07:00
Vinayakumar B
d8455479b8 HDFS-9042. Update document for the Storage policy name (Contributed by J.Andreina) 2015-09-12 12:36:12 +05:30
Akira Ajisaka
7b5b2c5822 HDFS-8974. Convert docs in xdoc format to markdown. Contributed by Masatake Iwasaki. 2015-09-10 16:45:27 +09:00
Vinayakumar B
0f0e897bf1 HDFS-7116. Add a command to get the balancer bandwidth (Contributed by Rakesh R) 2015-09-09 22:58:50 +05:30
Andrew Wang
c83d13c649 HDFS-9021. Use a yellow elephant rather than a blue one in diagram. 2015-09-03 16:27:20 -07:00
Tsuyoshi Ozawa
9a87f81ce6 HADOOP-5323. Trash documentation should describe its directory structure and configurations. Contributed by Weiwei Yang. 2015-09-03 22:34:25 +09:00
Ming Ma
d31a41c359 HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) 2015-09-02 15:55:42 -07:00
Jakob Homan
837fb75e8e HDFS-8155. Support OAuth2 in WebHDFS. 2015-08-29 18:37:05 -07:00
Akira Ajisaka
bcaf83902a HDFS-8942. Update hyperlink to rack awareness page in HDFS Architecture documentation. Contributed by Masatake Iwasaki. 2015-08-24 13:52:49 +09:00
Chris Douglas
30e342a5d3 HDFS-8435. Support CreateFlag in WebHDFS. Contributed by Jakob Homan 2015-08-18 17:32:48 -07:00
Akira Ajisaka
fc509f66d8 HDFS-8852. HDFS architecture documentation of version 2.x is outdated about append write support. Contributed by Ajith S. 2015-08-18 23:31:52 +09:00
Arpit Agarwal
ae57d60d82 HDFS-7649. Multihoming docs should emphasize using hostnames in configurations. (Contributed by Brahma Reddy Battula) 2015-08-13 14:26:40 -07:00
Akira Ajisaka
40f815131e HDFS-8622. Implement GETCONTENTSUMMARY operation for WebImageViewer. Contributed by Jagadesh Kiran N. 2015-08-13 11:31:56 +09:00
Jakob Homan
8f73bdd06b HDFS-8866. Typo in docs: Rumtime -> Runtime. Contributed by Gabor Liptak. 2015-08-07 11:38:31 -07:00
Arun Suresh
030fcfa99c HDFS-7858. Improve HA Namenode Failover detection on the client. (asuresh) 2015-07-27 23:02:03 -07:00
Aaron T. Myers
ed01dc70b2 HDFS-8657. Update docs for mSNN. Contributed by Jesse Yates. 2015-07-20 16:40:06 -07:00
Arpit Agarwal
ec0dc71cab HDFS-8706. Fix typo in datanode startup options in HDFSCommands.html. (Controibuted by Brahma Reddy Battula) 2015-07-01 10:36:04 -07:00
Vinayakumar B
fde20ffcef HDFS-8628. Update missing command option for fetchdt (Contributed by J.Andreina) 2015-06-29 16:50:48 +05:30
Akira Ajisaka
bc433908d3 HDFS-8462. Implement GETXATTRS and LISTXATTRS operations for WebImageViewer. Contributed by Jagadesh Kiran N. 2015-06-26 00:20:12 +09:00
Akira Ajisaka
1a169a26bc HDFS-8615. Correct HTTP method in WebHDFS document. Contributed by Brahma Reddy Battula. 2015-06-17 17:13:02 -07:00
Arpit Agarwal
5dbc8c9cb0 HDFS-7164. Feature documentation for HDFS-6581. (Contributed by Arpit Agarwal) 2015-06-16 19:05:44 -07:00
Arpit Agarwal
83e8110f87 HDFS-8583. Document that NFS gateway does not work with rpcbind on SLES 11. (Arpit Agarwal) 2015-06-11 15:08:56 -07:00
Colin Patrick Mccabe
587309bbba HDFS-8566. HDFS documentation about debug commands wrongly identifies them as "hdfs dfs" commands (Surendra Singh Lilhore via Colin P. McCabe) 2015-06-11 14:26:22 -07:00
cnauroth
d2832b3d42 HDFS-8553. Document hdfs class path options. Contributed by Brahma Reddy Battula. 2015-06-08 16:15:38 -07:00
Andrew Wang
b2540f486e HDFS-8535. Clarify that dfs usage in dfsadmin -report output includes all block replicas. Contributed by Eddy Xu. 2015-06-04 15:35:07 -07:00
Vinayakumar B
a2bd6217eb HDFS-8256. '-storagepolicies , -blockId ,-replicaDetails ' options are missed out in usage and from documentation (Contributed by J.Andreina) 2015-06-02 16:07:18 +05:30
Akira Ajisaka
0e4f1081c7 HADOOP-10366. Add whitespaces between classes for values in core-default.xml to fit better in browser. Contributed by kanaka kumar avvaru. 2015-05-21 17:52:03 +09:00
Akira Ajisaka
1dd79ffaca HDFS-8241. Remove unused NameNode startup option -finalize. Contributed by Brahma Reddy Battula. 2015-05-12 00:18:18 +09:00
Akira Ajisaka
3fa2efc09f HDFS-8351. Remove namenode -finalize option from document. (aajisaka) 2015-05-11 15:34:44 +09:00
Allen Wittenauer
c945c20483 HADOOP-11590. Update sbin commands and documentation to use new --slaves option (aw) 2015-05-08 15:27:25 -07:00
Xiaoyu Yao
d0e75e60fb HDFS-8326. Documentation about when checkpoints are run is out of date. (Misty Stanley-Jones via xyao) 2015-05-08 14:46:37 -07:00
Arpit Agarwal
a2d40bced9 HDFS-8340. Fix NFS documentation of nfs.wtmax. (Contributed by Ajith S) 2015-05-08 10:15:26 -07:00
Vinayakumar B
e01c1a979c HDFS-8226. Non-HA rollback compatibility broken (Contributed by J.Andreina) 2015-05-08 15:24:36 +05:30
Vinayakumar B
6232235df3 HDFS-8175. Provide information on snapshotDiff for supporting the comparison between snapshot and current status (Contributed by J.Andreina) 2015-05-08 14:37:50 +05:30
Vinayakumar B
e642eff0e0 HDFS-8187. Remove usage of '-setStoragePolicy' and '-getStoragePolicy' using dfsadmin cmd (as it is not been supported) (Contributed by J.Andreina) 2015-05-08 14:16:30 +05:30
Akira Ajisaka
fd605997ee HDFS-8222. Remove usage of "dfsadmin -upgradeProgress" from document which is no longer supported. Contributed by J.Andreina. 2015-05-08 16:27:40 +09:00
Vinayakumar B
26da2ddf38 HDFS-7998. HDFS Federation : Command mentioned to add a NN to existing federated cluster is wrong (Contributed by Ajith S) 2015-05-08 12:33:49 +05:30
Akira Ajisaka
c5afe444df HDFS-8349. Remove .xml and documentation references to dfs.webhdfs.enabled. Contributed by Ray Chiang. 2015-05-08 15:57:13 +09:00
Vinayakumar B
c7c26a1e4a HDFS-8257. Namenode rollingUpgrade option is incorrect in document (Contributed by J.Andreina) 2015-05-08 10:35:25 +05:30
Haohui Mai
4d9f9e546f HDFS-8037. CheckAccess in WebHDFS silently accepts malformed FsActions parameters. Contributed by Walter Su. 2015-05-07 15:25:26 -07:00
Akira Ajisaka
de9404f02f HDFS-7770. Need document for storage type label of data node storage locations under dfs.data.dir. Contributed by Xiaoyu Yao. 2015-04-30 20:12:32 +09:00
Allen Wittenauer
8b69c825e5 HADOOP-11865. Incorrect path mentioned in document for accessing script files (J.Andreina via aw) 2015-04-26 09:55:46 -07:00
Allen Wittenauer
f83c55a6be HDFS-7673. synthetic load generator docs give incorrect/incomplete commands (Brahma Reddy Battula via aw) 2015-04-25 15:05:43 +01:00
Akira Ajisaka
91b97c21c9 HDFS-8110. Remove unsupported 'hdfs namenode -rollingUpgrade downgrade' from document. Contributed by J.Andreina. 2015-04-24 20:32:55 +09:00
Akira Ajisaka
4308910eed Revert "HDFS-6153. Document "fileId" and "childrenNum" fields in the FileStatus Json schema" 
This reverts commit eb1d4c39e0.
 2015-04-16 16:54:01 -05:00
Jing Zhao
b172d03595 HDFS-7934. Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN. Contributed by J. Andreina. 2015-04-15 13:10:38 -07:00
Akira Ajisaka
859cab2f22 HDFS-7671. hdfs user guide should point to the common rack awareness doc. Contributed by Kai Sasaki. 2015-04-01 00:26:16 +09:00
Akira Ajisaka
e7ea2a8e8f HDFS-8002. Website refers to /trash directory. Contributd by Brahma Reddy Battula. 2015-03-31 00:27:50 +09:00
Arpit Agarwal
89fb0f57ef HDFS-7700. Document quota support for storage types. (Contributed by Xiaoyu Yao) 2015-03-27 19:49:26 -07:00
Brandon Li
570a83ae80 HDFS-7977. NFS couldn't take percentile intervals. Contributed by Brandon Li 2015-03-24 10:49:16 -07:00
Brandon Li
51f1f49374 HDFS-7976. Update NFS user guide for mount option 'sync' to minimize or avoid reordered writes. Contributed by Brandon Li 2015-03-24 10:28:38 -07:00
Brandon Li
36af4a913c HDFS-7942. NFS: support regexp grouping in nfs.exports.allowed.hosts. Contributed by Brandon Li 2015-03-23 10:06:47 -07:00
Vinayakumar B
5be5129d93 HDFS.7849. Update documentation for enabling a new feature in rolling upgrade ( Contributed by J.Andreina ) 2015-03-19 19:05:42 +05:30
Haohui Mai
f0dea037ff HDFS-7697. Mark the PB OIV tool as experimental. Contributed by Lei (Eddy) Xu. 2015-03-18 13:33:41 -07:00