big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,956 Commits 2 Branches 2 Tags 264 MiB
2a8fcf0c9a
Commit Graph

186 Commits

Author SHA1 Message Date
Akira Ajisaka
bedfec0c10 HADOOP-13522. Add %A and %a formats for fs -stat command to print permissions. Contributed by Alex Garbarini. 2016-10-18 15:00:44 +09:00
Andrew Wang
987ee51141 HADOOP-13724. Fix a few typos in site markdown documents. Contributed by Ding Fei. 2016-10-17 13:25:58 -07:00
Wei-Chiu Chuang
ed9fcbec54 HADOOP-13661. Upgrade HTrace version. Contributed by Sean Mackrory. 2016-10-17 05:04:49 -07:00
Xiao Chen
b84c4891f9 HADOOP-13698. Document caveat for KeyShell when underlying KeyProvider does not delete a key. 2016-10-11 17:05:00 -07:00
Steve Loughran
ebd4f39a39 HADOOP-12977 s3a to handle delete("/", true) robustly. Contributed by Steve Loughran. 2016-10-07 12:51:40 +01:00
Akira Ajisaka
9a61b52fbe HADOOP-13685. Document -safely option of rm command. Contributed by Xiaoyu Yao. 2016-10-05 20:41:08 +09:00
Xiao Chen
ea839bd48e HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen. 2016-09-17 22:25:39 -07:00
Akira Ajisaka
7cad7b7046 HADOOP-13616. Broken code snippet area in Hadoop Benchmarking. Contributed by Kai Sasaki. 2016-09-15 23:42:34 +09:00
Allen Wittenauer
58ed4fa544 HADOOP-13341. Deprecate HADOOP_SERVERNAME_OPTS; replace with (command)_(subcommand)_OPTS 
This commit includes the following changes:

	HADOOP-13356. Add a function to handle command_subcommand_OPTS
	HADOOP-13355. Handle HADOOP_CLIENT_OPTS in a function
	HADOOP-13554. Add an equivalent of hadoop_subcmd_opts for secure opts
	HADOOP-13562. Change hadoop_subcommand_opts to use only uppercase
	HADOOP-13358. Modify HDFS to use hadoop_subcommand_opts
	HADOOP-13357. Modify common to use hadoop_subcommand_opts
	HADOOP-13359. Modify YARN to use hadoop_subcommand_opts
	HADOOP-13361. Modify hadoop_verify_user to be consistent with hadoop_subcommand_opts (ie more granularity)
	HADOOP-13564. modify mapred to use hadoop_subcommand_opts
	HADOOP-13563. hadoop_subcommand_opts should print name not actual content during debug
	HADOOP-13360. Documentation for HADOOP_subcommand_OPTS

This closes apache/hadoop#126
 2016-09-12 11:10:00 -07:00
Andrew Wang
f388a20943 Add CHANGES and release notes for 3.0.0-alpha1 to site 2016-09-06 09:51:55 -07:00
Chris Douglas
c37346d0e3 HADOOP-12726. Unsupported FS operations should throw UnsupportedOperationException. Contributed by Daniel Templeton. 2016-08-23 14:12:52 -07:00
Masatake Iwasaki
8aae8d6bf0 HADOOP-13497. fix wrong command in CredentialProviderAPI.md. Contributed by Yuanbo Liu. 2016-08-24 00:03:27 +09:00
Wei-Chiu Chuang
f0efea490e HDFS-8986. Add option to -du to calculate directory space usage excluding snapshots. Contributed by Xiao Chen. 2016-08-23 04:14:24 -07:00
Akira Ajisaka
8179f9a493 HDFS-10645. Make block report size as a metric and add this metric to datanode web ui. Contributed by Yuanbo Liu. 2016-08-19 16:15:00 +09:00
Mingliang Liu
382d615260 HDFS-10678. Documenting NNThroughputBenchmark tool. (Contributed by Mingliang Liu) 2016-08-15 20:22:14 -07:00
Wei-Chiu Chuang
d892ae9576 HADOOP-13441. Document LdapGroupsMapping keystore password properties. Contributed by Yuanbo Liu. 2016-08-11 11:57:43 -07:00
Chris Nauroth
5fda66e4a3 HADOOP-13207. Specify FileSystem listStatus, listFiles and RemoteIterator. Contributed by Steve Loughran. 2016-07-22 15:38:18 -07:00
Vrushali Channapattan
32b033d57c YARN-5052 Update timeline service v2 documentation to capture information about filters (Varun Saxena via Vrushali C) 2016-07-10 08:46:03 -07:00
Allen Wittenauer
a0035661c1 HADOOP-13349. HADOOP_CLASSPATH vs HADOOP_USER_CLASSPATH (aw) 2016-07-07 14:15:34 -07:00
Masatake Iwasaki
5c07c573db HADOOP-12242. Add in-page TOC to filesystem specification pages. (iwasakims) 2016-06-30 07:21:08 +09:00
Steve Loughran
111739df8f HADOOP-12229 Fix inconsistent subsection titles in filesystem.md. Contributed by Masatake Iwasaki 2016-06-29 14:32:03 +01:00
Allen Wittenauer
23c3ff85a9 HADOOP-13209. replace slaves with workers (John Smith via aw) 2016-06-28 05:53:03 -07:00
Arpit Agarwal
9683eab0e1 HADOOP-13263. Reload cached groups in background after expiry. (Contributed bt Stephen O'Donnell) 2016-06-27 09:36:05 -07:00
Akira Ajisaka
09e82acaf9 HADOOP-12943. Add -w -r options in dfs -test command. Contributed by Weiwei Yang. 2016-06-17 16:20:38 +09:00
Andrew Wang
0accc3306d HADOOP-13079. Add -q option to Ls to print ? instead of non-printable characters. Contributed by John Zhuge. 2016-06-13 11:43:46 -07:00
Robert Kanter
733f3f18d5 MAPREDUCE-6702. TestMiniMRChildTask.testTaskEnv and TestMiniMRChildTask.testTaskOldEnv are failing (ajisakaa via rkanter) 2016-06-07 15:46:06 -07:00
Arpit Agarwal
97e2449477 HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (Contributed by Akira Ajisaka) 2016-06-02 13:14:45 -07:00
Akira Ajisaka
ead61c45da HADOOP-13224. Grep job in Single Cluster document fails. (aajisaka) 2016-06-03 02:00:13 +09:00
Colin Patrick Mccabe
8ceb06e239 HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe) 2016-05-31 17:54:34 -07:00
Yongjun Zhang
34cc21f6d1 HADOOP-12847. hadoop daemonlog should support https and SPNEGO for Kerberized cluster. (Wei-Chiu Chuang via Yongjun Zhang) 2016-05-26 22:43:45 -07:00
Kai Zheng
182fc1986a HADOOP-12782. Faster LDAP group name resolution with ActiveDirectory. Contributed by Wei-Chiu Chuang 2016-05-19 07:15:52 -07:00
Allen Wittenauer
730bc746f9 HADOOP-12930. Dynamic subcommands for hadoop shell scripts (aw) 
This commit contains the following JIRA issues:

    HADOOP-12931. bin/hadoop work for dynamic subcommands
    HADOOP-12932. bin/yarn work for dynamic subcommands
    HADOOP-12933. bin/hdfs work for dynamic subcommands
    HADOOP-12934. bin/mapred work for dynamic subcommands
    HADOOP-12935. API documentation for dynamic subcommands
    HADOOP-12936. modify hadoop-tools to take advantage of dynamic subcommands
    HADOOP-13086. enable daemonization of dynamic commands
    HADOOP-13087. env var doc update for dynamic commands
    HADOOP-13088. fix shellprofiles in hadoop-tools to allow replacement
    HADOOP-13089. hadoop distcp adds client opts twice when dynamic
    HADOOP-13094. hadoop-common unit tests for dynamic commands
    HADOOP-13095. hadoop-hdfs unit tests for dynamic commands
    HADOOP-13107. clean up how rumen is executed
    HADOOP-13108. dynamic subcommands need a way to manipulate arguments
    HADOOP-13110. add a streaming subcommand to mapred
    HADOOP-13111. convert hadoop gridmix to be dynamic
    HADOOP-13115. dynamic subcommand docs should talk about exit vs. continue program flow
    HADOOP-13117. clarify daemonization and security vars for dynamic commands
    HADOOP-13120. add a --debug message when dynamic commands have been used
    HADOOP-13121. rename sub-project shellprofiles to match the rest of Hadoop
    HADOOP-13129. fix typo in dynamic subcommand docs
    HADOOP-13151. Underscores should be escaped in dynamic subcommands document
    HADOOP-13153. fix typo in debug statement for dynamic subcommands
 2016-05-16 17:54:45 -07:00
Sangjin Lee
1f2794b4fa HADOOP-12971. FileSystemShell doc should explain relative path (John Zhuge via sale) 2016-05-13 10:01:46 -07:00
Larry McCay
acb509b2fa HADOOP-12942. hadoop credential commands non-obviously use password of "none" (Mike Yoder via lmccay) 2016-05-11 14:30:07 -04:00
Steve Loughran
829a2e4d27 HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple. (Bolke de Bruin via stevel). 2016-05-10 21:32:57 +01:00
Allen Wittenauer
1c5bbf6499 HADOOP-12866. add a subcommand for gridmix (Kai Sasaki via aw) 2016-05-06 14:07:02 -07:00
Allen Wittenauer
971af603ea HADOOP-13045. hadoop_add_classpath is not working in .hadooprc 2016-04-30 12:23:51 -07:00
Ravi Prakash
2753185a01 HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano 2016-04-29 22:32:27 -07:00
Zhe Zhang
5865fe2bf0 HDFS-9869. Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]. Contributed by Rakesh R. 2016-04-25 22:01:54 -07:00
Jing Zhao
63e5412f1a HDFS-9427. HDFS should not default to ephemeral ports. Contributed by Xiaobing Zhou. 2016-04-22 15:14:40 -07:00
Ravi Prakash
d6402faded Revert "HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano" 
This reverts commit 4838b735f0.
 2016-04-22 10:17:20 -07:00
Larry McCay
337bcde1dc HADOOP-13011 - Clearly Document the Password Details for Keystore-based Credential Providers 2016-04-21 20:17:33 -07:00
Ravi Prakash
4838b735f0 HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano 2016-04-21 11:32:39 -07:00
Akira Ajisaka
209303be3a HDFS-8356. Document missing properties in hdfs-default.xml. Contributed by Ray Chiang. 2016-04-12 15:26:50 +09:00
Akira Ajisaka
a409508b3f HDFS-10277. PositionedReadable test testReadFullyZeroByteFile failing in HDFS. Contributed by Steve Loughran. 2016-04-12 14:55:01 +09:00
Chris Nauroth
843ee8d59d HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran. 2016-04-08 13:36:58 -07:00
Allen Wittenauer
0a74610d1c HADOOP-11393. Revert HADOOP_PREFIX, go back to HADOOP_HOME (aw) 2016-03-31 07:51:05 -07:00
Akira Ajisaka
01cfee6381 HADOOP-12873. Remove MRv1 terms from HttpAuthentication.md. Contributed by Brahma Reddy Battula. 2016-03-28 15:57:57 +09:00
Andrew Wang
938222b2e2 HADOOP-12947. Update documentation Hadoop Groups Mapping to add static group mapping, negative cache. Contributed by Wei-Chiu Chuang. 2016-03-23 14:57:14 -07:00
Akira Ajisaka
87c8005ad3 HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak. 2016-03-09 15:35:51 +09:00
Allen Wittenauer
55f73a1cbd HADOOP-12798. Update changelog and release notes (2016-03-04) (aw) 2016-03-08 16:48:38 -08:00
Akira Ajisaka
f86850b544 HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang. 2016-03-08 14:28:47 +09:00
Arpit Agarwal
c2140d05ef HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:24 -08:00
Chris Nauroth
2759689d7d HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth. 2016-03-04 15:29:50 -08:00
Masatake Iwasaki
cbd31328a6 HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims) 2016-03-04 14:11:36 +09:00
Akira Ajisaka
0a9f00af5e HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula. 2016-03-03 23:32:30 +09:00
Akira Ajisaka
1c3136cbd8 HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula. 2016-03-03 23:22:35 +09:00
Akira Ajisaka
eb864d35d6 HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge. 2016-03-03 18:46:48 +09:00
Masatake Iwasaki
f70e317ccc HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims) 2016-03-03 17:14:32 +09:00
cnauroth
27b77751c1 HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay. 2016-02-22 17:30:13 -08:00
cnauroth
8ab7658025 HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay. 2016-02-18 14:06:38 -08:00
Akira Ajisaka
c7ac25e52c HDFS-9830. Remove references to hftp in ViewFs documentation in trunk. Contributed by Wei-Chiu Chuang. 2016-02-19 05:02:57 +09:00
Akira Ajisaka
1c48e50ce7 HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen. 2016-02-15 11:38:25 +09:00
cnauroth
cfa8513890 HADOOP-12426. Add Entry point for Kerberos health check. Contributed by Steve Loughran. 2016-02-05 15:47:51 -08:00
Xuan
63c63e298c YARN-4662. Document some newly added metrics. Contributed by Jian He 2016-02-03 20:05:22 -08:00
Kihwal Lee
2fd19b9674 HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma. 2016-01-22 09:10:06 -06:00
Ravi Prakash
1acc509b45 HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano 2016-01-19 13:57:08 -08:00
Benoy Antony
dec8dfdfa6 HADOOP-12587. Hadoop AuthToken refuses to work without a maxinactive attribute in issued token. (Benoy Antony) 2016-01-09 13:41:18 -08:00
Steve Loughran
21bededd2f HADOOP-12675. Fix description about retention period in usage of expunge command. (Masatake Iwasaki via stevel) 2016-01-07 14:40:09 +00:00
Akira Ajisaka
1af2917856 HADOOP-12686. Update FileSystemShell documentation to mention the meaning of each columns of fs -du. Contributed by Daisuke Kobayashi. 2016-01-04 20:33:17 +09:00
Akira Ajisaka
fa544020f6 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki. 2015-12-21 21:23:03 +09:00
cnauroth
932956458d HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal. 2015-12-18 16:24:53 -08:00
Akira Ajisaka
061c05cc05 HADOOP-12657. Add a option to skip newline on empty files with getMerge -nl. Contributed by Kanaka Kumar Avvaru. 2015-12-18 13:58:28 +09:00
Akira Ajisaka
3857fed2c8 HADOOP-12565. Replace DSA with RSA for SSH key type in SingleCluster.md. Contributed by Mingliang Liu. 2015-12-03 11:50:31 +08:00
Haohui Mai
db4cab21f4 HDFS-5165. Remove the TotalFiles metrics. Contributed by Akira AJISAKA. 2015-11-24 11:41:57 -08:00
Haohui Mai
8228697857 HDFS-9024. Deprecate the TotalFiles metric. Contributed by Akira Ahisaka. 2015-11-22 23:02:50 -08:00
Zhe Zhang
8def51a708 HDFS-9229. Expose size of NameNode directory as a metric. Contributed by Surendra Singh Lilhore. 
Change-Id: I985627a5d1400249d72d084283ef366d5ac6e07b
 2015-10-29 11:23:08 -07:00
Jonathan Eagles
f8adeb712d YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles) 2015-10-23 10:34:08 -05:00
Allen Wittenauer
d759b4bd74 HADOOP-11791. Update src/site/markdown/releases to include old versions of Hadoop (aw) 2015-10-21 11:30:59 -07:00
Vinayakumar B
7f0e1eb43d HADOOP-12460. Add overwrite option for 'get' shell command (Contributed by Jagadesh Kiran N) 2015-10-19 12:16:16 +05:30
Colin Patrick Mccabe
3e1752f9fb HADOOP-12452. Fix tracing documention reflecting the update to htrace-4 (Masatake Iwasaki via Colin P. McCabe) 2015-10-05 11:35:31 -07:00
Colin Patrick Mccabe
850d679acb HADOOP-12447. Clean up some htrace integration issues (cmccabe) 2015-09-29 09:25:11 -07:00
Colin Patrick Mccabe
892ade689f HDFS-9080. Update htrace version to 4.0.1 (cmccabe) 2015-09-28 07:42:12 -07:00
Vinayakumar B
a2c76e5f26 HDFS-9013. Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk (Contributed by Surendra Singh Lilhore) 2015-09-23 15:28:41 +05:30
Eric Yang
2ffe2db95e HADOOP-12374. Updated expunge command description. 
(WeiWei Yang via eyang)
 2015-09-15 20:03:24 -07:00
Vinayakumar B
94cf7ab9d2 HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) 2015-09-09 11:03:57 +05:30
Akira Ajisaka
65ccf2b125 HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore. 2015-09-02 14:28:38 +09:00
Akira Ajisaka
2e251a7674 HADOOP-12359. hadoop fs -getmerge doc is wrong. Contributed by Jagadesh Kiran N. 2015-09-01 20:55:33 +09:00
Akira Ajisaka
36b1a1e784 HADOOP-12061. Incorrect command in single cluster setup document. Contributed by Kengo Seki. 2015-08-20 11:09:45 +09:00
Arpit Agarwal
9c3571ea60 HDFS-8911. NameNode Metric : Add Editlog counters as a JMX metric. (Contributed by Anu Engineer) 2015-08-19 09:42:35 -07:00
Benoy Antony
71aedfabf3 hadoop-12050. Enable MaxInactiveInterval for hadoop http auth token. Contributed by Huizhi Lu. 2015-08-18 13:43:34 -07:00
Xiaoyu Yao
a7862d5fe4 HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed by Anu Engineer. 2015-08-17 10:15:56 -07:00
Akira Ajisaka
2a1d656196 Revert "HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka)" 
This reverts commit 02c01815ec.
 2015-07-29 16:48:30 +09:00
Akira Ajisaka
e21dde501a HADOOP-12245. References to misspelled REMAINING_QUATA in FileSystemShell.md. Contributed by Gabor Liptak. 2015-07-28 11:33:10 +09:00
Akira Ajisaka
02c01815ec HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka) 2015-07-24 11:37:23 +09:00
Jakob Homan
ab3197c204 HADOOP-12009: Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via jghoman) 2015-07-23 17:46:13 -07:00
cnauroth
a26cc66f38 HDFS-8773. Few FSNamesystem metrics are not documented in the Metrics page. Contributed by Rakesh R. 2015-07-21 14:12:03 -07:00
cnauroth
cb03768b1b HDFS-8721. Add a metric for number of encryption zones. Contributed by Rakesh R. 2015-07-21 13:55:58 -07:00
Akira Ajisaka
d6675606dc YARN-3069. Document missing properties in yarn-default.xml. Contributed by Ray Chiang. 2015-07-13 12:57:01 +09:00
Steve Loughran
076948d9a4 Revert "HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via stevel)" 
This reverts commit 3dfa8161f9.
 2015-06-30 11:54:12 +01:00