Commit Graph

51 Commits

Author SHA1 Message Date
Allen Wittenauer
730bc746f9 HADOOP-12930. Dynamic subcommands for hadoop shell scripts (aw)
This commit contains the following JIRA issues:

    HADOOP-12931. bin/hadoop work for dynamic subcommands
    HADOOP-12932. bin/yarn work for dynamic subcommands
    HADOOP-12933. bin/hdfs work for dynamic subcommands
    HADOOP-12934. bin/mapred work for dynamic subcommands
    HADOOP-12935. API documentation for dynamic subcommands
    HADOOP-12936. modify hadoop-tools to take advantage of dynamic subcommands
    HADOOP-13086. enable daemonization of dynamic commands
    HADOOP-13087. env var doc update for dynamic commands
    HADOOP-13088. fix shellprofiles in hadoop-tools to allow replacement
    HADOOP-13089. hadoop distcp adds client opts twice when dynamic
    HADOOP-13094. hadoop-common unit tests for dynamic commands
    HADOOP-13095. hadoop-hdfs unit tests for dynamic commands
    HADOOP-13107. clean up how rumen is executed
    HADOOP-13108. dynamic subcommands need a way to manipulate arguments
    HADOOP-13110. add a streaming subcommand to mapred
    HADOOP-13111. convert hadoop gridmix to be dynamic
    HADOOP-13115. dynamic subcommand docs should talk about exit vs. continue program flow
    HADOOP-13117. clarify daemonization and security vars for dynamic commands
    HADOOP-13120. add a --debug message when dynamic commands have been used
    HADOOP-13121. rename sub-project shellprofiles to match the rest of Hadoop
    HADOOP-13129. fix typo in dynamic subcommand docs
    HADOOP-13151. Underscores should be escaped in dynamic subcommands document
    HADOOP-13153. fix typo in debug statement for dynamic subcommands
2016-05-16 17:54:45 -07:00
Andrew Wang
9e8411d0a6 MAPREDUCE-6537. Include hadoop-pipes examples in the release tarball. Contributed by Kai Sasaki. 2016-05-02 15:35:05 -07:00
Allen Wittenauer
7b1c37a13a HADOOP-12892. fix/rewrite create-release (aw) 2016-04-27 08:38:22 -07:00
Gábor Lipták
18727c63da HADOOP-12133 Add schemas to Maven Assembly XMLs
Signed-off-by: Allen Wittenauer <aw@apache.org>
2015-10-30 11:36:52 -07:00
Karthik Kambatla
119cc75e7e MAPREDUCE-6415. Create a tool to combine aggregated logs into HAR files. (Robert Kanter via kasha) 2015-09-09 17:45:19 -07:00
Allen Wittenauer
aab459c904 MAPREDUCE-4413. MR lib dir contains jdiff (which is gpl) (Nemon Lou via aw) 2015-02-09 14:02:47 -08:00
Allen Wittenauer
5c79439568 HADOOP-11485. Pluggable shell integration (aw) 2015-02-06 13:09:01 -08:00
Todd Lipcon
4b3f1e2ce4 Merge remote-tracking branch 'apache/trunk' into MR-2841 2014-09-05 10:47:27 -07:00
Karthik Kambatla
ce0462129f HADOOP-10956. Fix create-release script to include docs and necessary txt files. (kasha) 2014-09-03 09:39:02 -07:00
Todd Lipcon
cce7d1e2f9 Merge remote-tracking branch 'origin/trunk' into MR-2841
Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/MapTask.java
2014-09-02 15:55:54 -07:00
Allen Wittenauer
31467453ec HADOOP-9902. Shell script rewrite (aw)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618847 13f79535-47bb-0310-9956-ffa450edef68
2014-08-19 12:11:17 +00:00
Todd Lipcon
eace4dd50b MAPREDUCE-6035. native-task: sources/test-sources jar distribution. Contributed by Manu Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/MR-2841@1617879 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 04:56:43 +00:00
Alejandro Abdelnur
17d4fbbf0a HADOOP-10433. Key Management Server based on KeyProvider API. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592637 13f79535-47bb-0310-9956-ffa450edef68
2014-05-05 21:43:14 +00:00
Vinod Kumar Vavilapalli
cbee889711 YARN-321. Merging YARN-321 branch to trunk.
svn merge ../branches/YARN-321


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561452 13f79535-47bb-0310-9956-ffa450edef68
2014-01-26 04:51:10 +00:00
Alejandro Abdelnur
0ff3d6397e YARN-1601. 3rd party JARs are missing from hadoop-dist output. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558465 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 17:00:36 +00:00
Alejandro Abdelnur
58b08e11b9 YARN-1021. Yarn Scheduler Load Simulator. (ywskycn via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1527059 13f79535-47bb-0310-9956-ffa450edef68
2013-09-27 20:23:19 +00:00
Brandon Li
270eaceba8 HDFS-5069 Include hadoop-nfs and hadoop-hdfs-nfs into hadoop dist for NFS deployment. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516232 13f79535-47bb-0310-9956-ffa450edef68
2013-08-21 17:54:08 +00:00
Chris Nauroth
e4e0499fc9 MAPREDUCE-5187. Create mapreduce command scripts on Windows. Contributed by Chuan Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1500929 13f79535-47bb-0310-9956-ffa450edef68
2013-07-08 20:27:12 +00:00
Thomas Graves
7049c83d0e HADOOP-9469. mapreduce/yarn source jars not included in dist tarball (Robert Parker via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470047 13f79535-47bb-0310-9956-ffa450edef68
2013-04-19 21:18:05 +00:00
Hitesh Shah
2e4382b7c3 YARN-429. capacity-scheduler config missing from yarn-test artifact. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453501 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 19:26:57 +00:00
Suresh Srinivas
638801cce1 HADOOP-8952. Enhancements to support Hadoop on Windows Server and Windows Azure environments. Contributed by Ivan Mitic, Chuan Liu, Ramya Sunil, Bikas Saha, Kanna Karanam, John Gordon, Brandon Li, Chris Nauroth, David Lao, Sumadhur Reddy Bolli, Arpit Agarwal, Ahmed El Baz, Mike Liddell, Jing Zhao, Thejas Nair, Steve Maine, Ganeshan Iyer, Raja Aluri, Giridharan Kesavan, Ramya Bharathi Nimmagadda.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453486 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 19:15:18 +00:00
Jason Darrell Lowe
96398870b4 HADOOP-9260. Hadoop version may be not correct when starting name node or data node. Contributed by Chris Nauroth
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442639 13f79535-47bb-0310-9956-ffa450edef68
2013-02-05 16:02:52 +00:00
Vinod Kumar Vavilapalli
ca4bc1a417 YARN-181. Fixed eclipse settings broken by capacity-scheduler.xml move via YARN-140. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401504 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 22:48:49 +00:00
Arun Murthy
e1fdf62123 YARN-1. Promote YARN to be a sub-project of Apache Hadoop.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370666 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 05:22:27 +00:00
Alejandro Abdelnur
117145f1ad MAPREDUCE-4498. Remove hsqldb jar from Hadoop runtime classpath. (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369906 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 18:14:47 +00:00
Aaron Myers
56b0912b6c HDFS-3720. hdfs.h must get packaged. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365759 13f79535-47bb-0310-9956-ffa450edef68
2012-07-25 21:21:14 +00:00
Eli Collins
370c65f282 Revert MAPREDUCE-3868. Reenable Raid.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363572 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 22:30:36 +00:00
Alejandro Abdelnur
12979570be MAPREDUCE-4407. Add hadoop-yarn-server-tests-<version>-tests.jar to hadoop dist package. (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363162 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 22:43:01 +00:00
Thomas Graves
9a43f05129 HADOOP-8563. don't package hadoop-pipes examples/bin (Colin Patrick McCabe via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357811 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 19:13:06 +00:00
Eli Collins
8188c1cb41 HADOOP-8547. Package hadoop-pipes examples/bin directory (again). Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356947 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 21:12:04 +00:00
Robert Joseph Evans
49feb6a039 MAPREDUCE-4267. mavenize pipes (tgraves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351818 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 19:40:44 +00:00
Scott Chun-Yang Chen
277b3dd736 MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351548 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 00:55:28 +00:00
Robert Joseph Evans
4d876c7800 MAPREDUCE-4060. Multiple SLF4J binding warning (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308925 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 14:19:29 +00:00
Arun Murthy
4f6839f23d MAPREDUCE-3354. Changed scripts so that jobhistory server is started by bin/mapred instead of bin/yarn. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241250 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 23:11:26 +00:00
Mahadev Konar
c7642a135c MAPREDUCE-3712. The mapreduce tar does not contain the hadoop-mapreduce-client-jobclient-tests.jar. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235566 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 00:14:26 +00:00
Alejandro Abdelnur
750c5d881c HADOOP-7936. There's a Hoop README in the root dir of the tarball. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227968 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 05:58:39 +00:00
Alejandro Abdelnur
b3bcbe274d HADOOP-7907. hadoop-tools JARs are not part of the distro. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227901 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 00:02:04 +00:00
Mahadev Konar
6d551b83de MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215065 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 09:09:28 +00:00
Alejandro Abdelnur
3334306512 HDFS-2178. Contributing Hoop to HDFS, replacement for HDFS proxy with read/write capabilities. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212060 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 19:25:28 +00:00
Alejandro Abdelnur
f5cffab738 HDFS-2614. hadoop dist tarball is missing hdfs headers. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208928 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 01:19:35 +00:00
Alejandro Abdelnur
59df2d48c3 MAPREDUCE-3183. hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml missing license header. (Hitesh Shah via tucu).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183160 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 23:16:07 +00:00
Alejandro Abdelnur
3790f31317 HADOOP-7743. Add Maven profile to create a full source tarball. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183151 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 22:38:03 +00:00
Alejandro Abdelnur
e9544ef3d2 HADOOP-7737. normalize hadoop-mapreduce & hadoop-dist dist/tar build with common/hdfs (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183068 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 20:23:59 +00:00
Alejandro Abdelnur
327e02fdf4 MAPREDUCE-3171. normalize nodemanager native code compilation with common/hdfs native. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182575 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 20:38:51 +00:00
Alejandro Abdelnur
3f998db918 HADOOP-7642. create hadoop-dist module where TAR stitching would happen. Contributed by Thomas White.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182151 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 00:27:32 +00:00
Devaraj Das
468775a21d HADOOP-7599. Script improvements to setup a secure Hadoop cluster. Contributed by Eric Yang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169986 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 00:31:29 +00:00
Arun Murthy
bb0005cfec HADOOP-7563. Setup HADOOP_HDFS_HOME, HADOOP_MAPRED_HOME and classpath correction. Contributed by Eric Yang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161329 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 00:06:53 +00:00
Thomas White
14b97a91d9 HADOOP-7496. Break Maven TAR & bintar profiles into just LAYOUT & TAR proper. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160344 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 17:40:58 +00:00
Thomas White
8d34a17407 HADOOP-7498. Remove legacy TAR layout creation. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160341 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 17:19:46 +00:00
Thomas White
d86f3183d9 HDFS-2096. Mavenization of hadoop-hdfs. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159702 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 17:36:23 +00:00