big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
13,600 Commits 2 Branches 2 Tags 264 MiB
83f2f78c11
Commit Graph

123 Commits

Author SHA1 Message Date
Allen Wittenauer
730bc746f9 HADOOP-12930. Dynamic subcommands for hadoop shell scripts (aw) 
This commit contains the following JIRA issues:

    HADOOP-12931. bin/hadoop work for dynamic subcommands
    HADOOP-12932. bin/yarn work for dynamic subcommands
    HADOOP-12933. bin/hdfs work for dynamic subcommands
    HADOOP-12934. bin/mapred work for dynamic subcommands
    HADOOP-12935. API documentation for dynamic subcommands
    HADOOP-12936. modify hadoop-tools to take advantage of dynamic subcommands
    HADOOP-13086. enable daemonization of dynamic commands
    HADOOP-13087. env var doc update for dynamic commands
    HADOOP-13088. fix shellprofiles in hadoop-tools to allow replacement
    HADOOP-13089. hadoop distcp adds client opts twice when dynamic
    HADOOP-13094. hadoop-common unit tests for dynamic commands
    HADOOP-13095. hadoop-hdfs unit tests for dynamic commands
    HADOOP-13107. clean up how rumen is executed
    HADOOP-13108. dynamic subcommands need a way to manipulate arguments
    HADOOP-13110. add a streaming subcommand to mapred
    HADOOP-13111. convert hadoop gridmix to be dynamic
    HADOOP-13115. dynamic subcommand docs should talk about exit vs. continue program flow
    HADOOP-13117. clarify daemonization and security vars for dynamic commands
    HADOOP-13120. add a --debug message when dynamic commands have been used
    HADOOP-13121. rename sub-project shellprofiles to match the rest of Hadoop
    HADOOP-13129. fix typo in dynamic subcommand docs
    HADOOP-13151. Underscores should be escaped in dynamic subcommands document
    HADOOP-13153. fix typo in debug statement for dynamic subcommands
 2016-05-16 17:54:45 -07:00
Allen Wittenauer
1c5bbf6499 HADOOP-12866. add a subcommand for gridmix (Kai Sasaki via aw) 2016-05-06 14:07:02 -07:00
Allen Wittenauer
35cf503149 HADOOP-13077. Handle special characters in passwords in httpfs.sh (Xiao Chen via aw) 2016-05-05 11:33:06 -07:00
Allen Wittenauer
971af603ea HADOOP-13045. hadoop_add_classpath is not working in .hadooprc 2016-04-30 12:23:51 -07:00
Ravi Prakash
2753185a01 HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano 2016-04-29 22:32:27 -07:00
Ravi Prakash
d6402faded Revert "HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano" 
This reverts commit 4838b735f0.
 2016-04-22 10:17:20 -07:00
Ravi Prakash
4838b735f0 HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano 2016-04-21 11:32:39 -07:00
Allen Wittenauer
0a74610d1c HADOOP-11393. Revert HADOOP_PREFIX, go back to HADOOP_HOME (aw) 2016-03-31 07:51:05 -07:00
Allen Wittenauer
738155063e HADOOP-12857. rework hadoop-tools (aw) 2016-03-23 13:46:38 -07:00
Arpit Agarwal
2e76c2f751 HADOOP-12070. Some of the bin/hadoop subcommands are not available on Windows. (Contributed by Kengo Seki) 2016-02-24 12:45:34 -08:00
Zhe Zhang
4ef1324ff6 HADOOP-12764. Increase default value of KMX maxHttpHeaderSize and make it configurable. 
Change-Id: I6e970563c201152e1428feafb8124e61c15a6fc0
 2016-02-10 09:56:40 -08:00
Haohui Mai
f0cd903866 HADOOP-12467. Respect user-defined JAVA_LIBRARY_PATH in Windows Hadoop scripts. Contributed by Radhey Shah. 2015-11-22 16:03:59 -08:00
Allen Wittenauer
b76b0ce51e HADOOP-12366. expose calculated paths (aw) 2015-11-07 08:32:56 -08:00
Varun Vasudev
73b9c7b82b HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. Contributed by Allen Wittenauer. 2015-11-04 15:56:17 +05:30
Allen Wittenauer
ded012e1d6 HADOOP-12493. bash unit tests are failing (aw) 2015-10-19 19:02:20 -07:00
Allen Wittenauer
56dc7773f8 HADOOP-12364. Deleting pid file after stop is causing the daemons to keep restarting (Sigi Li via aw) 2015-10-14 11:16:10 -07:00
Allen Wittenauer
a890a31529 HADOOP-10854. unit tests for the shell scripts (aw) 2015-07-31 14:34:48 -07:00
Allen Wittenauer
666cafca8d HADOOP-12249. pull argument parsing into a function (aw) 2015-07-31 14:32:21 -07:00
Allen Wittenauer
ee36f4f9b8 HADOOP-10979. Auto-entries in hadoop_usage (aw) 2015-07-16 16:58:11 -07:00
Allen Wittenauer
08ae87f6ba HADOOP-11983. HADOOP_USER_CLASSPATH_FIRST works the opposite of what it is supposed to do (Sangjin Lee via aw) 2015-05-28 11:29:58 -07:00
Allen Wittenauer
5df1fadf87 HADOOP-7947. Validate XMLs if a relevant tool is available, when using scripts (Kengo Seki via aw) 2015-05-28 11:01:00 -07:00
Allen Wittenauer
5504a261f8 HADOOP-11406. xargs -P is not portable (Kengo Seki via aw) 2015-05-28 10:36:40 -07:00
Akira Ajisaka
c7fea088f7 HADOOP-12014. hadoop-config.cmd displays a wrong error message. Contributed by Kengo Seki. 2015-05-22 14:15:08 +09:00
Vinayakumar B
ffbb574623 HADOOP-10993. Dump java command line to *.out file (Contributed by Kengo Seki) 2015-05-14 15:24:35 +05:30
Allen Wittenauer
b30ca8ce0e HADOOP-11553. Foramlize the shell API (aw) 2015-03-26 15:09:51 -07:00
cnauroth
4528eb9fb2 HADOOP-11524. hadoop_do_classpath_subcommand throws a shellcheck warning. Contributed by Chris Nauroth. 2015-03-25 22:36:09 -07:00
Allen Wittenauer
7711049837 HADOOP-11668. hadoop-daemons.sh bw compat broke with --slaves change (Vinayakumar B via aw) 2015-03-09 22:31:50 -07:00
Allen Wittenauer
01bfe6f05b HADOOP-11653. shellprofiles should require .sh extension (Brahma Reddy Battula via aw) 2015-03-06 13:54:11 -08:00
Allen Wittenauer
dce8b9c4d0 HADOOP-11637. bash location hard-coded in shell scripts (aw) 2015-02-26 09:29:16 -08:00
Allen Wittenauer
93b941c637 HADOOP-11565. Add --slaves shell option (aw) 2015-02-12 18:01:28 -08:00
Allen Wittenauer
58cb9f5293 HDFS-7322. deprecate sbin/hadoop-daemon.sh (aw) 2015-02-12 11:51:35 -08:00
cnauroth
67efab935e HADOOP-10140. Specification of HADOOP_CONF_DIR via the environment in hadoop_config.cmd. Contributed by Kiran Kumar M R. 2015-02-11 16:36:09 -08:00
Allen Wittenauer
cfd8a2174a HADOOP-11554. Expose HadoopKerberosName as a hadoop subcommand (aw) 2015-02-11 07:40:39 -08:00
Allen Wittenauer
5c79439568 HADOOP-11485. Pluggable shell integration (aw) 2015-02-06 13:09:01 -08:00
Tsuyoshi Ozawa
ec950be173 HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula. 2015-02-05 15:49:36 +09:00
Allen Wittenauer
43d5caef5e HADOOP-11460. Deprecate shell vars (John Smith via aw) 2015-02-04 16:35:50 -08:00
Arpit Agarwal
a6efbb21c2 HDFS-7591. hdfs classpath command should support same options as hadoop classpath. (Contributed by Varun Saxena) 2015-01-15 11:02:17 -08:00
cnauroth
8c3e888dcd HADOOP-11464. Reinstate support for launching Hadoop processes on Windows using Cygwin. Contributed by Chris Nauroth. 2015-01-09 15:01:50 -08:00
Allen Wittenauer
cd7d78914c HADOOP-11058. Missing HADOOP_CONF_DIR generates strange results (Masatake Iwasaki via aw) 2015-01-06 12:02:03 -08:00
Allen Wittenauer
0c45946e65 HADOOP-10788. Rewrite kms to use new shell framework (John Smith via aw) 2015-01-02 10:52:47 -08:00
Allen Wittenauer
bc21a1c07a HADOOP-11397. Can't override HADOOP_IDENT_STRING (Kengo Seki via aw) 2014-12-17 09:06:01 -08:00
Allen Wittenauer
8e9a266819 HADOOP-11353. Add support for .hadooprc (aw) 2014-12-11 09:00:35 -08:00
Allen Wittenauer
c536142699 HADOOP-6590. Add a username check for hadoop sub-commands (John Smith via aw) 2014-12-10 13:41:28 -08:00
Allen Wittenauer
a7c6c710b2 HADOOP-10950. rework heap management vars (John Smith via aw) 2014-12-10 13:37:32 -08:00
Vinayakumar B
92ce6eda92 HADOOP-11296. hadoop-daemons.sh throws 'host1: bash: host3: command not found...' (Contributed by Vinayakumar B) 2014-12-03 10:07:43 +05:30
Colin Patrick Mccabe
aa2f277256 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 2014-11-26 12:17:48 -08:00
Colin Patrick Mccabe
f95017b3ea Revert HADOOP-11257 because it didn't get a jenkins run yet 2014-11-14 13:06:03 -08:00
Colin Patrick Mccabe
10c98aed38 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 2014-11-14 12:53:09 -08:00
Allen Wittenauer
aee68b67f3 HADOOP-11150. hadoop command should show the reason on failure by invalid COMMAND or CLASSNAME (Masatake Iwasaki via aw) 2014-11-13 12:08:03 -08:00
Allen Wittenauer
b650e61a7f HADOOP-11298. slaves.sh and stop-all.sh are missing slashes (aw) 2014-11-13 12:01:38 -08:00