big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
21,169 Commits 2 Branches 2 Tags 264 MiB
3dc2523266
Commit Graph

27 Commits

Author SHA1 Message Date
Akira Ajisaka
1129288cf5
HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki. 2019-01-29 18:29:56 -08:00
Weiwei Yang
a4bd64e724 YARN-9116. Capacity Scheduler: implements queue level maximum-allocation inheritance. Contributed by Aihua Xu. 2019-01-24 17:53:43 +08:00
Eric Yang
824dfa3b09 YARN-8489. Support "dominant" component concept in YARN service. 
Contributed by Zac Zhou
 2019-01-18 20:23:04 -05:00
Wangda Tan
2c02aa6ec2 YARN-9160. [Submarine] Document 'PYTHONPATH' environment variable setting when using -localization options. (Zhankun Tang via wangda) 
Change-Id: I115b6710eb11501e21ab3e9e7cd1a87f322e5cf8
 2019-01-06 10:25:35 -08:00
Wangda Tan
8f004fe4e0 YARN-9141. [Submarine] JobStatus outputs with system UTC clock, not local clock. (Zac Zhou via wangda) 
Change-Id: Ib2b17cf7860ddc9188f06498086de3326bc09519
 2019-01-06 10:24:29 -08:00
Sunil G
742fd978b5 YARN-9090. [Submarine] Update submarine installation script document. Contributed by Xun Liu. 2018-12-26 08:26:48 +05:30
Wangda Tan
9fba6cc247 YARN-9112. [Submarine] Support polling applicationId when it's not ready in cluster. (Zhankun Tang via wangda) 
Change-Id: I73d73f3d631b28fb9866faa56571839b13824a97
 2018-12-12 11:44:58 -08:00
Wangda Tan
c771fe6e10 YARN-8714. [Submarine] Support files/tarballs to be localized for a training job. (Zhankun Tang via wangda) 
Change-Id: I845131273e52a9d81dbc813ea6d4af06b205e334
 2018-12-12 11:43:23 -08:00
Wangda Tan
8a5361116e YARN-9078. [Submarine] Clean up the code of CliUtils#parseResourcesString. (Zhankun Tang via wangda) 
Change-Id: I21ac5757b6115d55ec3157ba25db1b65bc85a37b
 2018-12-12 11:42:44 -08:00
Wangda Tan
228156cfd1 Revert "YARN-8870. [Submarine] Add submarine installation scripts. (Xun Liu via wangda)" 
This reverts commit 46d6e00166.
 2018-12-04 14:13:06 -08:00
Wangda Tan
897643928c YARN-8975. [Submarine] Use predefined Charset object StandardCharsets.UTF_8 instead of String UTF-8. (Zhankun Tang via wangda) 
Change-Id: If6c7904aa17895e543cfca245264249eb7328bdc
 2018-11-28 14:39:06 -08:00
Wangda Tan
8b23814415 YARN-8960. [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment. (Zac Zhou via wangda) 
Change-Id: I21b1addc9c32817650ea744a8f2e6b5602f2f4d4
 2018-11-19 08:55:30 -08:00
Wangda Tan
fcbd205cc3 YARN-9001. [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs. (Zac Zhou via wangda) 
Change-Id: Ic3d6c1e439df9cdf74448b345b925343224efe51
 2018-11-13 13:13:27 -08:00
Wangda Tan
076b795b2e YARN-8918. [Submarine] Correct method usage of str.subString in CliUtils. (Zhankun Tang via wangda) 
Change-Id: Id1f11dbab3aa838dee3a0ec8b8fd5dc32f5dd946
 2018-11-13 11:24:15 -08:00
Giovanni Matteo Fumarola
e269c3fb5a YARN-8997. [Submarine] Small refactors of modifier, condition check and redundant local variables. Contributed by Zhankun Tang. 2018-11-12 15:06:43 -08:00
Wangda Tan
143d74775b YARN-8798. [Submarine] Job should not be submitted if --input_path option is missing. (Zhankun Tang via wangda) 
Change-Id: I7ae0e44eb5179b04a6ac861ec1c65f3b18c38f0f
 2018-10-16 13:51:02 -07:00
Wangda Tan
46d6e00166 YARN-8870. [Submarine] Add submarine installation scripts. (Xun Liu via wangda) 
Change-Id: I46e8d9fd32c7745c313030da62da41486a77b3ea
 2018-10-16 13:51:02 -07:00
Wangda Tan
ed08dd3b0c YARN-8875. [Submarine] Add documentation for submarine installation script details. (Xun Liu via wangda) 
Change-Id: I1c8d39c394e5a30f967ea514919835b951f2c124
 2018-10-16 13:51:01 -07:00
Wangda Tan
a23ea68b97 YARN-8852. Add documentation for submarine installation details. (Zac Zhou via wangda) 
Change-Id: If5681d1ef37ff5dc916735eeef15a6120173d653
 2018-10-09 10:18:27 -07:00
Vidura Mudalige
b85ee0d75d
YARN-8819. Fix findbugs warnings in YarnServiceUtils 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-10-07 00:53:53 +09:00
Sunil G
58fa96b697 Changed version in trunk to 3.3.0-SNAPSHOT. 2018-10-02 22:41:41 +05:30
Sunil G
19ad5be651 YARN-8800. Updated documentation of Submarine with latest examples. Contributed by Wangda Tan. 2018-09-29 00:01:04 +05:30
Sunil G
d0bc6a27fd YARN-8817. [Submarine] In cases when user doesn't ask HDFS path while submitting job but framework requires user to set HDFS related environments. Contributed by Wangda Tan. 2018-09-25 11:23:34 +05:30
Sunil G
0cd6346102 YARN-8769. [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job. Contributed by Wangda Tan. 2018-09-21 23:39:22 +05:30
Sunil G
1824d5d1c4 YARN-8757. [Submarine] Add Tensorboard component when --tensorboard is specified. Contributed by Wangda Tan. 2018-09-19 22:18:55 +05:30
Wangda Tan
de85f841da YARN-8698. [Submarine] Failed to reset Hadoop home environment when submitting a submarine job. (Zac Zhou via wangda) 
Change-Id: If7fdc11fcc4e49bed2186ded76cd69164f34f502
 2018-09-09 17:45:31 -07:00
Sunil G
cadbc8b57f YARN-8561. [Submarine] Initial implementation: Training job submission and job history retrieval. Contributed by Wangda Tan. 2018-08-13 14:22:55 +05:30