big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
20,124 Commits 2 Branches 2 Tags 264 MiB
d0bc6a27fd
Commit Graph

381 Commits

Author SHA1 Message Date
Sunil G
d0bc6a27fd YARN-8817. [Submarine] In cases when user doesn't ask HDFS path while submitting job but framework requires user to set HDFS related environments. Contributed by Wangda Tan. 2018-09-25 11:23:34 +05:30
Sunil G
0cd6346102 YARN-8769. [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job. Contributed by Wangda Tan. 2018-09-21 23:39:22 +05:30
Sunil G
1824d5d1c4 YARN-8757. [Submarine] Add Tensorboard component when --tensorboard is specified. Contributed by Wangda Tan. 2018-09-19 22:18:55 +05:30
Sunil G
33d8327cff YARN-8715. Make allocation tags in the placement spec optional for node-attributes. Contributed by Weiwei Yang. 2018-09-17 10:07:45 +05:30
Andrew Purtell
568ebecdf4
YARN-8772. Annotation javax.annotation.Generated has moved 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-09-14 15:02:52 +09:00
Naganarasimha
67ae81f0e0 YARN-7863. Modify placement constraints to support node attributes. Contributed by Sunil Govindan. 2018-09-12 16:01:01 +05:30
Wangda Tan
de85f841da YARN-8698. [Submarine] Failed to reset Hadoop home environment when submitting a submarine job. (Zac Zhou via wangda) 
Change-Id: If7fdc11fcc4e49bed2186ded76cd69164f34f502
 2018-09-09 17:45:31 -07:00
Giovanni Matteo Fumarola
16333782c1 HADOOP-15731. TestDistributedShell fails on Windows. Contributed by Botong Huang. 2018-09-07 14:19:10 -07:00
bibinchundatt
eed8415dc1 YARN-8535. Fix DistributedShell unit tests. Contributed by Abhishek Modi. 2018-09-02 13:35:52 +05:30
Eric Yang
fd089caf69 YARN-8488. Added SUCCEEDED/FAILED states to YARN service. 
Contributed by Suma Shivaprasad
 2018-08-28 13:55:28 -04:00
Eric Yang
e557c6bd8d YARN-8298. Added express upgrade for YARN service. 
Contributed by Chandni Singh
 2018-08-21 19:49:26 -04:00
Eric Yang
8990eaf592 YARN-8474. Fixed ApiServiceClient kerberos negotiation. 
Contributed by Billie Rinaldi
 2018-08-16 12:46:37 -04:00
Eric Yang
4cba0741d5 YARN-8160. Support upgrade of service that use docker containers. 
Contributed by Chandni Singh
 2018-08-14 11:36:26 -04:00
Sunil G
cadbc8b57f YARN-8561. [Submarine] Initial implementation: Training job submission and job history retrieval. Contributed by Wangda Tan. 2018-08-13 14:22:55 +05:30
Wangda Tan
861095f761 YARN-8407. Container launch exception in AM log should be printed in ERROR level. (Yesha Vora via wangda) 
Change-Id: I154e873df1df3503a09c41d6b3874ca195af91d9
 2018-08-07 13:01:13 -07:00
Eric Yang
23f394240e YARN-8610. Fixed initiate upgrade error message. 
Contributed by Chandni Singh
 2018-08-01 20:41:43 -04:00
Eric Yang
c7ebcd76bf YARN-8579. Recover NMToken of previous attempted component data. 
Contributed by Gour Saha
 2018-07-31 18:01:02 -04:00
Billie Rinaldi
b429f19d32 YARN-8571. Validate service principal format prior to launching yarn service. Contributed by Eric Yang 2018-07-27 11:30:19 -07:00
Eric Yang
8d3c068e59 YARN-8429. Improve diagnostic message when artifact is not set properly. 
Contributed by Gour Saha
 2018-07-26 20:02:13 -04:00
Eric Yang
40fad32824 YARN-8545. Return allocated resource to RM for failed container. 
Contributed by Chandni Singh
 2018-07-26 18:22:57 -04:00
Eric Yang
84d7bf1eef YARN-8360. Improve YARN service restart policy and node manager auto restart policy. 
Contributed by Suma Shivaprasad
 2018-07-23 12:57:01 -04:00
Eric Yang
121865c3f9 YARN-8299. Added CLI and REST API for query container status. 
Contributed by Chandni Singh
 2018-07-16 17:41:23 -04:00
bibinchundatt
52e1bc8539 YARN-8491. TestServiceCLI#testEnableFastLaunch fail when umask is 077. Contributed by K G Bakthavachalam. 2018-07-11 16:20:29 +05:30
Eric Yang
9f15483c5d YARN-8445. Improved error message for duplicated service and component names. 
Contributed by Chandni Singh
 2018-06-21 11:20:24 -04:00
Eric Yang
69b0596897 YARN-8411. Restart stopped system service during RM start. 
Contributed by Billie Rinaldi
 2018-06-13 19:05:52 -04:00
Akira Ajisaka
652bcbb3e4
YARN-8363. Upgrade commons-lang version to 3.7 in hadoop-yarn-project. Contributed by Takanobu Asanuma. 2018-06-13 00:35:37 +09:00
Billie Rinaldi
31998643a5 YARN-8342. Enable untrusted docker image to run with launch command. Contributed by Eric Yang 2018-06-02 14:46:32 -07:00
Wangda Tan
ff583d3fa3 YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda) 
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
 2018-06-01 14:49:18 -07:00
Wangda Tan
8956e5b8db YARN-8372. Distributed shell app master should not release containers when shutdown if keep-container is true. (Suma Shivaprasad via wangda) 
Change-Id: Ief04d1ca865621f348fba4ac85fa78bc47465904
 2018-06-01 14:49:18 -07:00
Eric Yang
7dd26d5378 YARN-8308. Fixed YARN Service AM failure with HDFS token renewal. 
Contributed by Gour Saha
 2018-05-31 21:09:36 -04:00
Billie Rinaldi
778a4a24be YARN-8350. NPE in service AM related to placement policy. Contributed by Gour Saha 2018-05-30 13:19:13 -07:00
Billie Rinaldi
96eefcc84a YARN-8368. yarn app start cli should print applicationId. Contributed by Rohith Sharma K S 2018-05-30 12:37:43 -07:00
Wangda Tan
3061bfcde5 YARN-8339. Service AM should localize static/archive resource types to container working directory instead of 'resources'. (Suma Shivaprasad via wangda) 
Change-Id: I9f8e8f621650347f6c2f9e3420edee9eb2f356a4
 2018-05-29 09:23:11 -07:00
Eric Yang
d9852eb589 YARN-8357. Fixed NPE when YARN service is saved and not deployed. 
Contributed by Chandni Singh
 2018-05-24 16:32:13 -04:00
Eric Yang
a23ff8d880 YARN-7530. Refactored YARN service API project location. 
Contributed by Chandni Singh
 2018-05-18 17:29:10 -04:00
Eric Yang
2f2dd22aad YARN-8296. Removed unique_component_support from YARN services. 
Contributed by Suma Shivaprasad
 2018-05-17 20:58:13 -04:00
Eric Yang
989cfdc1e0 YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag. 
Contributed by Chandni Singh
 2018-05-17 20:56:04 -04:00
Eric Yang
d45a0b7d73 YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag. 
Contributed by Chandni Singh
 2018-05-17 17:29:34 -04:00
Eric Yang
7f083ed869 YARN-8080. Add restart policy for YARN services. 
Contributed by Suma Shivaprasad
 2018-05-17 17:16:50 -04:00
Eric Yang
91357c22ef YARN-8300. Fixed NPE in DefaultUpgradeComponentsFinder. 
Contributed by Suma Shivaprasad
 2018-05-16 12:38:26 -04:00
Eric Yang
8d3b39de89 YARN-8081. Add support to upgrade a component. 
Contributed by Chandni Singh
 2018-05-15 20:40:39 -04:00
Sunil G
58b97c79e3 YARN-8236. Invalid kerberos principal file name cause NPE in native service. Contributed by Gour Saha. 2018-05-15 12:17:35 +05:30
Eric Yang
0ff94563b9 YARN-8265. Improve DNS handling on docker IP changes. 
Contributed by Billie Rinaldi
 2018-05-11 22:37:43 -07:00
Jason Lowe
6c8e51ca7e YARN-7654. Support ENTRY_POINT for docker container. Contributed by Eric Yang 2018-05-11 18:56:05 -05:00
Billie Rinaldi
ca612e353f YARN-8243. Flex down should remove instance with largest component instance ID first. Contributed by Gour Saha 2018-05-11 12:49:05 -07:00
Billie Rinaldi
1ef0a1db1d YARN-7894. Improve ATS response for DShell DS_CONTAINER when container launch fails. Contributed by Chandni Singh 2018-05-08 13:49:41 -07:00
Billie Rinaldi
6795f8072f YARN-8079. Support static and archive unmodified local resources in service AM. Contributed by Suma Shivaprasad 2018-05-04 09:27:07 -07:00
Eric Yang
7698737207 YARN-8226. Improved anti-affinity description in YARN Service doc. 
Contributed by Gour Saha
 2018-05-03 13:35:40 -04:00
Eric Yang
7fe3214d4b YARN-7961. Improve status message for YARN service. 
Contributed by Gour Saha
 2018-05-03 13:27:07 -04:00
Eric Yang
24eeea8b18 YARN-7799. Improved YARN service jar file handling. 
Contributed by Billie Rinaldi
 2018-05-01 16:46:34 -04:00