Weiwei Yang
|
e411dd6666
|
YARN-7607. Remove the trailing duplicated timestamp in container diagnostics message. Contributed by Weiwei Yang.
|
2017-12-07 17:29:40 +08:00 |
|
Weiwei Yang
|
05c347fe51
|
YARN-7611. Node manager web UI should display container type in containers page. Contributed by Weiwei Yang.
|
2017-12-06 12:21:52 +08:00 |
|
Arun Suresh
|
37ca416950
|
YARN-7587. Skip dispatching opportunistic containers to nodes whose queue is already full. (Weiwei Yang via asuresh)
|
2017-12-03 22:22:01 -08:00 |
|
Sunil G
|
81f6e46b2f
|
YARN-6907. Node information page in the old web UI should report resource types. Contributed by Gergely Novák.
|
2017-12-04 11:27:23 +05:30 |
|
Sunil G
|
30f2646b15
|
YARN-7594. TestNMWebServices#testGetNMResourceInfo fails on trunk. Contributed by Gergely Novák.
|
2017-12-04 10:45:07 +05:30 |
|
Jason Lowe
|
60f95fb719
|
YARN-7455. quote_and_append_arg can overflow buffer. Contributed by Jim Brennan
|
2017-12-01 15:47:01 -06:00 |
|
Wangda Tan
|
7225ec0ceb
|
YARN-6507. Add support in NodeManager to isolate FPGA devices with CGroups. (Zhankun Tang via wangda)
Change-Id: Ic9afd841805f1035423915a0b0add5f3ba96cf9d
|
2017-12-01 10:50:49 -08:00 |
|
Sunil G
|
556aea3f36
|
YARN-7487. Ensure volume to include GPU base libraries after created by plugin. Contributed by Wangda Tan.
|
2017-12-01 13:36:28 +05:30 |
|
Wangda Tan
|
c9a54aab6b
|
YARN-7573. Gpu Information page could be empty for nodes without GPU. (Sunil G via wangda)
Change-Id: I7f614e5a589a09ce4e4286c84b706e05c29abd14
|
2017-11-29 17:46:16 -08:00 |
|
Yufei Gu
|
d8923cdbf1
|
YARN-7363. ContainerLocalizer don't have a valid log4j config in case of Linux container executor. (Contributed by Yufei Gu)
|
2017-11-27 14:31:52 -08:00 |
|
Sunil G
|
aab439593b
|
YARN-7330. Add support to show GPU in UI including metrics. Contributed by Wangda Tan.
|
2017-11-23 07:54:20 +05:30 |
|
Eric Yang
|
d42a336cfa
|
YARN-5534. Allow user provided Docker volume mount list. (Contributed by Shane Kumpf)
|
2017-11-22 13:05:34 -05:00 |
|
Subru Krishnan
|
d5f66888b8
|
YARN-6128. Add support for AMRMProxy HA. (Botong Huang via Subru).
|
2017-11-17 17:39:06 -08:00 |
|
Junping Du
|
e14f03dfbf
|
YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi.
|
2017-11-13 15:27:37 -08:00 |
|
Arun Suresh
|
cb35a59589
|
YARN-7343. Add a junit test for ContainerScheduler recovery. (Sampada Dehankar via asuresh)
|
2017-11-08 08:14:02 -08:00 |
|
Jian He
|
a55d0738f1
|
YARN-7371. Added allocateRequestId in NMContainerStatus for recovery. Contributed by Chandni Singh
|
2017-11-06 13:30:20 -08:00 |
|
Billie Rinaldi
|
ce74e64363
|
YARN-7210. Some NPE fixes in Registry DNS. Contributed by Jian He
|
2017-11-06 13:30:16 -08:00 |
|
Jian He
|
8d335e59cf
|
YARN-6804. [yarn-native-services changes] Allow custom hostname for docker containers in native services. Contributed by Billie Rinaldi
|
2017-11-06 13:30:10 -08:00 |
|
Billie Rinaldi
|
ce05c6e981
|
YARN-6545. Followup fix for YARN-6405. Contributed by Jian He
|
2017-11-06 13:30:07 -08:00 |
|
bibinchundatt
|
dcd99c4b9a
|
Add containerId to Localizer failed logs. Contributed by Prabhu Joseph
|
2017-11-06 22:39:10 +05:30 |
|
Jason Lowe
|
d00b6f7c1f
|
YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger
|
2017-11-02 09:37:17 -05:00 |
|
Jian He
|
0cc98ae0ec
|
YARN-7396. NPE when accessing container logs due to null dirsHandler. Contributed by Jonathan Hung
|
2017-11-01 17:00:32 -07:00 |
|
Eric Yang
|
7a49ddfdde
|
YARN-7412. Fix unit test for docker mount check on ubuntu. (Contributed by Eric Badger)
|
2017-11-01 18:39:56 -04:00 |
|
Sunil G
|
9114d7a5a0
|
YARN-7224. Support GPU isolation for docker container. Contributed by Wangda Tan.
|
2017-10-29 11:08:44 +05:30 |
|
Arun Suresh
|
9c5c68745e
|
YARN-7299. Fix TestDistributedScheduler. (asuresh)
|
2017-10-27 23:08:18 -07:00 |
|
Jason Lowe
|
665bb147aa
|
YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla
|
2017-10-27 16:56:05 -05:00 |
|
Haibo Chen
|
480187aebb
|
YARN-7372. TestContainerSchedulerQueuing.testContainerUpdateExecTypeGuaranteedToOpportunistic is flaky.
|
2017-10-20 14:24:17 -07:00 |
|
Yufei Gu
|
0799fde35e
|
YARN-7261. Add debug message for better download latency monitoring. (Yufei Gu)
|
2017-10-20 10:00:13 -07:00 |
|
Eric Yang
|
b61144a93d
|
YARN-7353. Improved volume mount check for directories and unit test compatibility on RHEL7. Contributed by Eric Badger.
|
2017-10-20 12:02:06 -04:00 |
|
Wangda Tan
|
c1b08ba720
|
YARN-7345. GPU Isolation: Incorrect minor device numbers written to devices.deny file. (Jonathan Hung via wangda)
|
2017-10-19 14:45:44 -07:00 |
|
Nathan Roberts
|
4540ffd15f
|
YARN-7333. container-executor fails to remove entries from a directory that is not writable or executable. Contributed by Jason Lowe.
|
2017-10-16 17:00:38 -05:00 |
|
Arun Suresh
|
a50be1b8f4
|
YARN-7275. NM Statestore cleanup for Container updates. (Kartheek Muthyala via asuresh)
|
2017-10-16 13:12:15 -07:00 |
|
Sunil G
|
fa5cfc68f3
|
YARN-6620. Add support in NodeManager to isolate GPU devices by using CGroups. Contributed by Wangda Tan.
|
2017-10-11 23:44:33 +05:30 |
|
Haibo Chen
|
c071aad5da
|
YARN-7009. TestNMClient.testNMClientNoCleanupOnStop is flaky by design. (Miklos Szegedi via Haibo Chen)
|
2017-10-05 15:50:13 -07:00 |
|
Naganarasimha
|
d0046bb5c6
|
YARN-7285. ContainerExecutor always launches with priorities due to yarn-default property. Contributed by Jason Lowe.
|
2017-10-06 00:07:53 +05:30 |
|
Sunil G
|
592bf2d550
|
YARN-7279. Fix typo in helper message of ContainerLauncher. Contributed by Elek, Marton.
|
2017-10-05 10:52:00 +05:30 |
|
Akira Ajisaka
|
c9b525bd94
|
YARN-6943. Update Yarn to YARN in documentation. Contributed by Chetna Chaudhari.
|
2017-10-04 07:01:54 +09:00 |
|
Sidharta S
|
7eb8499996
|
YARN-7226. Whitelisted variables do not support delayed variable expansion. Contributed by Jason Lowe
|
2017-10-02 19:04:49 -07:00 |
|
Wangda Tan
|
febeead5f9
|
YARN-6550. Capture launch_container.sh logs to a separate log file. (Suma Shivaprasad via wangda)
Change-Id: I0ee0b1bb459437432a22cf68861a6354f0decabb
|
2017-09-29 16:39:46 -07:00 |
|
Wangda Tan
|
d3b1c63195
|
YARN-6623. Add support to turn off launching privileged containers in the container-executor. (Varun Vasudev via wangda)
Change-Id: I76aec68cbfb42d239279d7245a03290d691e87a4
|
2017-09-28 16:41:09 -07:00 |
|
Subru Krishnan
|
ca669f9f8b
|
YARN-6962. Add support for updateContainers when allocating using FederationInterceptor. (Botong Huang via Subru).
|
2017-09-28 13:04:03 -07:00 |
|
Jason Lowe
|
85d81ae58e
|
YARN-7248. NM returns new SCHEDULED container status to older clients. Contributed by Arun Suresh
|
2017-09-28 14:10:15 -05:00 |
|
Jason Lowe
|
14fec04ed3
|
Revert "YARN-6570. No logs were found for running application, running"
This reverts commit 7c732924a8.
|
2017-09-26 10:38:03 -05:00 |
|
Arun Suresh
|
df800f6cf3
|
YARN-7240. Add more states and transitions to stabilize the NM Container state machine. (Kartheek Muthyala via asuresh)
|
2017-09-25 16:02:55 -07:00 |
|
Jason Lowe
|
bfd1a72ba8
|
YARN-4266. Allow users to enter containers as UID:GID pair instead of by username. Contributed by luhuichun, Zhankun Tang, and Eric Badger.
|
2017-09-21 17:41:34 -05:00 |
|
Junping Du
|
e5e1851d80
|
YARN-7034. DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor. Contributed by Miklos Szegedi.
|
2017-09-21 14:01:16 -07:00 |
|
Jason Lowe
|
10d7493587
|
YARN-6968. Hardcoded absolute pathname in DockerLinuxContainerRuntime. Contributed by Eric Badger
|
2017-09-21 08:38:08 -05:00 |
|
Junping Du
|
647b7527a9
|
YARN-7186. Fix finicky TestContainerManager tests. Contributed by Arun Suresh.
|
2017-09-19 18:31:15 -07:00 |
|
Xuan
|
7c732924a8
|
YARN-6570. No logs were found for running application, running
container. Contributed by Junping Du
|
2017-09-18 14:04:05 -07:00 |
|
Jason Lowe
|
a4f9c7c924
|
YARN-7192. Add a pluggable StateMachine Listener that is notified of NM Container State changes. Contributed by Arun Suresh
|
2017-09-18 10:16:09 -05:00 |
|
Arun Suresh
|
66ca0a6540
|
YARN-6059. Update paused container state in the NM state store. (Hitesh Sharma via asuresh)
|
2017-09-14 08:51:26 -07:00 |
|
Arun Suresh
|
4f8194430f
|
YARN-5216. Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM. (Hitesh Sharma via asuresh)
|
2017-09-14 08:51:26 -07:00 |
|
Arun Suresh
|
864fbacd45
|
YARN-5292. NM Container lifecycle and state transitions to support for PAUSED container state. (Hitesh Sharma via asuresh)
|
2017-09-14 08:48:39 -07:00 |
|
Eric Payne
|
3860be7961
|
YARN-4727. Unable to override the $HADOOP_CONF_DIR env variable for container. Contributed by Jason Lowe.
|
2017-09-13 14:41:55 -05:00 |
|
Eric Payne
|
a3c44195be
|
Revert 'YARN-4727. Unable to override the $HADOOP_CONF_DIR env variable for container. Contributed by Jason Lowe.'
This reverts commit 729d05f529.
|
2017-09-13 14:38:58 -05:00 |
|
Eric Payne
|
729d05f529
|
YARN-4727. Unable to override the /home/ericp/run/conf/ env variable for container. Contributed by Jason Lowe.
|
2017-09-13 14:29:08 -05:00 |
|
Arun Suresh
|
a1c398e0dc
|
YARN-7185. [Addendum patch] Minor javadoc and checkstyle fix.
|
2017-09-12 17:03:32 -07:00 |
|
Arun Suresh
|
2ae72692fc
|
YARN-7185. ContainerScheduler should only look at availableResource for GUARANTEED containers when OPPORTUNISTIC container queuing is enabled. (Wangda Tan via asuresh)
|
2017-09-12 16:10:08 -07:00 |
|
Wangda Tan
|
e490602e9b
|
YARN-7039. Fix javac and javadoc errors in YARN-3926 branch. (Sunil G via wangda)
Change-Id: I442bf6d838b3aba83f1f6779cf9dcf8596a2102d
|
2017-09-12 09:19:12 -07:00 |
|
Varun Vasudev
|
759114b006
|
YARN-4830. Add support for resource types in the nodemanager. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Yufei Gu
|
5ab21dfe9c
|
YARN-6799. Remove the duplicated code in CGroupsHandlerImp.java. (Contributed by Weiyuan via Yufei Gu)
|
2017-09-10 23:17:59 -07:00 |
|
Junping Du
|
3fddabc2fe
|
YARN-7072. Add a new log aggregation file format controller. Contributed by Xuan Gong.
|
2017-09-08 15:16:19 -07:00 |
|
Arun Suresh
|
1f53ae7972
|
YARN-6849. NMContainerStatus should have the Container ExecutionType. (Kartheek Muthyala via asuresh)
|
2017-09-08 09:24:05 -07:00 |
|
Jason Lowe
|
b0b535d9d5
|
YARN-6930. Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager. Contributed by Shane Kumpf
|
2017-09-07 16:17:03 -05:00 |
|
Wangda Tan
|
f155ab7cfa
|
YARN-7033. Add support for NM Recovery of assigned resources (e.g. GPU's, NUMA, FPGA's) to container. (Devaraj K and Wangda Tan)
Change-Id: Iffd18bb95debe1c8cc55e30abc1d8f663e9d0e30
|
2017-09-07 14:13:37 -07:00 |
|
Allen Wittenauer
|
0adc3a0533
|
YARN-6721. container-executor should have stack checking
Signed-off-by: Chris Douglas <cdouglas@apache.org>
|
2017-08-31 19:39:31 -07:00 |
|
Junping Du
|
91cc070d67
|
YARN-6877. Create an abstract log reader for extendability. Contributed by Xuan Gong.
|
2017-08-31 16:41:43 -07:00 |
|
Allen Wittenauer
|
71bbb86d69
|
HADOOP-14670. Increase minimum cmake version for all platforms
Signed-off-by: Chris Douglas <cdouglas@apache.org>
|
2017-08-30 21:47:24 -07:00 |
|
Varun Saxena
|
3d00c8f394
|
Made fixes for whitespace errors and checstyle warnings before merge.
|
2017-08-30 11:29:54 +05:30 |
|
Jian He
|
08f40bcc7f
|
MAPREDUCE-6838. [ATSv2 Security] Add timeline delegation token received in allocate response to UGI. Contributed by Varun Saxena
|
2017-08-30 11:29:54 +05:30 |
|
Haibo Chen
|
9b08f365d7
|
YARN-6323. Rolling upgrade/config change is broken on timeline v2. (Vrushali C via Haibo Chen)
|
2017-08-30 11:29:54 +05:30 |
|
Rohith Sharma K S
|
32188d3295
|
YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena.
|
2017-08-30 11:29:54 +05:30 |
|
Jian He
|
b664569586
|
YARN-7006. [ATSv2 Security] Changes for authentication for CollectorNodemanagerProtocol. Contributed by Varun Saxena
|
2017-08-30 11:29:53 +05:30 |
|
Rohith Sharma K S
|
7594d1de7b
|
YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena.
|
2017-08-30 11:29:53 +05:30 |
|
Haibo Chen
|
a8f082a180
|
YARN-6555. Store application flow context in NM state store for work-preserving restart. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit 47474fffac)
|
2017-08-30 11:29:52 +05:30 |
|
Sangjin Lee
|
092fead5d9
|
YARN-5792. Adopt the id prefix for YARN, MR, and DS entities. Contributed by Varun Saxena.
|
2017-08-30 11:29:51 +05:30 |
|
Varun Saxena
|
c92a7ab31c
|
YARN-3359. Addendum for Recover collector list when RM fails over (Li Lu via Varun Saxena)
|
2017-08-30 11:29:51 +05:30 |
|
Varun Saxena
|
91d3443806
|
YARN-3359. Recover collector list when RM fails over (Li Lu via Varun Saxena)
|
2017-08-30 11:29:51 +05:30 |
|
Sangjin Lee
|
78b7e070d8
|
YARN-5638. Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery. Contributed by Li Lu.
|
2017-08-30 11:29:50 +05:30 |
|
Sangjin Lee
|
278bd6fcff
|
YARN-5156. YARN_CONTAINER_FINISHED of YARN_CONTAINERs will always have running state (Vrushali C via sjlee)
|
2017-08-30 11:29:50 +05:30 |
|
Wangda Tan
|
f59332b97b
|
YARN-5219. When an export var command fails in launch_container.sh, the full container launch should fail. (Sunil G via wangda)
Change-Id: Iaa6b978bb89482e9d1d77ba57f4adfdc48e39a3c
|
2017-08-29 15:29:22 -07:00 |
|
Junping Du
|
ad45d19998
|
YARN-7037. Optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices. Contributed by Tao Yang.
|
2017-08-29 15:16:23 -07:00 |
|
Yufei Gu
|
d5bc958279
|
YARN-7099. ResourceHandlerModule.parseConfiguredCGroupPath only works for privileged yarn users. (Contributed by Miklos Szegedi via Yufei Gu)
|
2017-08-28 10:09:46 -07:00 |
|
Li Lu
|
3bee7046c5
|
YARN-6999. Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster. (Linlin Zhou via gtcarrera9)
|
2017-08-25 22:43:25 -07:00 |
|
Eric Payne
|
e864f81471
|
YARN-7087. NM failed to perform log aggregation due to absent container. Contributed by Jason Lowe.
|
2017-08-25 15:37:54 -05:00 |
|
Junping Du
|
c2cb7ea1ef
|
YARN-6876. Create an abstract log writer for extendability. Contributed by Xuan Gong.
|
2017-08-24 13:36:49 -07:00 |
|
bibinchundatt
|
de0cba700b
|
YARN-7074. Fix NM state store update comment. Contributed by Botong Huang
|
2017-08-24 16:34:38 +05:30 |
|
Akira Ajisaka
|
d5ff57a08f
|
YARN-7047. Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager. Contributed by Yeliang Cang.
|
2017-08-22 17:14:12 +09:00 |
|
Arun Suresh
|
7a82d7bcea
|
YARN-6979. [Addendum patch] Fixed classname and added javadocs. (Kartheek Muthyala via asuresh)
|
2017-08-20 10:24:05 -07:00 |
|
Arun Suresh
|
8410d862d3
|
YARN-6979. Add flag to notify all types of container updates to NM via NodeHeartbeatResponse. (Kartheek Muthyala via asuresh)
|
2017-08-20 07:54:09 -07:00 |
|
Wangda Tan
|
436c2638f9
|
YARN-6852. Native code changes to support isolate GPU devices by using CGroups. (wangda)
Change-Id: I4869cc4d8ad539539ccba4bea5a178cacdb741ab
|
2017-08-18 18:26:36 -07:00 |
|
Jason Lowe
|
ab1a8ae85f
|
YARN-6988. container-executor fails for docker when command length > 4096 B. Contributed by Eric Badger
|
2017-08-17 15:50:14 -05:00 |
|
Sunil G
|
f9a0e23381
|
YARN-3254. HealthReport should include disk full information. Contributed by Suma Shivaprasad.
|
2017-08-17 15:07:15 +05:30 |
|
Nathan Roberts
|
d265459024
|
YARN-7014. Fix off-by-one error causing heap corruption (Jason Lowe via nroberts)
|
2017-08-15 15:52:48 -05:00 |
|
Arun Suresh
|
4d7be1d857
|
YARN-5978. ContainerScheduler and ContainerManager changes to support ExecType update. (Kartheek Muthyala via asuresh)
|
2017-08-14 19:46:17 -07:00 |
|
Karthik Kambatla
|
8c4b6d16a5
|
YARN-5927. BaseContainerManagerTest::waitForNMContainerState timeout accounting is not accurate. (Kai Sasaki via kasha)
|
2017-08-11 12:15:43 -07:00 |
|
Wangda Tan
|
ec694145cf
|
YARN-6033. Add support for sections in container-executor configuration file. (Varun Vasudev via wandga)
Change-Id: Ibc6d2a959debe5d8ff2b51504149742449d1f1da
|
2017-08-09 10:51:29 -07:00 |
|
Akira Ajisaka
|
1a18d5e514
|
YARN-6515. Fix warnings from Spotbugs in hadoop-yarn-server-nodemanager. Contributed by Naganarasimha G R.
|
2017-08-09 21:56:43 +09:00 |
|
Wangda Tan
|
1794de3ea4
|
YARN-6726. Fix issues with docker commands executed by container-executor. (Shane Kumpf via wangda)
Change-Id: If1b1827345f98f0a49cc7e39d1ba41fbeed5e911
|
2017-08-08 12:56:29 -07:00 |
|
Daniel Templeton
|
47b145b9b4
|
YARN-6757. Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path
(Contributed by Miklos Szegedi via Daniel Templeton)
|
2017-08-08 10:33:26 -07:00 |
|