Arun Suresh
|
1f53ae7972
|
YARN-6849. NMContainerStatus should have the Container ExecutionType. (Kartheek Muthyala via asuresh)
|
2017-09-08 09:24:05 -07:00 |
|
Jason Lowe
|
b0b535d9d5
|
YARN-6930. Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager. Contributed by Shane Kumpf
|
2017-09-07 16:17:03 -05:00 |
|
Wangda Tan
|
f155ab7cfa
|
YARN-7033. Add support for NM Recovery of assigned resources (e.g. GPU's, NUMA, FPGA's) to container. (Devaraj K and Wangda Tan)
Change-Id: Iffd18bb95debe1c8cc55e30abc1d8f663e9d0e30
|
2017-09-07 14:13:37 -07:00 |
|
Andrew Wang
|
0d419c984f
|
Preparing for 3.1.0 development
|
2017-09-01 11:53:48 -07:00 |
|
Allen Wittenauer
|
0adc3a0533
|
YARN-6721. container-executor should have stack checking
Signed-off-by: Chris Douglas <cdouglas@apache.org>
|
2017-08-31 19:39:31 -07:00 |
|
Junping Du
|
91cc070d67
|
YARN-6877. Create an abstract log reader for extendability. Contributed by Xuan Gong.
|
2017-08-31 16:41:43 -07:00 |
|
Allen Wittenauer
|
71bbb86d69
|
HADOOP-14670. Increase minimum cmake version for all platforms
Signed-off-by: Chris Douglas <cdouglas@apache.org>
|
2017-08-30 21:47:24 -07:00 |
|
Varun Saxena
|
3d00c8f394
|
Made fixes for whitespace errors and checstyle warnings before merge.
|
2017-08-30 11:29:54 +05:30 |
|
Jian He
|
08f40bcc7f
|
MAPREDUCE-6838. [ATSv2 Security] Add timeline delegation token received in allocate response to UGI. Contributed by Varun Saxena
|
2017-08-30 11:29:54 +05:30 |
|
Haibo Chen
|
9b08f365d7
|
YARN-6323. Rolling upgrade/config change is broken on timeline v2. (Vrushali C via Haibo Chen)
|
2017-08-30 11:29:54 +05:30 |
|
Rohith Sharma K S
|
32188d3295
|
YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena.
|
2017-08-30 11:29:54 +05:30 |
|
Jian He
|
b664569586
|
YARN-7006. [ATSv2 Security] Changes for authentication for CollectorNodemanagerProtocol. Contributed by Varun Saxena
|
2017-08-30 11:29:53 +05:30 |
|
Rohith Sharma K S
|
7594d1de7b
|
YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena.
|
2017-08-30 11:29:53 +05:30 |
|
Haibo Chen
|
a8f082a180
|
YARN-6555. Store application flow context in NM state store for work-preserving restart. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit 47474fffac)
|
2017-08-30 11:29:52 +05:30 |
|
Sangjin Lee
|
092fead5d9
|
YARN-5792. Adopt the id prefix for YARN, MR, and DS entities. Contributed by Varun Saxena.
|
2017-08-30 11:29:51 +05:30 |
|
Varun Saxena
|
c92a7ab31c
|
YARN-3359. Addendum for Recover collector list when RM fails over (Li Lu via Varun Saxena)
|
2017-08-30 11:29:51 +05:30 |
|
Varun Saxena
|
91d3443806
|
YARN-3359. Recover collector list when RM fails over (Li Lu via Varun Saxena)
|
2017-08-30 11:29:51 +05:30 |
|
Sangjin Lee
|
78b7e070d8
|
YARN-5638. Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery. Contributed by Li Lu.
|
2017-08-30 11:29:50 +05:30 |
|
Sangjin Lee
|
278bd6fcff
|
YARN-5156. YARN_CONTAINER_FINISHED of YARN_CONTAINERs will always have running state (Vrushali C via sjlee)
|
2017-08-30 11:29:50 +05:30 |
|
Wangda Tan
|
f59332b97b
|
YARN-5219. When an export var command fails in launch_container.sh, the full container launch should fail. (Sunil G via wangda)
Change-Id: Iaa6b978bb89482e9d1d77ba57f4adfdc48e39a3c
|
2017-08-29 15:29:22 -07:00 |
|
Junping Du
|
ad45d19998
|
YARN-7037. Optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices. Contributed by Tao Yang.
|
2017-08-29 15:16:23 -07:00 |
|
Yufei Gu
|
d5bc958279
|
YARN-7099. ResourceHandlerModule.parseConfiguredCGroupPath only works for privileged yarn users. (Contributed by Miklos Szegedi via Yufei Gu)
|
2017-08-28 10:09:46 -07:00 |
|
Li Lu
|
3bee7046c5
|
YARN-6999. Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster. (Linlin Zhou via gtcarrera9)
|
2017-08-25 22:43:25 -07:00 |
|
Eric Payne
|
e864f81471
|
YARN-7087. NM failed to perform log aggregation due to absent container. Contributed by Jason Lowe.
|
2017-08-25 15:37:54 -05:00 |
|
Junping Du
|
c2cb7ea1ef
|
YARN-6876. Create an abstract log writer for extendability. Contributed by Xuan Gong.
|
2017-08-24 13:36:49 -07:00 |
|
bibinchundatt
|
de0cba700b
|
YARN-7074. Fix NM state store update comment. Contributed by Botong Huang
|
2017-08-24 16:34:38 +05:30 |
|
Akira Ajisaka
|
d5ff57a08f
|
YARN-7047. Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager. Contributed by Yeliang Cang.
|
2017-08-22 17:14:12 +09:00 |
|
Arun Suresh
|
7a82d7bcea
|
YARN-6979. [Addendum patch] Fixed classname and added javadocs. (Kartheek Muthyala via asuresh)
|
2017-08-20 10:24:05 -07:00 |
|
Arun Suresh
|
8410d862d3
|
YARN-6979. Add flag to notify all types of container updates to NM via NodeHeartbeatResponse. (Kartheek Muthyala via asuresh)
|
2017-08-20 07:54:09 -07:00 |
|
Wangda Tan
|
436c2638f9
|
YARN-6852. Native code changes to support isolate GPU devices by using CGroups. (wangda)
Change-Id: I4869cc4d8ad539539ccba4bea5a178cacdb741ab
|
2017-08-18 18:26:36 -07:00 |
|
Jason Lowe
|
ab1a8ae85f
|
YARN-6988. container-executor fails for docker when command length > 4096 B. Contributed by Eric Badger
|
2017-08-17 15:50:14 -05:00 |
|
Sunil G
|
f9a0e23381
|
YARN-3254. HealthReport should include disk full information. Contributed by Suma Shivaprasad.
|
2017-08-17 15:07:15 +05:30 |
|
Nathan Roberts
|
d265459024
|
YARN-7014. Fix off-by-one error causing heap corruption (Jason Lowe via nroberts)
|
2017-08-15 15:52:48 -05:00 |
|
Arun Suresh
|
4d7be1d857
|
YARN-5978. ContainerScheduler and ContainerManager changes to support ExecType update. (Kartheek Muthyala via asuresh)
|
2017-08-14 19:46:17 -07:00 |
|
Karthik Kambatla
|
8c4b6d16a5
|
YARN-5927. BaseContainerManagerTest::waitForNMContainerState timeout accounting is not accurate. (Kai Sasaki via kasha)
|
2017-08-11 12:15:43 -07:00 |
|
Wangda Tan
|
ec694145cf
|
YARN-6033. Add support for sections in container-executor configuration file. (Varun Vasudev via wandga)
Change-Id: Ibc6d2a959debe5d8ff2b51504149742449d1f1da
|
2017-08-09 10:51:29 -07:00 |
|
Akira Ajisaka
|
1a18d5e514
|
YARN-6515. Fix warnings from Spotbugs in hadoop-yarn-server-nodemanager. Contributed by Naganarasimha G R.
|
2017-08-09 21:56:43 +09:00 |
|
Wangda Tan
|
1794de3ea4
|
YARN-6726. Fix issues with docker commands executed by container-executor. (Shane Kumpf via wangda)
Change-Id: If1b1827345f98f0a49cc7e39d1ba41fbeed5e911
|
2017-08-08 12:56:29 -07:00 |
|
Daniel Templeton
|
47b145b9b4
|
YARN-6757. Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path
(Contributed by Miklos Szegedi via Daniel Templeton)
|
2017-08-08 10:33:26 -07:00 |
|
Arun Suresh
|
8d3fd81980
|
YARN-6920. Fix resource leak that happens during container re-initialization. (asuresh)
|
2017-08-07 18:59:25 -07:00 |
|
Subru Krishnan
|
c61f2c4198
|
YARN-6955. Handle concurrent register AM requests in FederationInterceptor. (Botong Huang via Subru).
|
2017-08-07 16:58:29 -07:00 |
|
Sunil G
|
46b7054fa7
|
YARN-6951. Fix debug log when Resource Handler chain is enabled. Contributed by Yang Wang.
|
2017-08-07 13:15:46 +05:30 |
|
Arun Suresh
|
35dc782923
|
YARN-5977. ContainerManagementProtocol changes to support change of container ExecutionType. (Kartheek Muthyala via asuresh)
|
2017-08-03 21:15:40 -07:00 |
|
Yufei Gu
|
c617fe02b3
|
YARN-6832. Tests use assertTrue(....equals(...)) instead of assertEquals()). (Daniel Templeton via Yufei Gu)
|
2017-08-03 11:33:37 -07:00 |
|
Haibo Chen
|
293c74a81b
|
YARN-6673 Add cpu cgroup configurations for opportunistic containers. (Miklos Szegedi via Haibo Chen)
|
2017-08-03 09:56:51 -07:00 |
|
Haibo Chen
|
c5d256c760
|
YARN-6674 Add memory cgroup settings for opportunistic containers. (Miklos Szegedi via Haibo Chen)
|
2017-08-03 09:52:35 -07:00 |
|
Eric Payne
|
48899134d2
|
YARN-6846. Nodemanager can fail to fully delete application local directories when applications are killed. Contributed by Jason Lowe.
|
2017-08-02 10:59:33 -05:00 |
|
Subru Krishnan
|
70b1a757f1
|
YARN-6511. Federation: transparently spanning application across multiple sub-clusters. (Botong Huang via Subru).
(cherry picked from commit 8c988d235eaf0972783985b1ab24680d029aea79)
|
2017-08-01 17:28:26 -07:00 |
|
Subru Krishnan
|
bed1832c93
|
YARN-3666. Federation Intercepting and propagating AM- home RM communications. (Botong Huang via Subru).
(cherry picked from commit 2399eb8200609246cb623c74450ca4a2032063cc)
|
2017-08-01 17:28:25 -07:00 |
|
Subru Krishnan
|
859aa1f9d6
|
YARN-5531. UnmanagedAM pool manager for federating application across clusters. (Botong Huang via Subru).
(cherry picked from commit 73bb2102ce4b82b3a3bed91319f7c8f067ddc3e8)
|
2017-08-01 17:28:24 -07:00 |
|
Subru Krishnan
|
80e1904000
|
YARN-5411. Create a proxy chain for ApplicationClientProtocol in the Router. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 4846069061b6baa06da3b524b9e36567dd368388)
|
2017-08-01 17:28:24 -07:00 |
|
Akira Ajisaka
|
b38a1eea8e
|
HADOOP-14245. Use Mockito.when instead of Mockito.stub. Contributed by Andras Bokor.
|
2017-08-01 15:15:43 +09:00 |
|
Arun Suresh
|
890e14c02a
|
YARN-6870. Fix floating point inaccuracies in resource availability check in AllocationBasedResourceUtilizationTracker. (Brook Zhou via asuresh)
|
2017-07-28 16:32:43 -07:00 |
|
Akira Ajisaka
|
38c6fa5c7a
|
HADOOP-11875. [JDK9] Adding a second copy of Hamlet without _ as a one-character identifier.
|
2017-07-28 09:10:52 +09:00 |
|
Jian He
|
ac9489f7fc
|
YARN-6804. Allow custom hostname for docker containers in native services. Contributed by Billie Rinaldi
|
2017-07-25 09:57:14 -07:00 |
|
Brahma Reddy Battula
|
2054324d47
|
Revert "YARN-6804. [YARN core changes] Allow custom hostname for docker containers in native services. Contributed by Billie Rinaldi"
This reverts commit 4a771d9010.
|
2017-07-23 12:56:18 +08:00 |
|
Jian He
|
4a771d9010
|
YARN-6804. [YARN core changes] Allow custom hostname for docker containers in native services. Contributed by Billie Rinaldi
|
2017-07-21 11:31:33 -07:00 |
|
Jason Lowe
|
c8df3668ec
|
YARN-6837. Null LocalResource visibility or resource type can crash the nodemanager. Contributed by Jinjiang Ling
|
2017-07-20 11:03:04 -05:00 |
|
Ray Chiang
|
f5f14a2ad6
|
YARN-6798. Fix NM startup failure with old state store due to version mismatch. (Botong Huang via rchiang)
|
2017-07-18 12:35:08 -07:00 |
|
Arun Suresh
|
5b007921cd
|
YARN-6706. Refactor ContainerScheduler to make oversubscription change easier. (Haibo Chen via asuresh)
|
2017-07-17 14:11:14 -07:00 |
|
Jason Lowe
|
ebc048cc05
|
YARN-6805. NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code. Contributed by Jason Lowe
|
2017-07-13 17:44:47 -05:00 |
|
Jason Lowe
|
0ffca5d347
|
Revert "YARN-6805. NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code. Contributed by Jason Lowe"
This reverts commit f76f5c0919.
|
2017-07-13 17:42:38 -05:00 |
|
Jason Lowe
|
f76f5c0919
|
YARN-6805. NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code. Contributed by Jason Lowe
|
2017-07-13 17:38:17 -05:00 |
|
Jason Lowe
|
7576a688ea
|
YARN-6708. Nodemanager container crash after ext3 folder limit. Contributed by Bibin A Chundatt
|
2017-07-06 09:40:09 -05:00 |
|
Andrew Wang
|
af2773f609
|
Updating version for 3.0.0-beta1 development
|
2017-06-29 17:57:40 -07:00 |
|
Arun Suresh
|
49aa60e50d
|
YARN-6127. Add support for work preserving NM restart when AMRMProxy is enabled. (Botong Huang via asuresh).
|
2017-06-22 11:27:13 -07:00 |
|
Daniel Templeton
|
a062374c39
|
YARN-6679. Reduce Resource instance overhead via non-PBImpl
(Contributed by Daryn Sharp via Daniel Templeton)
|
2017-06-08 10:08:08 -07:00 |
|
Daniel Templeton
|
73ecb19312
|
YARN-6208. Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application
(Contributed by Akira Ajisaka via Daniel Templeton)
|
2017-06-02 08:50:19 -07:00 |
|
Varun Vasudev
|
547f18cb96
|
YARN-6366. Refactor the NodeManager DeletionService to support additional DeletionTask types. Contributed by Shane Kumpf.
|
2017-05-31 16:15:35 +05:30 |
|
Andrew Wang
|
16ad896d5c
|
Update maven version for 3.0.0-alpha4 development
|
2017-05-26 14:09:44 -07:00 |
|
Daniel Templeton
|
d81372dfad
|
YARN-6646. Modifier 'static' is redundant for inner enums
(Contributed by ZhangBing Lin via Daniel Templeton)
|
2017-05-26 12:05:48 -07:00 |
|
Jason Lowe
|
aea42930bb
|
YARN-6641. Non-public resource localization on a bad disk causes subsequent containers failure. Contributed by Kuhu Shukla
|
2017-05-26 09:37:56 -05:00 |
|
Haibo Chen
|
47474fffac
|
YARN-6555. Store application flow context in NM state store for work-preserving restart. (Rohith Sharma K S via Haibo Chen)
|
2017-05-25 21:15:27 -07:00 |
|
Varun Vasudev
|
1a56a3db59
|
Addendum patch to fix Docker sanitization.
|
2017-05-25 14:53:57 +05:30 |
|
Akira Ajisaka
|
bc28da65fb
|
YARN-6141. ppc64le on Linux doesn't trigger __linux get_executable codepath. Contributed by Sonia Garudi and Ayappan.
|
2017-05-25 17:06:26 +09:00 |
|
Eric Payne
|
19482e0d09
|
YARN-6618. TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once. Contributed by Jason Lowe.
|
2017-05-19 11:24:54 -05:00 |
|
Varun Vasudev
|
b46cd315f7
|
Sanitize arguments before launching Docker containers.
|
2017-05-18 10:37:16 +05:30 |
|
Varun Vasudev
|
e120ee865a
|
Validate docker image name before launching container.
|
2017-05-18 10:29:34 +05:30 |
|
Chris Douglas
|
b23fcc86c6
|
YARN-6577. Remove unused ContainerLocalization classes. Contributed by ZhangBing Lin
|
2017-05-17 20:40:06 -07:00 |
|
Robert Kanter
|
18c494a00c
|
YARN-6447. Provide container sandbox policies for groups (gphillips via rkanter)
|
2017-05-16 18:02:39 -07:00 |
|
Jian He
|
8236130b2c
|
YARN-6306. NMClient API change for container upgrade. Contributed by Arun Suresh
|
2017-05-16 10:48:46 -07:00 |
|
Daniel Templeton
|
74a61438ca
|
YARN-6475. Fix some long function checkstyle issues
(Contributed by Soumabrata Chakraborty via Daniel Templeton)
|
2017-05-10 10:46:50 -07:00 |
|
Daniel Templeton
|
a2f680493f
|
YARN-5301. NM mount cpu cgroups failed on some systems
(Contributed by Miklos Szegedi via Daniel Templeton)
|
2017-05-09 12:05:46 -07:00 |
|
Subru Krishnan
|
749e5c09b9
|
YARN-6281. Cleanup when AMRMProxy fails to initialize a new interceptor chain. (Botong Huang via Subru)
(cherry picked from commit 57a9afbd45b7ef8e6021cc58f96bd0074bf1389d)
|
2017-05-08 16:55:47 -07:00 |
|
Subru Krishnan
|
cd9ff27ffc
|
YARN-6234. Support multiple attempts on the node when AMRMProxy is enabled. (Giovanni Matteo Fumarola via Subru).
|
2017-05-08 16:41:30 -07:00 |
|
Jason Lowe
|
424887ecb7
|
YARN-3839. Quit throwing NMNotYetReadyException. Contributed by Manikandan R
|
2017-05-08 17:14:37 -05:00 |
|
Subru Krishnan
|
d6eed5acca
|
YARN-6565. Fix memory leak and finish app trigger in AMRMProxy. (Botong Huang via Subru).
|
2017-05-05 16:27:49 -07:00 |
|
Sidharta S
|
fd5cb2c946
|
YARN-6374. Improve test coverage and add utility classes for common Docker operations. Contributed by Shane Kumpf
|
2017-05-03 14:49:30 -07:00 |
|
Robert Kanter
|
68e45f554b
|
YARN-6472. Improve Java sandbox regex (gphillips via rkanter)
|
2017-04-28 11:01:50 -07:00 |
|
Haibo Chen
|
8ac50e1322
|
YARN-6500. Do not mount inaccessible cgroups directories in CgroupsLCEResourcesHandler. (Miklos Szegedi via Haibo Chen)
|
2017-04-24 11:37:52 -07:00 |
|
Daniel Templeton
|
46940d92e2
|
YARN-6302. Fail the node if Linux Container Executor is not configured properly
(Contributed by Miklos Szegedi via Daniel Templeton)
|
2017-04-19 12:23:49 -07:00 |
|
Daniel Templeton
|
dd43b895c2
|
YARN-6202. Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded
(Contributed by Yufei Gu via Daniel Templeton)
|
2017-04-19 11:44:55 -07:00 |
|
Daniel Templeton
|
41ac190dba
|
YARN-6438. Code can be improved in ContainersMonitorImpl.java
(Contributed by Miklos Szegedi via Daniel Templeton)
|
2017-04-19 10:53:08 -07:00 |
|
Karthik Kambatla
|
8a1d7480f7
|
YARN-6433. Only accessible cgroup mount directories should be selected for a controller. (Miklos Szegedi via kasha)
|
2017-04-14 15:07:14 -07:00 |
|
Eric Payne
|
a16ab2be91
|
YARN-6450. TestContainerManagerWithLCE requires override for each new test added to ContainerManagerTest? Contributed by Jason Lowe.
|
2017-04-12 10:20:08 -05:00 |
|
Daniel Templeton
|
e9ac61cc0e
|
YARN-6372. Add default value for NM disk validator (Contributed by Yufei Gu via Daniel Templeton)
|
2017-04-10 14:56:42 -07:00 |
|
Robert Kanter
|
63f7322522
|
YARN-6368. Decommissioning an NM results in a -1 exit code (miklos.szegedi@cloudera.com via rkanter)
|
2017-04-07 14:28:07 -07:00 |
|
Ming Ma
|
0116c3c957
|
YARN-5797. Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches. (Chris Trezzo via mingma)
|
2017-04-06 16:54:43 -07:00 |
|
Jason Lowe
|
1b081ca27e
|
YARN-6288. Exceptions during aggregated log writes are mishandled. Contributed by Akira Ajisaka
|
2017-04-06 16:24:36 -05:00 |
|
Jason Lowe
|
e8071aa249
|
YARN-6403. Invalid local resource request can raise NPE and make NM exit. Contributed by Tao Yang
|
2017-04-05 12:30:45 -05:00 |
|