Haibo Chen
|
bb92bfb4ef
|
YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)
|
2018-04-17 11:15:20 -07:00 |
|
Jason Lowe
|
1d6e43da51
|
YARN-7996. Allow user supplied Docker client configurations with YARN native services. Contributed by Shane Kumpf
|
2018-04-17 08:57:31 -05:00 |
|
Haibo Chen
|
86dfb70875
|
Revert "YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)"
This reverts commit 0c14b6f0d8 .
|
2018-04-17 06:04:38 -07:00 |
|
Haibo Chen
|
0c14b6f0d8
|
YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)
|
2018-04-17 05:59:03 -07:00 |
|
Rohith Sharma K S
|
669eb7bdea
|
YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri.
|
2018-04-14 10:31:28 +05:30 |
|
Jason Lowe
|
4571351ccc
|
MAPREDUCE-7069. Add ability to specify user environment variables individually. Contributed by Jim Brennan
|
2018-04-12 11:12:46 -05:00 |
|
Jason Lowe
|
907919d28c
|
YARN-7667. Docker Stop grace period should be configurable. Contributed by Eric Badger
|
2018-04-09 17:19:21 -05:00 |
|
Haibo Chen
|
f8b8bd53c4
|
YARN-6936. [Atsv2] Retrospect storing entities into sub application table from client perspective. (Rohith Sharma K S via Haibo Chen)
|
2018-04-05 10:23:42 -07:00 |
|
Vrushali C
|
345e7624d5
|
YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S
|
2018-04-04 15:08:03 -07:00 |
|
Wangda Tan
|
b779f4f0f6
|
YARN-8106. Update LogAggregationIndexedFileController to use readFull instead read to avoid IOException while loading log meta. (Prabhu Joseph via wangda)
Change-Id: I63a65f73f8d1636e2c99ed9c8c2bbd05efcff80f
|
2018-04-03 21:06:24 -07:00 |
|
Wangda Tan
|
a0bde7d525
|
YARN-7142. Support placement policy in yarn native services. (Gour Saha via wangda)
Change-Id: I166c67a7a34430627c17365f60bac75b6da1b434
|
2018-04-02 07:26:01 -07:00 |
|
Weiwei Yang
|
1606dad133
|
YARN-7497. Add file system based scheduler configuration store. Contributed by Jiandan Yang.
|
2018-03-30 21:41:33 +08:00 |
|
Subru Krishnan
|
725b10e3ae
|
Revert "YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru)."
This reverts commit 2a2ef15caf as smart-apply-patch script didn't pick the latest patch.
|
2018-03-28 11:26:50 -07:00 |
|
Subru Krishnan
|
2a2ef15caf
|
YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru).
|
2018-03-27 17:39:46 -07:00 |
|
Sean Mackrory
|
82665a7887
|
HADOOP-15299. Bump Jackson 2 version to Jackson 2.9.x.
|
2018-03-26 14:05:15 -06:00 |
|
Wangda Tan
|
4bf622043f
|
YARN-7952. RM should be able to recover log aggregation status after restart/fail-over. (Xuan Gong via wangda)
Change-Id: I725c9afe64831eda0aa6b0bebdbc79d2dd165707
|
2018-03-15 13:26:45 -07:00 |
|
fang zhenyi
|
5e013d50d1
|
HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-03-15 16:12:07 +09:00 |
|
Wangda Tan
|
a5b27b3c67
|
YARN-5015. Support sliding window retry capability for container restart. (Chandni Singh via wangda)
Change-Id: I07addd3e4ba8d98456ee2ff1d5c540a38fe61dea
|
2018-03-13 17:55:17 -07:00 |
|
Miklos Szegedi
|
a82d4a2e3a
|
YARN-5764. NUMA awareness support for launching containers. Contributed by Devaraj K.
|
2018-03-13 12:36:57 -07:00 |
|
Wangda Tan
|
583f459431
|
YARN-7891. LogAggregationIndexedFileController should support read from HAR file. (Xuan Gong via wangda)
Change-Id: I16e081f21c5f80160564c49cc49d103bd8eb7e16
|
2018-03-07 15:46:47 -08:00 |
|
Wangda Tan
|
e718ac597f
|
Revert "YARN-7891. LogAggregationIndexedFileController should support read from HAR file. (Xuan Gong via wangda)"
This reverts commit 4d53ef7eef .
|
2018-03-07 15:46:47 -08:00 |
|
Wangda Tan
|
4d53ef7eef
|
YARN-7891. LogAggregationIndexedFileController should support read from HAR file. (Xuan Gong via wangda)
Change-Id: Ie16e34039d57df50128c73b37516ad0bc7c9590e
|
2018-03-07 11:30:06 -08:00 |
|
Jason Lowe
|
d69b31f7f7
|
YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan
|
2018-03-07 09:20:34 -06:00 |
|
Takanobu Asanuma
|
745190ecdc
|
HADOOP-15287. JDK9 JavaDoc build fails due to one-character underscore identifiers in hadoop-yarn-common
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-03-05 18:15:53 -08:00 |
|
Konstantinos Karanasos
|
e85188101c
|
YARN-7921. Transform a PlacementConstraint to a string expression. Contributed by Weiwei Yang.
|
2018-02-26 12:15:16 -08:00 |
|
Gabor Bota
|
c36b4aa31c
|
HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-02-23 13:55:18 +09:00 |
|
Jason Lowe
|
9497215084
|
YARN-7813. Capacity Scheduler Intra-queue Preemption should be configurable for each queue. Contributed by Eric Payne
|
2018-02-19 14:06:28 -06:00 |
|
Jason Lowe
|
b9a429bb28
|
Revert "YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan"
This reverts commit 8013475d44 .
|
2018-02-19 08:16:25 -06:00 |
|
fang zhenyi
|
4d4dde5112
|
HADOOP-15223. Replace Collections.EMPTY* with empty* when available
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-02-18 22:19:39 +09:00 |
|
Wangda Tan
|
ca1043ab90
|
YARN-7328. ResourceUtils allows yarn.nodemanager.resource-types.memory-mb and .vcores to override yarn.nodemanager.resource.memory-mb and .cpu-vcores. (lovekesh bansal via wangda)
Change-Id: Ibb1faf0beefec079dae2208986976b2f64650672
|
2018-02-17 12:28:08 +08:00 |
|
Sunil G
|
aae629913c
|
YARN-7292. Retrospect Resource Profile Behavior for overriding capability. Contributed by Wangda Tan.
|
2018-02-16 12:37:40 +05:30 |
|
Jason Lowe
|
8013475d44
|
YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan
|
2018-02-15 17:09:00 -06:00 |
|
Konstantinos Karanasos
|
0b489e564c
|
YARN-7920. Simplify configuration for PlacementConstraints. Contributed by Wangda Tan.
|
2018-02-15 14:23:38 -08:00 |
|
Eric Payne
|
bddfe42e2c
|
Revert "YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue"
This reverts commit c5e6e3de1c .
|
2018-02-14 14:29:20 -06:00 |
|
Eric Payne
|
c5e6e3de1c
|
YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue
|
2018-02-13 10:11:02 -06:00 |
|
Wangda Tan
|
d4c98579e3
|
YARN-7697. NM goes down with OOM due to leak in log-aggregation. (Xuan Gong via wangda)
Change-Id: Ie4fc7979d834e25f37a033c314f3efceeb8f4a9e
|
2018-02-12 10:28:35 +08:00 |
|
Wangda Tan
|
60f9e60b3b
|
Preparing for 3.2.0 development
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
|
2018-02-11 11:17:38 +08:00 |
|
Jian He
|
eb2449d539
|
YARN-5428. Allow for specifying the docker client configuration directory. Contributed by Shane Kumpf
|
2018-02-08 11:35:30 -08:00 |
|
Miklos Szegedi
|
c7101fe21b
|
YARN-7879. NM user is unable to access the application filecache due to permissions. Contributed by Jason Lowe.
|
2018-02-02 16:48:57 -08:00 |
|
Arun Suresh
|
d481344783
|
YARN-7822. Constraint satisfaction checker support for composite OR and AND constraints. (Weiwei Yang via asuresh)
|
2018-01-31 01:51:08 -08:00 |
|
Arun Suresh
|
8d1e2c6409
|
Merge branch 'YARN-6592' into trunk
|
2018-01-31 01:42:42 -08:00 |
|
Jason Lowe
|
7288b08330
|
YARN-2185. Use pipes when localizing archives. Contributed by Miklos Szegedi
|
2018-01-31 09:39:43 -06:00 |
|
Arun Suresh
|
c23980c4f2
|
YARN-7795. Fix jenkins issues of YARN-6592 branch. (Sunil G via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
38af237969
|
YARN-6599. Support anti-affinity constraint via AppPlacementAllocator. (Wangda Tan via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
8779a35742
|
YARN-7709. Remove SELF from TargetExpression type. (Konstantinos Karanasos via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
a5c1fc881e
|
YARN-7696. Add container tags to ContainerTokenIdentifier, api.Container and NMContainerStatus to handle all recovery cases. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
a52d11fb8c
|
YARN-7613. Implement Basic algorithm for constraint based placement. (Panagiotis Garefalakis via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
f9af15d659
|
YARN-7612. Add Processor Framework for Rich Placement Constraints. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
06eb63e64b
|
YARN-7669. API and interface modifications for placement constraint processor. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
69de9a1ba9
|
YARN-7448. [API] Add SchedulingRequest to the AllocateRequest. (Panagiotis Garefalakis via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Konstantinos Karanasos
|
db928556c8
|
YARN-6595. [API] Add Placement Constraints at the application level. (Arun Suresh via kkaranasos)
|
2018-01-31 01:30:17 -08:00 |
|
Wangda Tan
|
b57e8bc300
|
YARN-6594. [API] Introduce SchedulingRequest object. (Konstantinos Karanasos via wangda)
|
2018-01-31 01:30:17 -08:00 |
|
Wangda Tan
|
33a796d9b7
|
YARN-6593. [API] Introduce Placement Constraint object. (Konstantinos Karanasos via wangda)
Change-Id: Id00edb7185fdf01cce6e40f920cac3585f8cbe9c
|
2018-01-31 01:30:17 -08:00 |
|
Jason Lowe
|
901d15a30b
|
Revert "YARN-2185. Use pipes when localizing archives. Contributed by Miklos Szegedi"
This reverts commit 1b0f265db1 .
|
2018-01-30 08:34:39 -06:00 |
|
Haibo Chen
|
649ef7ac33
|
YARN-7064. Use cgroup to get container resource utilization. (Miklos Szegedi via Haibo Chen)
|
2018-01-26 16:27:31 -08:00 |
|
Jason Lowe
|
1b0f265db1
|
YARN-2185. Use pipes when localizing archives. Contributed by Miklos Szegedi
|
2018-01-26 13:25:20 -06:00 |
|
Rohith Sharma K S
|
f3e33aeb80
|
Revert "YARN-7537 [Atsv2] load hbase configuration from filesystem rather than URL. Contributed by Rohith Sharma"
This reverts commit ec8f47e7fa .
|
2018-01-24 15:04:15 +05:30 |
|
Billie Rinaldi
|
e307edcb47
|
YARN-7540 and YARN-7605. Convert yarn app cli to call yarn api services and implement doAs for Api Service REST API. Contributed by Eric Yang and Jian He
|
2018-01-23 17:54:39 -08:00 |
|
Jian He
|
39b999aba2
|
YARN-7782. Enable user re-mapping for Docker containers in yarn-default.xml. Contributed by Eric Yang
|
2018-01-23 14:03:53 -08:00 |
|
Eric Yang
|
97fe3cc187
|
YARN-7729. Add support for setting Docker PID namespace mode. (Contributed by Billie Rinaldi)
|
2018-01-22 16:33:38 -05:00 |
|
Vrushali C
|
ec8f47e7fa
|
YARN-7537 [Atsv2] load hbase configuration from filesystem rather than URL. Contributed by Rohith Sharma
|
2018-01-19 15:34:40 -08:00 |
|
Rohith Sharma K S
|
d09058b2fd
|
YARN-6736. Consider writing to both ats v1 & v2 from RM for smoother upgrades. Contributed by Aaron Gresch.
|
2018-01-16 07:58:29 +05:30 |
|
Eric Yang
|
3d65dbe032
|
YARN-5366. Improve signal handling and delete delay for Docker on Yarn.
(Contributed by Shane Kumpf)
|
2018-01-12 13:41:27 -05:00 |
|
Wangda Tan
|
a81144daa0
|
YARN-7666. Introduce scheduler specific environment variable support in ApplicationSubmissionContext for better scheduling placement configurations. (Sunil G via wangda)
Change-Id: I0fd826490f5160d47d42af2a9ac0bd8ec4e959dc
|
2018-01-05 15:12:04 -08:00 |
|
Miklos Szegedi
|
626b5103d4
|
YARN-7688. Miscellaneous Improvements To ProcfsBasedProcessTree. Contributed by BELUGA BEHR.
|
2018-01-02 17:39:50 -08:00 |
|
Miklos Szegedi
|
33ae2a4ae1
|
YARN-7687. ContainerLogAppender Improvements. Contributed by BELUGA BEHR.
|
2018-01-02 16:36:51 -08:00 |
|
Varun Saxena
|
c0aeb666a4
|
YARN-7662. [ATSv2] Define new set of configurations for reader and collectors to bind (Rohith Sharma K S via Varun Saxena)
|
2017-12-19 22:29:24 +05:30 |
|
Wangda Tan
|
631b5c2db7
|
YARN-5418. When partial log aggregation is enabled, display the list of aggregated files on the container log page. (Xuan Gong via wangda)
Change-Id: I1befb0bbaeb89fb315bafe3e2f3379663f8cf1ec
|
2017-12-15 15:38:36 -08:00 |
|
Sunil G
|
10fc8d2a7d
|
YARN-7383. Node resource is not parsed correctly for resource names containing dot. Contributed by Gergely Novák.
|
2017-12-13 22:00:07 +05:30 |
|
Sunil G
|
daa1cdd062
|
YARN-7564. Cleanup to fix checkstyle issues of YARN-5881 branch. Contributed by Sunil G.
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
7462c38277
|
YARN-7483. CapacityScheduler test cases cleanup post YARN-5881. (Sunil G via wangda)
Change-Id: I9741a6baf5cb7352d05636efb6c0b24790e7589a
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
034b312d9f
|
YARN-7411. Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee. (Sunil G via wangda)
Change-Id: I41b1d7558c20fc4eb2050d40134175a2ef6330cb
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
d52627a7cb
|
YARN-7254. UI and metrics changes related to absolute resource configuration. (Sunil G via wangda)
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
5e798b1a0d
|
YARN-6471. Support to add min/max resource configuration for a queue. (Sunil G via wangda)
Change-Id: I9213f5297a6841fab5c573e85ee4c4e5f4a0b7ff
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
0311cf0535
|
YARN-7381. Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml. (Xuan Gong via wangda)
Change-Id: I1ed58dafad5cc276eea5c0b0813cf04f57d73a87
|
2017-12-05 13:09:49 -08:00 |
|
Robert Kanter
|
d8863fc16f
|
YARN-5594. Handle old RMDelegationToken format when recovering RM (rkanter)
|
2017-12-04 13:14:55 -08:00 |
|
Wangda Tan
|
7225ec0ceb
|
YARN-6507. Add support in NodeManager to isolate FPGA devices with CGroups. (Zhankun Tang via wangda)
Change-Id: Ic9afd841805f1035423915a0b0add5f3ba96cf9d
|
2017-12-01 10:50:49 -08:00 |
|
Jason Lowe
|
5cfaee2e6d
|
YARN-7495. Improve robustness of the AggregatedLogDeletionService. Contributed by Jonathan Eagles
|
2017-11-30 12:39:18 -06:00 |
|
Yufei Gu
|
d8923cdbf1
|
YARN-7363. ContainerLocalizer don't have a valid log4j config in case of Linux container executor. (Contributed by Yufei Gu)
|
2017-11-27 14:31:52 -08:00 |
|
Jian He
|
fedabcad42
|
YARN-6168. Restarted RM may not inform AM about all existing containers. Contributed by Chandni Singh
|
2017-11-27 10:19:58 -08:00 |
|
Arun Suresh
|
b46ca7e73b
|
YARN-6483. Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM. (Juan Rodriguez Hortala via asuresh)
|
2017-11-22 19:18:30 -08:00 |
|
Haibo Chen
|
67bbbe1c0c
|
YARN-7531. ResourceRequest.equal does not check ExecutionTypeRequest.enforceExecutionType().
|
2017-11-21 09:09:16 -08:00 |
|
Subru Krishnan
|
d5f66888b8
|
YARN-6128. Add support for AMRMProxy HA. (Botong Huang via Subru).
|
2017-11-17 17:39:06 -08:00 |
|
Eric Yang
|
0940e4f692
|
YARN-7218. Decouple YARN Services REST API namespace from RM. (Contributed by Eric Yang)
|
2017-11-17 12:28:12 -05:00 |
|
Daniel Templeton
|
2e512f016e
|
YARN-7442. [YARN-7069] Limit format of resource type name (Contributed by Wangda Tan via Daniel Templeton)
|
2017-11-13 11:03:30 -08:00 |
|
Wangda Tan
|
dd07038ffa
|
YARN-6909. Use LightWeightedResource when number of resource types more than two. (Sunil G via wangda)
Change-Id: I90e021c5dea7abd9ec6bd73b2287c8adebe14595
|
2017-11-09 14:51:15 -08:00 |
|
Robert Kanter
|
a2c150a736
|
YARN-7386. Duplicate Strings in various places in Yarn memory (misha@cloudera.com via rkanter)
|
2017-11-09 12:12:52 -08:00 |
|
Jian He
|
a55d0738f1
|
YARN-7371. Added allocateRequestId in NMContainerStatus for recovery. Contributed by Chandni Singh
|
2017-11-06 13:30:20 -08:00 |
|
Jian He
|
c723021579
|
YARN-6626. Embed REST API service into RM. Contributed by Eric Yang
|
2017-11-06 13:30:17 -08:00 |
|
Jian He
|
673c0db43c
|
Revert "YARN-6626. Embed REST API service into RM. Contributed by Eric Yang"
This reverts commit 63d1084e9781e0fee876916190b69f6242dd00e4.
|
2017-11-06 13:30:17 -08:00 |
|
Jian He
|
9e677fa05c
|
YARN-6626. Embed REST API service into RM. Contributed by Eric Yang
|
2017-11-06 13:30:17 -08:00 |
|
Jian He
|
bd96c4c235
|
Rebase onto latest trunk. minor conflicts
|
2017-11-06 13:30:13 -08:00 |
|
Billie Rinaldi
|
1888318c89
|
YARN-6903. Yarn-native-service framework core rewrite. Contributed by Jian He
|
2017-11-06 13:30:11 -08:00 |
|
Sunil G
|
1700adc6f7
|
YARN-7410. Cleanup FixedValueResource to avoid dependency to ResourceUtils. Contributed by Wangda Tan.
|
2017-11-03 07:25:29 +05:30 |
|
Jason Lowe
|
d00b6f7c1f
|
YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger
|
2017-11-02 09:37:17 -05:00 |
|
Junping Du
|
d57dba9942
|
YARN-7400. Incorrect log preview displayed in jobhistory server ui. Contributed by Xuan Gong.
|
2017-11-01 14:48:16 -07:00 |
|
Sunil G
|
9114d7a5a0
|
YARN-7224. Support GPU isolation for docker container. Contributed by Wangda Tan.
|
2017-10-29 11:08:44 +05:30 |
|
Wangda Tan
|
36e158ae98
|
YARN-7307. Allow client/AM update supported resource types via YARN APIs. (Sunil G via wangda)
Change-Id: I14c5ea7252b7c17e86ab38f692b5f9d43196dbe0
|
2017-10-26 20:15:19 -07:00 |
|
Robert Kanter
|
b1de78619f
|
YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow (rkanter)
|
2017-10-26 17:47:32 -07:00 |
|
Subru Krishnan
|
25932da6d1
|
YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru).
|
2017-10-26 12:10:14 -07:00 |
|