Rohith Sharma K S
|
d09058b2fd
|
YARN-6736. Consider writing to both ats v1 & v2 from RM for smoother upgrades. Contributed by Aaron Gresch.
|
2018-01-16 07:58:29 +05:30 |
|
Wangda Tan
|
edcc3a95d5
|
YARN-7468. Provide means for container network policy control. (Xuan Gong via wangda)
Change-Id: I73678c343f663412917758feef35d8308c216e76
|
2018-01-12 16:14:10 -08:00 |
|
Eric Yang
|
3d65dbe032
|
YARN-5366. Improve signal handling and delete delay for Docker on Yarn.
(Contributed by Shane Kumpf)
|
2018-01-12 13:41:27 -05:00 |
|
Wangda Tan
|
a81144daa0
|
YARN-7666. Introduce scheduler specific environment variable support in ApplicationSubmissionContext for better scheduling placement configurations. (Sunil G via wangda)
Change-Id: I0fd826490f5160d47d42af2a9ac0bd8ec4e959dc
|
2018-01-05 15:12:04 -08:00 |
|
Robert Kanter
|
f8e7dd9b10
|
YARN-7557. It should be possible to specify resource types in the fair scheduler increment value (grepas via rkanter)
|
2018-01-05 11:15:06 -08:00 |
|
Varun Saxena
|
c0aeb666a4
|
YARN-7662. [ATSv2] Define new set of configurations for reader and collectors to bind (Rohith Sharma K S via Varun Saxena)
|
2017-12-19 22:29:24 +05:30 |
|
Akira Ajisaka
|
001008958d
|
YARN-7664. Several javadoc errors. Contributed by Sean Mackrory.
|
2017-12-18 22:24:51 +09:00 |
|
Sunil G
|
2564b4d07f
|
YARN-7119. Support multiple resource types in rmadmin updateNodeResource command. Contributed by Manikandan R.
|
2017-12-14 16:11:57 +05:30 |
|
Sunil G
|
10fc8d2a7d
|
YARN-7383. Node resource is not parsed correctly for resource names containing dot. Contributed by Gergely Novák.
|
2017-12-13 22:00:07 +05:30 |
|
Wangda Tan
|
d52627a7cb
|
YARN-7254. UI and metrics changes related to absolute resource configuration. (Sunil G via wangda)
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
0311cf0535
|
YARN-7381. Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml. (Xuan Gong via wangda)
Change-Id: I1ed58dafad5cc276eea5c0b0813cf04f57d73a87
|
2017-12-05 13:09:49 -08:00 |
|
Jason Lowe
|
25df505421
|
YARN-7589. TestPBImplRecords fails with NullPointerException. Contributed by Daniel Templeton
|
2017-12-01 15:37:36 -06:00 |
|
Wangda Tan
|
7225ec0ceb
|
YARN-6507. Add support in NodeManager to isolate FPGA devices with CGroups. (Zhankun Tang via wangda)
Change-Id: Ic9afd841805f1035423915a0b0add5f3ba96cf9d
|
2017-12-01 10:50:49 -08:00 |
|
Daniel Templeton
|
8498d287cd
|
YARN-7541. Node updates don't update the maximum cluster capability for resources other than CPU and memory
|
2017-11-29 11:11:36 -08:00 |
|
Yufei Gu
|
d8923cdbf1
|
YARN-7363. ContainerLocalizer don't have a valid log4j config in case of Linux container executor. (Contributed by Yufei Gu)
|
2017-11-27 14:31:52 -08:00 |
|
Jian He
|
fedabcad42
|
YARN-6168. Restarted RM may not inform AM about all existing containers. Contributed by Chandni Singh
|
2017-11-27 10:19:58 -08:00 |
|
Arun Suresh
|
b46ca7e73b
|
YARN-6483. Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM. (Juan Rodriguez Hortala via asuresh)
|
2017-11-22 19:18:30 -08:00 |
|
Sunil G
|
aab439593b
|
YARN-7330. Add support to show GPU in UI including metrics. Contributed by Wangda Tan.
|
2017-11-23 07:54:20 +05:30 |
|
Haibo Chen
|
67bbbe1c0c
|
YARN-7531. ResourceRequest.equal does not check ExecutionTypeRequest.enforceExecutionType().
|
2017-11-21 09:09:16 -08:00 |
|
Subru Krishnan
|
d5f66888b8
|
YARN-6128. Add support for AMRMProxy HA. (Botong Huang via Subru).
|
2017-11-17 17:39:06 -08:00 |
|
Varun Vasudev
|
5f0b238a11
|
YARN-7430. Enable user re-mapping for Docker containers by default. Contributed by Eric Yang.
|
2017-11-17 12:04:47 +05:30 |
|
Daniel Templeton
|
e094eb74b9
|
YARN-6953. Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()
(Contributed by Manikandan R via Daniel Templeton)
|
2017-11-15 10:03:29 -08:00 |
|
Jian He
|
5323b0048b
|
YARN-7466. ResourceRequest has a different default for allocationRequestId than Container. Contributed by Chandni Singh
|
2017-11-13 15:37:39 -08:00 |
|
Daniel Templeton
|
2e512f016e
|
YARN-7442. [YARN-7069] Limit format of resource type name (Contributed by Wangda Tan via Daniel Templeton)
|
2017-11-13 11:03:30 -08:00 |
|
bibinchundatt
|
2c2b7a3672
|
YARN-7406. Moving logging APIs over to slf4j in hadoop-yarn-api. Contributed by Yeliang Cang.
|
2017-11-11 10:36:27 +05:30 |
|
Wangda Tan
|
dd07038ffa
|
YARN-6909. Use LightWeightedResource when number of resource types more than two. (Sunil G via wangda)
Change-Id: I90e021c5dea7abd9ec6bd73b2287c8adebe14595
|
2017-11-09 14:51:15 -08:00 |
|
Daniel Templeton
|
462f6c490e
|
YARN-7143. FileNotFound handling in ResourceUtils is inconsistent
Change-Id: Ib1bb487e14a15edd2b5a42cf5078c5a2b295f069
|
2017-11-09 11:58:49 -08:00 |
|
Jian He
|
c723021579
|
YARN-6626. Embed REST API service into RM. Contributed by Eric Yang
|
2017-11-06 13:30:17 -08:00 |
|
Jian He
|
673c0db43c
|
Revert "YARN-6626. Embed REST API service into RM. Contributed by Eric Yang"
This reverts commit 63d1084e9781e0fee876916190b69f6242dd00e4.
|
2017-11-06 13:30:17 -08:00 |
|
Jian He
|
9e677fa05c
|
YARN-6626. Embed REST API service into RM. Contributed by Eric Yang
|
2017-11-06 13:30:17 -08:00 |
|
Sunil G
|
1700adc6f7
|
YARN-7410. Cleanup FixedValueResource to avoid dependency to ResourceUtils. Contributed by Wangda Tan.
|
2017-11-03 07:25:29 +05:30 |
|
Daniel Templeton
|
d64736d589
|
YARN-7336. Unsafe cast from long to int Resource.hashCode() method
(Contributed by Miklos Szegedi via Daniel Templeton)
|
2017-10-30 12:41:28 -07:00 |
|
Daniel Templeton
|
9a7e810838
|
YARN-6927. Add support for individual resource types requests in MapReduce
(Contributed by Gergo Repas via Daniel Templeton)
|
2017-10-30 11:04:22 -07:00 |
|
Daniel Templeton
|
9711b78998
|
YARN-7374. Improve performance of DRF comparisons for resource types in fair scheduler
|
2017-10-29 18:54:33 -07:00 |
|
Sunil G
|
9114d7a5a0
|
YARN-7224. Support GPU isolation for docker container. Contributed by Wangda Tan.
|
2017-10-29 11:08:44 +05:30 |
|
Jason Lowe
|
665bb147aa
|
YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla
|
2017-10-27 16:56:05 -05:00 |
|
Wangda Tan
|
36e158ae98
|
YARN-7307. Allow client/AM update supported resource types via YARN APIs. (Sunil G via wangda)
Change-Id: I14c5ea7252b7c17e86ab38f692b5f9d43196dbe0
|
2017-10-26 20:15:19 -07:00 |
|
Robert Kanter
|
b1de78619f
|
YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow (rkanter)
|
2017-10-26 17:47:32 -07:00 |
|
Subru Krishnan
|
25932da6d1
|
YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru).
|
2017-10-26 12:10:14 -07:00 |
|
Yufei Gu
|
7a27c2c367
|
YARN-7270. Fix unsafe casting from long to int for class Resource and
its sub-classes. (Yufei)
|
2017-10-13 12:41:59 -07:00 |
|
Wangda Tan
|
8bcc49e677
|
YARN-7205. Log improvements for the ResourceUtils. (Sunil G via wangda)
Change-Id: I0f5b7a7f68ec5d3e1d52211f83fdd089bc0bfd37
|
2017-10-11 15:25:28 -07:00 |
|
Sunil G
|
fa5cfc68f3
|
YARN-6620. Add support in NodeManager to isolate GPU devices by using CGroups. Contributed by Wangda Tan.
|
2017-10-11 23:44:33 +05:30 |
|
Wangda Tan
|
5cfbad68c0
|
YARN-7237. Cleanup usages of ResourceProfiles. (Wangda Tan)
Change-Id: I959c8531bd48231956068cb7d2312f3235549f9c
(cherry picked from commit 8536db5a7549fa44d9f9e444b41bd5978b5c6ae1)
|
2017-10-09 20:36:57 -07:00 |
|
Jonathan Hung
|
09c5dfe937
|
YARN-7251. Misc changes to YARN-5734
|
2017-10-09 11:11:23 -07:00 |
|
Wangda Tan
|
ff39c0de20
|
YARN-6840. Implement zookeeper based store for scheduler configuration updates. (Jonathan Hung via wangda)
Change-Id: I9debea674fe8c7e4109d4ca136965a1ea4c48bcc
|
2017-10-09 11:11:23 -07:00 |
|
Xuan
|
74ba6ffa0b
|
YARN-5947: Create LeveldbConfigurationStore class using Leveldb as backing store. Contributed by Jonathan Hung
|
2017-10-09 11:11:23 -07:00 |
|
Wangda Tan
|
a4e6253046
|
YARN-5949. Add pluggable configuration ACL policy interface and implementation. (Jonathan Hung via wangda)
Change-Id: Ib98e82ff753bede21fcab2e6ca9ec1e7a5a2008f
|
2017-10-09 11:11:23 -07:00 |
|
Jonathan Hung
|
ef686635c1
|
YARN-5948. Implement MutableConfigurationManager for handling storage into configuration store
|
2017-10-09 11:11:23 -07:00 |
|
Haibo Chen
|
c071aad5da
|
YARN-7009. TestNMClient.testNMClientNoCleanupOnStop is flaky by design. (Miklos Szegedi via Haibo Chen)
|
2017-10-05 15:50:13 -07:00 |
|
Arun Suresh
|
b733348dde
|
YARN-7258. Add Node and Rack Hints to Opportunistic Scheduler. (Kartheek Muthyala via asuresh).
|
2017-10-05 09:58:04 -07:00 |
|
Ray Chiang
|
67e12169b0
|
YARN-7219. Make AllocateRequestProto compatible with branch-2/branch-2.8. (rchiang)
|
2017-10-03 15:06:07 -07:00 |
|
Akira Ajisaka
|
c9b525bd94
|
YARN-6943. Update Yarn to YARN in documentation. Contributed by Chetna Chaudhari.
|
2017-10-04 07:01:54 +09:00 |
|
Subru Krishnan
|
d4d2fd1acd
|
YARN-2037. Add work preserving restart support for Unmanaged AMs. (Botong Huang via Subru).
|
2017-10-02 18:14:44 -07:00 |
|
Jason Lowe
|
85d81ae58e
|
YARN-7248. NM returns new SCHEDULED container status to older clients. Contributed by Arun Suresh
|
2017-09-28 14:10:15 -05:00 |
|
Jason Lowe
|
bfd1a72ba8
|
YARN-4266. Allow users to enter containers as UID:GID pair instead of by username. Contributed by luhuichun, Zhankun Tang, and Eric Badger.
|
2017-09-21 17:41:34 -05:00 |
|
Arun Suresh
|
56ef5279c1
|
YARN-7203. Add container ExecutionType into ContainerReport. (Botong Huang via asuresh)
|
2017-09-18 15:49:31 -07:00 |
|
Jason Lowe
|
a4f9c7c924
|
YARN-7192. Add a pluggable StateMachine Listener that is notified of NM Container State changes. Contributed by Arun Suresh
|
2017-09-18 10:16:09 -05:00 |
|
Yufei Gu
|
09b476e6da
|
YARN-6612. Update fair scheduler policies to be aware of resource types. (Contributed by Daniel Templeton via Yufei Gu)
|
2017-09-14 11:23:37 -07:00 |
|
Arun Suresh
|
4f8194430f
|
YARN-5216. Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM. (Hitesh Sharma via asuresh)
|
2017-09-14 08:51:26 -07:00 |
|
Arun Suresh
|
864fbacd45
|
YARN-5292. NM Container lifecycle and state transitions to support for PAUSED container state. (Hitesh Sharma via asuresh)
|
2017-09-14 08:48:39 -07:00 |
|
Rohith Sharma K S
|
5324388cf2
|
YARN-7157. Add admin configuration to filter per-user's apps in secure cluster. Contributed by Sunil G.
|
2017-09-13 23:36:47 +05:30 |
|
Sunil G
|
da0b6a354b
|
YARN-7137. [YARN-3926] Move newly added APIs to unstable in YARN-3926 branch. Contributed by Wangda Tan.
|
2017-09-12 09:19:12 -07:00 |
|
Daniel Templeton
|
bf2b687412
|
YARN-7136. Additional Performance Improvement for Resource Profile Feature
(Contributed by Wangda Tan via Daniel Templeton)
|
2017-09-12 09:19:12 -07:00 |
|
Sunil G
|
805095496d
|
YARN-6933. [YARN-3926] ResourceUtils.DISALLOWED_NAMES check is duplicated. Contributed by Manikandan R.
|
2017-09-12 09:19:12 -07:00 |
|
Wangda Tan
|
53df3eac50
|
YARN-7093. Improve log message in ResourceUtils. (Sunil G via wangda)
Change-Id: I88928a747ee3eec17bc76fb71e9aaa632d091f0f
|
2017-09-12 09:19:12 -07:00 |
|
Wangda Tan
|
e490602e9b
|
YARN-7039. Fix javac and javadoc errors in YARN-3926 branch. (Sunil G via wangda)
Change-Id: I442bf6d838b3aba83f1f6779cf9dcf8596a2102d
|
2017-09-12 09:19:12 -07:00 |
|
Sunil G
|
a333ba54e3
|
YARN-7067. [YARN-3926] Optimize ResourceType information display in UI. Contributed by Wangda Tan.
|
2017-09-12 09:19:12 -07:00 |
|
Wangda Tan
|
39240b61a1
|
YARN-7043. Cleanup ResourceProfileManager. (wangda)
Change-Id: I463356f37bf1f6a3f1fc3c594c79916e8c0ab913
|
2017-09-12 09:19:12 -07:00 |
|
Sunil G
|
758b771943
|
YARN-6781. [YARN-3926] ResourceUtils#initializeResourcesMap takes an unnecessary Map parameter. Contributed by Yu-Tang Lin.
|
2017-09-12 09:19:12 -07:00 |
|
Wangda Tan
|
df3855541a
|
YARN-6789. Add Client API to get all supported resource types from RM. (Sunil G via wangda)
Change-Id: I366d8db6f6700acd087db5acb7a1be7e41b2b68d
|
2017-09-12 09:19:12 -07:00 |
|
Sunil G
|
a6989af1d9
|
YARN-7030. [YARN-3926] Performance optimizations in Resource and ResourceUtils class. Contributed by Wangda Tan.
|
2017-09-12 09:19:12 -07:00 |
|
Sunil G
|
2b51b262ab
|
YARN-6892. [YARN-3926] Improve API implementation in Resources and DominantResourceCalculator class. Contributed by Sunil G.
|
2017-09-12 09:19:12 -07:00 |
|
Yufei Gu
|
d5e9939ebb
|
YARN-6994. [YARN-3926] Remove last uses of Long from resource types code. (Daniel Templeton via Yufei Gu)
|
2017-09-12 09:19:11 -07:00 |
|
Daniel Templeton
|
3aeaafecb8
|
YARN-6788. [YARN-3926] Improve performance of resource profile branch
(Contributed by Sunil Govindan via Daniel Templeton)
|
2017-09-12 09:19:11 -07:00 |
|
Sunil G
|
ca2808d8bb
|
YARN-6761. Fix build for YARN-3926 branch. Contributed by Varun Vasudev.
|
2017-09-12 09:19:11 -07:00 |
|
Sunil G
|
58da54640e
|
YARN-6445. [YARN-3926] Performance improvements in resource profile branch with respect to SLS. Contributed by Varun Vasudev.
|
2017-09-12 09:19:11 -07:00 |
|
Sunil G
|
dae65f3bef
|
YARN-6232. Update resource usage and preempted resource calculations to take into account all resource types. Contributed by Varun Vasudev.
|
2017-09-12 09:19:11 -07:00 |
|
Sunil G
|
7805deed48
|
YARN-5588. [YARN-3926] Add support for resource profiles in distributed shell. Contributed by Varun Vasudev.
|
2017-09-12 09:19:11 -07:00 |
|
Arun Suresh
|
6708ac3301
|
YARN-5587. Add support for resource profiles. (vvasudev via asuresh)
|
2017-09-12 09:19:10 -07:00 |
|
Varun Vasudev
|
c2032e251e
|
YARN-5708. Implement APIs to get resource profiles from the RM. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Varun Vasudev
|
a9b4426302
|
YARN-5707. Add manager class for resource profiles. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Rohith Sharma K S
|
9e4ba6aff5
|
YARN-5242. Update DominantResourceCalculator to consider all resource types in calculations. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Varun Vasudev
|
759114b006
|
YARN-4830. Add support for resource types in the nodemanager. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Arun Suresh
|
7ba698997b
|
YARN-4829. Add support for binary units in Resource class.(vvasudev via asuresh)
|
2017-09-12 09:19:10 -07:00 |
|
Varun Vasudev
|
ceb12c59a3
|
YARN-4715. Add support to read resource types from a config file. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Wangda Tan
|
1bbab7c157
|
YARN-4081. Add support for multiple resource types in the Resource class. (Varun Vasudev via wangda)
|
2017-09-12 09:19:09 -07:00 |
|
Rohith Sharma K S
|
4a83170be4
|
YARN-7140. CollectorInfo should have Public visibility. Contributed by Varun Saxena.
|
2017-09-08 20:23:16 +05:30 |
|
Sunil G
|
56d93d2e39
|
YARN-6600. Introduce default and max lifetime of application at LeafQueue level. Contributed by Rohith Sharma K S.
|
2017-09-08 07:15:17 +05:30 |
|
Jason Lowe
|
b0b535d9d5
|
YARN-6930. Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager. Contributed by Shane Kumpf
|
2017-09-07 16:17:03 -05:00 |
|
Subru Krishnan
|
b6e7d13696
|
YARN-5328. Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem.
|
2017-09-06 16:46:01 -07:00 |
|
Subru Krishnan
|
e3345e985b
|
Revert "Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem."
This reverts commit 7996eca7dc.
|
2017-09-06 16:39:23 -07:00 |
|
Subru Krishnan
|
7996eca7dc
|
Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem.
|
2017-09-01 15:16:40 -07:00 |
|
Oleg Danilov
|
c5281a85e1
|
YARN-7023. Incorrect ReservationId.compareTo() implementation.
This closes #262
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2017-09-01 21:33:31 +02:00 |
|
Andrew Wang
|
0d419c984f
|
Preparing for 3.1.0 development
|
2017-09-01 11:53:48 -07:00 |
|
Varun Saxena
|
3d00c8f394
|
Made fixes for whitespace errors and checstyle warnings before merge.
|
2017-08-30 11:29:54 +05:30 |
|
Jian He
|
08f40bcc7f
|
MAPREDUCE-6838. [ATSv2 Security] Add timeline delegation token received in allocate response to UGI. Contributed by Varun Saxena
|
2017-08-30 11:29:54 +05:30 |
|
Haibo Chen
|
9b08f365d7
|
YARN-6323. Rolling upgrade/config change is broken on timeline v2. (Vrushali C via Haibo Chen)
|
2017-08-30 11:29:54 +05:30 |
|
Rohith Sharma K S
|
32188d3295
|
YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena.
|
2017-08-30 11:29:54 +05:30 |
|
Jason Lowe
|
d5ff965fee
|
YARN-6820. Restrict read access to timelineservice v2 data. Contributed by Vrushali C
|
2017-08-30 11:29:53 +05:30 |
|
Rohith Sharma K S
|
7594d1de7b
|
YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena.
|
2017-08-30 11:29:53 +05:30 |
|