Arun Suresh
|
6708ac3301
|
YARN-5587. Add support for resource profiles. (vvasudev via asuresh)
|
2017-09-12 09:19:10 -07:00 |
|
Varun Vasudev
|
a9b4426302
|
YARN-5707. Add manager class for resource profiles. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Rohith Sharma K S
|
239c1824a0
|
YARN-5586. Update the Resources class to consider all resource types. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Sunil G
|
722ee84194
|
YARN-7163. RMContext need not to be injected to webapp and other Always Running services. Contributed by Rohith Sharma K S.
|
2017-09-11 10:28:10 +05:30 |
|
Arun Suresh
|
1f53ae7972
|
YARN-6849. NMContainerStatus should have the Container ExecutionType. (Kartheek Muthyala via asuresh)
|
2017-09-08 09:24:05 -07:00 |
|
Subru Krishnan
|
fa6137501c
|
YARN-5330. SharingPolicy enhancements required to support recurring reservations in ReservationSystem. (Carlo Curino via Subru).
|
2017-09-07 19:07:17 -07:00 |
|
Sunil G
|
56d93d2e39
|
YARN-6600. Introduce default and max lifetime of application at LeafQueue level. Contributed by Rohith Sharma K S.
|
2017-09-08 07:15:17 +05:30 |
|
Subru Krishnan
|
b6e7d13696
|
YARN-5328. Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem.
|
2017-09-06 16:46:01 -07:00 |
|
Subru Krishnan
|
e3345e985b
|
Revert "Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem."
This reverts commit 7996eca7dc .
|
2017-09-06 16:39:23 -07:00 |
|
Subru Krishnan
|
7996eca7dc
|
Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem.
|
2017-09-01 15:16:40 -07:00 |
|
bibinchundatt
|
dcd0bedcc8
|
YARN-7141. Move logging APIs to slf4j in timelineservice after ATSv2 merge. Contributed by Varun Saxena
|
2017-09-01 11:29:16 +05:30 |
|
Daniel Templeton
|
cc23514aba
|
YARN-7115. Move BoundedAppender to org.hadoop.yarn.util pacakge
(Contributed by Jian He via Daniel Templeton)
|
2017-08-30 17:26:13 -07:00 |
|
Rohith Sharma K S
|
7594d1de7b
|
YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena.
|
2017-08-30 11:29:53 +05:30 |
|
Sangjin Lee
|
ccb38c1991
|
YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen.
|
2017-08-30 11:29:52 +05:30 |
|
Sangjin Lee
|
092fead5d9
|
YARN-5792. Adopt the id prefix for YARN, MR, and DS entities. Contributed by Varun Saxena.
|
2017-08-30 11:29:51 +05:30 |
|
Varun Saxena
|
91d3443806
|
YARN-3359. Recover collector list when RM fails over (Li Lu via Varun Saxena)
|
2017-08-30 11:29:51 +05:30 |
|
Sangjin Lee
|
78b7e070d8
|
YARN-5638. Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery. Contributed by Li Lu.
|
2017-08-30 11:29:50 +05:30 |
|
Rohith Sharma K S
|
4cae120c61
|
YARN-6982. Potential issue on setting AMContainerSpec#tokenConf to null before app is completed. Contributed by Manikandan R.
|
2017-08-30 10:45:11 +05:30 |
|
Jason Lowe
|
1f6dc4ee9a
|
YARN-5816. TestDelegationTokenRenewer#testCancelWithMultipleAppSubmissions is still flakey. Contributed by Robert Kanter
|
2017-08-29 09:52:24 -05:00 |
|
Junping Du
|
312b1fd9da
|
YARN-7076. yarn application -list -appTypes is not working. Contributed by Jian He.
|
2017-08-28 18:26:51 -07:00 |
|
Jason Lowe
|
3a4e861169
|
YARN-6640. AM heartbeat stuck when responseId overflows MAX_INT. Contributed by Botong Huang
|
2017-08-25 09:16:17 -05:00 |
|
Junping Du
|
652dd434d9
|
YARN-7090. testRMRestartAfterNodeLabelDisabled get failed when CapacityScheduler is configured. Contributed by Wangda Tan.
|
2017-08-23 18:06:29 -07:00 |
|
Wangda Tan
|
f49843a988
|
YARN-6251. Do async container release to prevent deadlock during container updates. (Arun Suresh via wangda)
Change-Id: I6c67d20c5dd4d22752830ebf0ed2340824976ecb
|
2017-08-23 09:56:20 -07:00 |
|
Jason Lowe
|
657dd59cc8
|
YARN-7048. Fix tests faking kerberos to explicitly set ugi auth type. Contributed by Daryn Sharp
|
2017-08-22 13:16:24 -05:00 |
|
Jason Lowe
|
3efcd51c3b
|
YARN-2416. InvalidStateTransitonException in ResourceManager if AMLauncher does not receive response for startContainers() call in time. Contributed by Jonathan Eagles
|
2017-08-22 12:56:09 -05:00 |
|
Arun Suresh
|
8410d862d3
|
YARN-6979. Add flag to notify all types of container updates to NM via NodeHeartbeatResponse. (Kartheek Muthyala via asuresh)
|
2017-08-20 07:54:09 -07:00 |
|
Jian He
|
e2f6299f6f
|
YARN-6959. RM may allocate wrong AM Container for new attempt. Contributed by Yuqi Wang
|
2017-08-14 10:51:30 -07:00 |
|
bibinchundatt
|
d8f74c3964
|
YARN-6741. Deleting all children of a Parent Queue on refresh throws exception. Contributed by Naganarasimha G R.
|
2017-08-14 09:39:00 +05:30 |
|
Carlo Curino
|
28d97b79b6
|
YARN-6687. Validate that the duration of the periodic reservation is less than the periodicity. (subru via curino)
|
2017-08-11 16:58:04 -07:00 |
|
Subru Krishnan
|
bbbf0e2a41
|
HADOOP-14741. Refactor curator based ZooKeeper communication into common library. (Íñigo Goiri via Subru).
|
2017-08-11 13:58:45 -07:00 |
|
Daniel Templeton
|
e0c24145d2
|
YARN-6879. TestLeafQueue.testDRFUserLimits() has commented out code
(Contributed by Angela Wang via Daniel Templeton)
|
2017-08-08 13:35:22 -07:00 |
|
Wangda Tan
|
adb84f34db
|
YARN-4161. Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration. (Wei Yan via wangda)
Change-Id: Ic441ae4e0bf72e7232411eb54243ec143d5fd0d3
|
2017-08-07 11:32:21 -07:00 |
|
Arun Suresh
|
35dc782923
|
YARN-5977. ContainerManagementProtocol changes to support change of container ExecutionType. (Kartheek Muthyala via asuresh)
|
2017-08-03 21:15:40 -07:00 |
|
Yufei Gu
|
c617fe02b3
|
YARN-6832. Tests use assertTrue(....equals(...)) instead of assertEquals()). (Daniel Templeton via Yufei Gu)
|
2017-08-03 11:33:37 -07:00 |
|
Sunil G
|
f64cfeaf61
|
YARN-6678. Handle IllegalStateException in Async Scheduling mode of CapacityScheduler. Contributed by Tao Yang.
|
2017-08-03 19:27:10 +05:30 |
|
Eric Payne
|
8ce8672b6b
|
YARN-5349. TestWorkPreservingRMRestart#testUAMRecoveryOnRMWorkPreservingRestart fail intermittently. Contributed by Jason Lowe.
|
2017-08-02 12:53:22 -05:00 |
|
Yufei Gu
|
45535f8afa
|
YARN-6895. [FairScheduler] Preemption reservation may cause regular reservation leaks. (Miklos Szegedi via Yufei Gu)
|
2017-08-02 09:25:19 -07:00 |
|
Carlo Curino
|
acda6b96a4
|
YARN-5412. Create a proxy chain for ResourceManager REST API in the Router. (Contributed by Giovanni Matteo Fumarola via curino)
(cherry picked from commit b6240b92abf453affc5fd64e1eedf2d29842aa75)
|
2017-08-01 17:28:28 -07:00 |
|
Subru Krishnan
|
859aa1f9d6
|
YARN-5531. UnmanagedAM pool manager for federating application across clusters. (Botong Huang via Subru).
(cherry picked from commit 73bb2102ce4b82b3a3bed91319f7c8f067ddc3e8)
|
2017-08-01 17:28:24 -07:00 |
|
Subru Krishnan
|
78032e51d9
|
YARN-5905. Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP.
(cherry picked from commit e0f0e7afed51aac4ac9093ac362f6ce64601884d)
|
2017-08-01 17:28:22 -07:00 |
|
Jian He
|
2797507d51
|
YARN-5601. Make the RM epoch base value configurable. Contributed by Subru Krishnan
(cherry picked from commit 9ca2aba9cc65090162b3517b194b5e655ee4a157)
|
2017-08-01 17:28:20 -07:00 |
|
Jian He
|
94a24567d6
|
YARN-3671. Integrate Federation services with ResourceManager. Contributed by Subru Krishnan
(cherry picked from commit 8573c286e27623155c715a632d56a68f23523c72)
|
2017-08-01 17:28:20 -07:00 |
|
Jian He
|
91f120f743
|
YARN-6872. Ensure apps could run given NodeLabels are disabled post RM switchover/restart. Contributed by Sunil G
|
2017-08-01 09:56:33 -07:00 |
|
Varun Saxena
|
11ece0bda1
|
Addendum for YARN-5548. Use MockRMMemoryStateStore to reduce test failures (Bibin A Chundatt via Varun Saxena)
|
2017-07-28 00:10:45 +05:30 |
|
Varun Saxena
|
f66fd11e51
|
YARN-5548. Use MockRMMemoryStateStore to reduce test failures (Bibin A Chundatt via Varun Saxena)
|
2017-07-27 23:14:50 +05:30 |
|
Akira Ajisaka
|
cca51e916b
|
HADOOP-14681. Remove MockitoMaker class. Contributed by Andras Bokor.
|
2017-07-25 15:24:56 +09:00 |
|
Sunil G
|
e315328428
|
YARN-6102. RMActiveService context to be updated with new RMContext on failover. Contributed by Rohith Sharma K S.
|
2017-07-24 11:39:03 +05:30 |
|
Arun Suresh
|
077fcf6a96
|
YARN-6777. Support for ApplicationMasterService processing chain of interceptors. (asuresh)
|
2017-07-19 12:26:40 -07:00 |
|
Rohith Sharma K S
|
845c4e52bd
|
YARN-6819. Application report fails if app rejected due to nodesize. Contributed by Bibin A Chundatt.
|
2017-07-19 11:10:52 +05:30 |
|
Sunil G
|
0b7afc060c
|
Addendum patch for YARN-5731
|
2017-07-18 11:49:09 +05:30 |
|
Jason Lowe
|
a5ae5ac50e
|
YARN-3260. AM attempt fail to register before RM processes launch event. Contributed by Bibin A Chundatt
|
2017-07-14 14:56:00 -05:00 |
|
bibinchundatt
|
75c0220b44
|
YARN-6759. Fix TestRMRestart.testRMRestartWaitForPreviousAMToFinish failure. Contributed by Naganarasimha G R
|
2017-07-14 13:53:39 +05:30 |
|
Yufei Gu
|
4a574e9a84
|
YARN-6769. Make schedulables without demand less needy in FairSharePolicy#compare. (Yunfan Zhou via Yufei Gu)
|
2017-07-13 23:10:10 -07:00 |
|
Wangda Tan
|
945c0958bb
|
YARN-6775. CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls. (Nathan Roberts via wangda)
Change-Id: I84ccd54200ccbaae23018ef320028e42b4c3509a
|
2017-07-13 10:30:15 -07:00 |
|
Sunil G
|
cf0d0844d6
|
YARN-5731. Preemption calculation is not accurate when reserved containers are present in queue. Contributed by Wangda Tan.
|
2017-07-13 16:48:29 +05:30 |
|
Sunil G
|
34f113df5c
|
YARN-6714. IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. Contributed by Tao Yang.
|
2017-07-11 14:52:44 +05:30 |
|
Arun Suresh
|
5496a34c0c
|
YARN-6776. Refactor ApplicaitonMasterService to move actual processing logic to a separate class. (asuresh)
|
2017-07-10 14:34:58 -07:00 |
|
Naganarasimha
|
626d730bfc
|
YARN-6428. Queue AM limit is not honored in CS always. Contributed by Bibin A Chundatt.
|
2017-07-09 17:26:09 +05:30 |
|
Daniel Templeton
|
0615985886
|
YARN-6752. Display reserved resources in web UI per application
(Contributed by Abdullah Yousufi via Daniel Templeton)
|
2017-07-09 19:02:31 +09:00 |
|
Sunil G
|
c1edca101c
|
YARN-6280. Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API. Contributed by Lantao Jin.
|
2017-06-28 15:40:58 -07:00 |
|
Yufei Gu
|
0b77262890
|
YARN-5876. TestResourceTrackerService#testGracefulDecommissionWithApp fails intermittently on trunk. (Robert Kanter via Yufei Gu)
|
2017-06-23 13:26:03 -07:00 |
|
Sunil G
|
ca13b224b2
|
YARN-5892. Support user-specific minimum user limit percentage in Capacity Scheduler. Contributed by Eric Payne.
|
2017-06-22 23:50:57 -07:00 |
|
Naganarasimha
|
740204b292
|
YARN-5006. ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zk. Contributed by Bibin A Chundatt.
|
2017-06-23 07:52:41 +05:30 |
|
Naganarasimha
|
ee89ac84e6
|
YARN-6680. Avoid locking overhead for NO_LABEL lookups. Contributed by Daryn Sharp
|
2017-06-19 22:42:45 +05:30 |
|
Naganarasimha
|
e9c2aa1bc3
|
YARN-6467. CSQueueMetrics needs to update the current metrics for default partition only. Contributed by Manikandan R.
|
2017-06-19 21:31:40 +05:30 |
|
Eric Payne
|
5578af8603
|
YARN-6585. RM fails to start when upgrading from 2.7 for clusters with node labels. Contributed by Sunil G.
|
2017-06-09 16:16:34 -05:00 |
|
Jason Lowe
|
3fd6a2da4e
|
YARN-6643. TestRMFailover fails rarely due to port conflict. Contributed by Robert Kanter
|
2017-05-25 16:07:52 -05:00 |
|
Wangda Tan
|
c583ab02c7
|
YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Sunil G via wangda)
Change-Id: I9b19f69788068be05b3295247cdd7b972f8a573c
|
2017-05-22 14:26:13 -07:00 |
|
Yufei Gu
|
66bba8c024
|
YARN-6249. TestFairSchedulerPreemption fails inconsistently. (Tao Jie via Yufei Gu)
|
2017-05-19 14:53:27 -07:00 |
|
Min Shen
|
2ada100da7
|
YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen.
|
2017-05-11 13:25:31 -07:00 |
|
Jason Lowe
|
6099deebcb
|
YARN-6552. Increase YARN test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
|
2017-05-10 08:47:48 -05:00 |
|
Karthik Kambatla
|
166be0ee95
|
YARN-3742. YARN RM will shut down if ZKClient creation times out. (Daniel Templeton via kasha)
|
2017-05-09 14:44:16 -07:00 |
|
Andrew Wang
|
543aac9f28
|
HADOOP-14386. Rewind trunk from Guava 21.0 back to Guava 11.0.2.
|
2017-05-09 09:22:53 -07:00 |
|
Chris Douglas
|
e4f34ecb04
|
HADOOP-14390. Correct spelling of 'succeed' and variants. Contributed by Dongtao Zhang
|
2017-05-05 12:10:50 -07:00 |
|
Daniel Templeton
|
9f0aea0ee2
|
YARN-6481. Yarn top shows negative container number in FS
(Contributed by Tao Jie via Daniel Templeton)
|
2017-05-02 13:06:47 -07:00 |
|
Subru Krishnan
|
6bf42e48ef
|
YARN-5331. Extend RLESparseResourceAllocation with period for supporting recurring reservations in YARN ReservationSystem. (Sangeetha Abdu Jyothi via Subru).
|
2017-05-01 18:48:36 -07:00 |
|
Subru Krishnan
|
e514fc432a
|
YARN-6542. Fix the logger in TestAlignedPlanner and TestGreedyReservationAgent.
|
2017-05-01 18:10:07 -07:00 |
|
Subru Krishnan
|
a3a615eeab
|
YARN-4359. Update LowCost agents logic to take advantage of YARN-4358. (Jonathan Yaniv and Ishai Menache via Subru).
|
2017-05-01 16:01:07 -07:00 |
|
Daniel Templeton
|
2e52789edf
|
YARN-2962. ZKRMStateStore: Limit the number of znodes under a znode (Contributed by Varun Sexena via Daniel Templeton)
|
2017-04-28 13:30:28 -07:00 |
|
Wangda Tan
|
2ba21d6376
|
YARN-6392. Add submit time to Application Summary log. (Zhihai Xu via wangda)
|
2017-04-24 13:17:35 -07:00 |
|
Eric Payne
|
52adf71914
|
YARN-5617. AMs only intended to run one attempt can be run more than once? Contributed by Jason Lowe.
|
2017-04-24 12:03:28 -05:00 |
|
Daniel Templeton
|
dd43b895c2
|
YARN-6202. Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded
(Contributed by Yufei Gu via Daniel Templeton)
|
2017-04-19 11:44:55 -07:00 |
|
Sunil G
|
9ff25408bc
|
YARN-6164. Expose Queue Configurations per Node Label through YARN client api. Contributed by Benson Qiu.
|
2017-04-19 20:39:09 +05:30 |
|
Chris Douglas
|
af8e9842d2
|
YARN-6451. Add RM monitor validating metrics invariants. Contributed by Carlo Curino
|
2017-04-18 10:29:44 -07:00 |
|
Jason Lowe
|
4168805502
|
YARN-6480. Timeout is too aggressive for TestAMRestart.testPreemptedAMRestartOnRMRestart. Contributed by Eric Badger
|
2017-04-14 17:15:48 -05:00 |
|
Eric Payne
|
a41f8dd58e
|
YARN-5994. TestCapacityScheduler.testAMLimitUsage fails intermittently. Contributed by Eric Badger
|
2017-04-14 10:53:09 -05:00 |
|
Karthik Kambatla
|
c3375175d6
|
YARN-6432. FairScheduler: Reserve preempted resources for corresponding applications. (Miklos Szegedi via kasha)
|
2017-04-12 14:21:20 -07:00 |
|
Wangda Tan
|
4d4ad0ebb7
|
YARN-6439. Fix ReservationSystem creation of default ReservationQueue. (Carlo Curino via wangda)
|
2017-04-11 14:56:18 -07:00 |
|
Konstantinos Karanasos
|
7999318af1
|
YARN-6344. Add parameter for rack locality delay in CapacityScheduler. (kkaranasos)
|
2017-04-10 15:34:44 -07:00 |
|
Karthik Kambatla
|
b4c4f36594
|
YARN-6448. Continuous scheduling thread crashes while sorting nodes. (Yufei Gu via kasha)
|
2017-04-05 15:43:14 -07:00 |
|
Varun Saxena
|
7d963c477a
|
YARN-6437. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently (Jason Lowe via Varun Saxena)
|
2017-04-06 01:20:41 +05:30 |
|
Wangda Tan
|
87e2ef8c98
|
YARN-6406. Remove SchedulerRequestKeys when no more pending ResourceRequest. (Arun Suresh via wangda)
|
2017-04-05 11:28:30 -07:00 |
|
Karthik Kambatla
|
9cc04b4708
|
YARN-6436. TestSchedulingPolicy#testParseSchedulingPolicy timeout is too low. (Eric Badger via kasha)
|
2017-04-04 17:08:33 -07:00 |
|
Wangda Tan
|
3fdae0a2b6
|
YARN-6109. Add an ability to convert ChildQueue to ParentQueue. (Xuan Gong via wangda)
|
2017-04-04 14:39:01 -07:00 |
|
Chris Douglas
|
6eba79232f
|
HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang
|
2017-04-03 20:13:14 -07:00 |
|
Eric Payne
|
318bfb01bc
|
YARN-6354. LeveldbRMStateStore can parse invalid keys when recovering reservations. Contributed by Jason Lowe
|
2017-03-31 12:30:35 -05:00 |
|
Jason Lowe
|
4d1fac5df2
|
YARN-6411. Clean up the overwrite of createDispatcher() in subclass of MockRM. Contributed by Yufei Gu
|
2017-03-31 10:05:34 -05:00 |
|
Daniel Templeton
|
640ba1d23f
|
YARN-5685. RM configuration allows all failover methods to disabled when automatic failover is enabled
|
2017-03-29 12:38:11 -07:00 |
|
Jason Lowe
|
fdf8f8ebca
|
YARN-6359. TestRM#testApplicationKillAtAcceptedState fails rarely due to race condition. Contributed by Robert Kanter
|
2017-03-28 09:33:26 -05:00 |
|
Robert Kanter
|
9bae6720cb
|
YARN-6050. AMs can't be scheduled on racks or nodes (rkanter)
|
2017-03-27 17:23:13 -07:00 |
|