Jian He
|
cf23f2c2b5
|
YARN-4000. RM crashes with NPE if leaf queue becomes parent queue during restart. Contributed by Varun Saxena
|
2015-10-15 17:12:46 -07:00 |
|
Jian He
|
9849c8b386
|
YARN-4230. RM crashes with NPE when increasing container resource if there is no headroom left. Contributed by Meng Ding
|
2015-10-12 11:51:33 -07:00 |
|
Zhihai Xu
|
049c6e8dc0
|
YARN-4201. AMBlacklist does not work for minicluster. Contributed by Jun Gong.
|
2015-10-12 00:14:25 -07:00 |
|
Devaraj K
|
db93047881
|
YARN-3964. Support NodeLabelsProvider at Resource Manager side.
Contributed by Dian Fu.
|
2015-10-11 11:21:29 +05:30 |
|
Wangda Tan
|
def374e666
|
YARN-4140. RM container allocation delayed incase of app submitted to Nodelabel partition. (Bibin A Chundatt via wangda)
|
2015-10-09 16:38:59 -07:00 |
|
Jason Lowe
|
a0bca2b5ad
|
YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S
|
2015-10-09 14:17:38 +00:00 |
|
Rohith Sharma K S
|
8f195387a4
|
YARN-4235. FairScheduler PrimaryGroup does not handle empty groups returned for a user. (Anubhav Dhoot via rohithsharmaks)
|
2015-10-09 10:09:26 +05:30 |
|
Rohith Sharma K S
|
9156fc60c6
|
YARN-4209. RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition. (Zhihai Xu via rohithsharmaks)
|
2015-10-07 09:34:59 +05:30 |
|
Wangda Tan
|
29a582ada0
|
YARN-4215. RMNodeLabels Manager Need to verify and replace node labels for the only modified Node Label Mappings in the request. (Naganarasimha G R via wangda)
|
2015-10-06 11:56:04 -07:00 |
|
Xuan
|
8f08532bde
|
YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma
|
2015-10-02 18:50:47 -07:00 |
|
Anubhav Dhoot
|
9735afe967
|
YARN-4180. AMLauncher does not retry on failures when talking to NM. (adhoot)
|
2015-09-28 16:13:41 -07:00 |
|
Jason Lowe
|
9f53a95ff6
|
YARN-4141. Runtime Application Priority change should not throw exception for applications at finishing states. Contributed by Sunil G
|
2015-09-28 22:55:20 +00:00 |
|
Anubhav Dhoot
|
fb2e525c07
|
YARN-4204. ConcurrentModificationException in FairSchedulerQueueInfo. (adhoot)
|
2015-09-28 09:05:45 -07:00 |
|
Rohith Sharma K S
|
a9aafad12b
|
YARN-4044. Running applications information changes such as movequeue is not published to TimeLine server. (Sunil G via rohithsharmaks)
|
2015-09-24 12:13:22 +05:30 |
|
Jian He
|
89cab1ba5f
|
YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan
|
2015-09-23 13:29:38 -07:00 |
|
Jian He
|
5f5a968d65
|
YARN-3867. ContainerImpl changes to support container resizing. Contributed by Meng Ding
|
2015-09-23 13:29:37 -07:00 |
|
Jian He
|
83a18add10
|
YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan)
|
2015-09-23 13:29:36 -07:00 |
|
Arun Suresh
|
94dec5a916
|
YARN-3920. FairScheduler container reservation on a node should be configurable to limit it to large containers (adhoot via asuresh)
|
2015-09-18 14:02:55 -07:00 |
|
Wangda Tan
|
9bc913a35c
|
YARN-3212. RMNode State Transition Update with DECOMMISSIONING state. (Junping Du via wangda)
|
2015-09-18 10:04:17 -07:00 |
|
Rohith Sharma K S
|
723c31d45b
|
YARN-4135. Improve the assertion message in MockRM while failing after waiting for the state.(Nijel S F via rohithsharmaks)
|
2015-09-18 08:44:10 +05:30 |
|
Jian He
|
6c6e734f0b
|
YARN-4034. Render cluster Max Priority in scheduler metrics in RM web UI. Contributed by Rohith Sharma K S
|
2015-09-17 14:55:50 +08:00 |
|
Jian He
|
452079af8b
|
YARN-4078. Add getPendingResourceRequestForAttempt in YarnScheduler interface. Contributed by Naganarasimha G R
|
2015-09-16 14:59:20 +08:00 |
|
Wangda Tan
|
ae5308fe1d
|
YARN-3717. Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API. (Naganarasimha G R via wangda)
|
2015-09-15 11:40:50 -07:00 |
|
Junping Du
|
73e3a49eb0
|
YARN-313. Add Admin API for supporting node resource configuration in command line. (Contributed by Inigo Goiri, Kenji Kikushima and Junping Du)
|
2015-09-15 07:56:47 -07:00 |
|
Jian He
|
5468baa80a
|
YARN-3635. Refactored current queue mapping implementation in CapacityScheduler to use a generic PlacementManager framework. Contributed by Wangda Tan
|
2015-09-15 15:39:20 +08:00 |
|
Jian He
|
e1b1d7e4ae
|
YARN-4126. RM should not issue delegation tokens in unsecure mode. Contributed by Bibin A Chundatt
|
2015-09-14 14:09:19 +08:00 |
|
Karthik Kambatla
|
332b520a48
|
YARN-3697. FairScheduler: ContinuousSchedulingThread can fail to shutdown. (Zhihai Xu via kasha)
|
2015-09-13 18:07:43 -07:00 |
|
Karthik Kambatla
|
81df7b586a
|
YARN-2005. Blacklisting support for scheduling AMs. (Anubhav Dhoot via kasha)
|
2015-09-13 17:03:15 -07:00 |
|
Robert Kanter
|
ea4bb2749f
|
YARN-4145. Make RMHATestBase abstract so its not run when running all tests under that namespace (adhoot via rkanter)
|
2015-09-11 11:46:10 -07:00 |
|
Wangda Tan
|
bcc85e3bab
|
YARN-4024. YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat. (Hong Zhiguo via wangda)
|
2015-09-04 15:13:53 -07:00 |
|
Jason Lowe
|
6eaca2e363
|
YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li
|
2015-09-04 15:30:53 +00:00 |
|
Varun Vasudev
|
40d222e862
|
YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles.
|
2015-09-04 14:31:51 +05:30 |
|
Varun Vasudev
|
b469ac531a
|
YARN-3970. Add REST api support for Application Priority. Contributed by Naganarasimha G R.
|
2015-09-03 16:40:10 +05:30 |
|
Jian He
|
09c64ba1ba
|
YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong
|
2015-09-02 17:45:23 -07:00 |
|
Rohith Sharma K S
|
7d6687fe76
|
YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks)
|
2015-09-02 15:22:48 +05:30 |
|
Varun Vasudev
|
bf669b6d9f
|
YARN-4082. Container shouldn't be killed when node's label updated. Contributed by Wangda Tan.
|
2015-09-01 14:19:11 +05:30 |
|
Junping Du
|
beb65c9465
|
YARN-1556. NPE getting application report with a null appId. Contributed by Weiwei Yang.
|
2015-08-28 05:57:34 -07:00 |
|
Jian He
|
a9c8ea71aa
|
YARN-3250. Support admin cli interface in for Application Priority. Contributed by Rohith Sharma K S
|
2015-08-27 13:25:53 -07:00 |
|
Jian He
|
57c7ae1aff
|
YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S
|
2015-08-24 20:36:44 -07:00 |
|
Rohith Sharma K S
|
feaf034994
|
YARN-3896. RMNode transitioned from RUNNING to REBOOTED because its response id has not been reset synchronously. (Jun Gong via rohithsharmaks)
|
2015-08-24 11:25:07 +05:30 |
|
Xuan
|
37e1c3d82a
|
YARN-221. NM should provide a way for AM to tell it not to aggregate
logs. Contributed by Ming Ma
|
2015-08-22 16:25:24 -07:00 |
|
Rohith Sharma K S
|
22de7c1dca
|
YARN-3986. getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface
|
2015-08-21 10:51:11 +05:30 |
|
Zhihai Xu
|
3a76a010b8
|
YARN-3857: Memory leak in ResourceManager with SIMPLE mode. Contributed by mujunchao.
|
2015-08-18 10:36:40 -07:00 |
|
Jian He
|
e5003be907
|
YARN-4026. Refactored ContainerAllocator to accept a list of priorites rather than a single priority. Contributed by Wangda Tan
|
2015-08-12 15:07:50 -07:00 |
|
rohithsharmaks
|
1c12adb71f
|
YARN-4023. Publish Application Priority to TimelineServer. (Sunil G via rohithsharmaks)
|
2015-08-12 14:45:41 +05:30 |
|
Xuan
|
3ae716fa69
|
YARN-3999. RM hangs on draing events. Contributed by Jian He
|
2015-08-11 18:25:11 -07:00 |
|
Jian He
|
fa1d84ae27
|
YARN-3887. Support changing Application priority during runtime. Contributed by Sunil G
|
2015-08-10 20:51:54 -07:00 |
|
Wangda Tan
|
cf9d3c9256
|
YARN-3873. PendingApplications in LeafQueue should also use OrderingPolicy. (Sunil G via wangda)
|
2015-08-10 14:54:55 -07:00 |
|
Rohith Sharma K S
|
b6265d39c5
|
YARN-3948. Display Application Priority in RM Web UI.(Sunil G via rohithsharmaks)
|
2015-08-07 10:43:41 +05:30 |
|
Carlo Curino
|
8572a5a14b
|
YARN-3974. Refactor the reservation system test cases to use parameterized base test. (subru via curino)
|
2015-08-02 01:55:31 -07:00 |
|
Arun Suresh
|
154c9d2e42
|
YARN-3961. Expose pending, running and reserved containers of a queue in REST api and yarn top (adhoot via asuresh)
|
2015-08-05 23:14:14 -07:00 |
|
rohithsharmaks
|
df9e7280db
|
YARN-3992. TestApplicationPriority.testApplicationPriorityAllocation fails intermittently. (Contributed by Sunil G)
|
2015-08-06 10:43:37 +05:30 |
|
Jian He
|
ba2313d614
|
YARN-3983. Refactored CapacityScheduleri#FiCaSchedulerApp to easier extend container allocation logic. Contributed by Wangda Tan
|
2015-08-05 13:47:40 -07:00 |
|
Arun Suresh
|
f271d37735
|
YARN-3736. Add RMStateStore apis to store and load accepted reservations for failover (adhoot via asuresh)
|
2015-08-05 12:57:12 -07:00 |
|
Xuan
|
0306d902f5
|
YARN-3543. ApplicationReport should be able to tell whether the
Application is AM managed or not. Contributed by Rohith Sharma K S
|
2015-08-03 15:46:00 -07:00 |
|
Jonathan Eagles
|
3cd02b9522
|
YARN-3978. Configurably turn off the saving of container info in Generic AHS (Eric Payne via jeagles)
|
2015-08-03 10:38:05 -05:00 |
|
Jason Lowe
|
32e490b6c0
|
YARN-3990. AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected. Contributed by Bibin A Chundatt
|
2015-07-31 17:37:24 +00:00 |
|
Zhihai Xu
|
ab80e27703
|
YARN-433. When RM is catching up with node updates then it should not expire acquired containers. Contributed by Xuan Gong
|
2015-07-30 21:57:11 -07:00 |
|
Wangda Tan
|
91b42e7d6e
|
YARN-3971. Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery. (Bibin A Chundatt via wangda)
|
2015-07-30 10:00:31 -07:00 |
|
ccurino
|
156f24ead0
|
YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino)
|
2015-07-25 07:39:47 -07:00 |
|
Jian He
|
83fe34ac08
|
YARN-3026. Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp. Contributed by Wangda Tan
|
2015-07-24 14:00:25 -07:00 |
|
Karthik Kambatla
|
d19d187753
|
YARN-3957. FairScheduler NPE In FairSchedulerQueueInfo causing scheduler page to return 500. (Anubhav Dhoot via kasha)
|
2015-07-24 11:44:37 -07:00 |
|
carlo curino
|
0fcb4a8cf2
|
YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino)
|
2015-07-23 19:33:59 -07:00 |
|
Robert Kanter
|
1d3026e7b3
|
YARN-3900. Protobuf layout of yarn_security_token causes errors in other protos that include it (adhoot via rkanter)
|
2015-07-23 14:46:54 -07:00 |
|
Wangda Tan
|
3bba180051
|
YARN-3941. Proportional Preemption policy should try to avoid sending duplicate PREEMPT_CONTAINER event to scheduler. (Sunil G via wangda)
|
2015-07-23 10:07:57 -07:00 |
|
Wangda Tan
|
76ec26de80
|
YARN-3932. SchedulerApplicationAttempt#getResourceUsageReport and UserInfo should based on total-used-resources. (Bibin A Chundatt via wangda)
|
2015-07-22 11:54:02 -07:00 |
|
Wangda Tan
|
c39ca541f4
|
YARN-2003. Support for Application priority : Changes in RM and Capacity Scheduler. (Sunil G via wangda)
|
2015-07-21 09:57:23 -07:00 |
|
Arun Suresh
|
9b272ccae7
|
YARN-3535. Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED (rohithsharma and peng.zhang via asuresh)
|
2015-07-17 04:31:34 -07:00 |
|
Wangda Tan
|
3540d5fe4b
|
YARN-3885. ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level. (Ajith S via wangda)
|
2015-07-16 16:13:32 -07:00 |
|
Arun Suresh
|
ac94ba3e18
|
YARN-3453. Ensure preemption logic in FairScheduler uses DominantResourceCalculator in DRF queues to prevent unnecessary thrashing. (asuresh)
|
2015-07-14 00:23:55 -07:00 |
|
Wangda Tan
|
5ed1fead6b
|
YARN-3894. RM startup should fail for wrong CS xml NodeLabel capacity configuration. (Bibin A Chundatt via wangda)
|
2015-07-12 21:52:11 -07:00 |
|
Wangda Tan
|
1df39c1efc
|
YARN-3849. Too much of preemption activity causing continuos killing of containers across queues. (Sunil G via wangda)
|
2015-07-11 10:26:46 -07:00 |
|
Zhijie Shen
|
1ea36299a4
|
YARN-3116. RM notifies NM whether a container is an AM container or normal task container. Contributed by Giovanni Matteo Fumarola.
|
2015-07-10 18:58:10 -07:00 |
|
Ming Ma
|
08244264c0
|
YARN-3445. Cache runningApps in RMNode for getting running apps on given NodeId. (Junping Du via mingma)
|
2015-07-10 08:30:10 -07:00 |
|
carlo curino
|
0e602fa3a1
|
YARN-3800. Reduce storage footprint for ReservationAllocation. Contributed by Anubhav Dhoot.
|
2015-07-09 16:51:59 -07:00 |
|
Wangda Tan
|
0e4b06690f
|
YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda)
|
2015-07-01 17:32:22 -07:00 |
|
Devaraj K
|
80a68d6056
|
YARN-3830. AbstractYarnScheduler.createReleaseCache may try to clean a
null attempt. Contributed by nijel.
|
2015-07-01 19:03:44 +05:30 |
|
Xuan
|
fe6c1bd73a
|
YARN-2871. TestRMRestart#testRMRestartGetApplicationList sometime fails
in trunk. Contributed by zhihai xu
|
2015-06-26 19:43:59 -07:00 |
|
Xuan
|
5b5bb8dcdc
|
YARN-3802. Two RMNodes for the same NodeId are used in RM sometimes
after NM is reconnected. Contributed by zhihai xu
|
2015-06-18 14:37:49 -07:00 |
|
Xuan
|
a826d432f9
|
YARN-3804. Both RM are on standBy state when kerberos user not in yarn.admin.acl. Contributed by Varun Saxena
|
2015-06-17 16:23:27 -07:00 |
|
Devaraj K
|
d8dcfa98e3
|
YARN-3794. TestRMEmbeddedElector fails because of ambiguous LOG reference.
Contributed by Chengbing Liu.
|
2015-06-12 13:42:49 +05:30 |
|
Xuan
|
5583f88bf7
|
YARN-3785. Support for Resource as an argument during submitApp call in
MockRM test class. Contributed by Sunil G
|
2015-06-10 21:40:48 -07:00 |
|
Jian He
|
960b8f19ca
|
YARN-2716. Refactor ZKRMStateStore retry code with Apache Curator. Contributed by Karthik Kambatla
|
2015-06-08 14:50:58 -07:00 |
|
Karthik Kambatla
|
bd69ea408f
|
YARN-3655. FairScheduler: potential livelock due to maxAMShare limitation and container reservation. (Zhihai Xu via kasha)
|
2015-06-07 11:37:52 -07:00 |
|
Xuan
|
3e000a919f
|
YARN-1462. AHS API and other AHS changes to handle tags for completed MR jobs. Contributed by Xuan Gong
|
2015-06-05 12:48:52 -07:00 |
|
Karthik Kambatla
|
75885852cc
|
YARN-3259. FairScheduler: Trigger fairShare updates on node events. (Anubhav Dhoot via kasha)
|
2015-06-05 09:39:41 -07:00 |
|
Jian He
|
6ad4e59cfc
|
YARN-3764. CapacityScheduler should forbid moving LeafQueue from one parent to another. Contributed by Wangda Tan
|
2015-06-04 10:52:59 -07:00 |
|
Wangda Tan
|
ebd797c48f
|
YARN-3733. Fix DominantRC#compare() does not work as expected if cluster resource is empty. (Rohith Sharmaks via wangda)
|
2015-06-04 10:22:57 -07:00 |
|
Junping Du
|
d7e7f6aa03
|
YARN-41. The RM should handle the graceful shutdown of the NM. Contributed by Devaraj K.
|
2015-06-04 04:59:27 -07:00 |
|
Xuan
|
5766a04428
|
YARN-3749. We should make a copy of configuration when init
MiniYARNCluster with multiple RMs. Contributed by Chun Chen
|
2015-06-03 17:20:15 -07:00 |
|
Zhijie Shen
|
bc85959edd
|
Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong."
This reverts commit 4a9ec1a824 .
|
2015-06-03 14:15:56 -07:00 |
|
Zhijie Shen
|
4a9ec1a824
|
YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong.
|
2015-05-30 21:05:36 -07:00 |
|
Vinod Kumar Vavilapalli
|
9acd24fec4
|
Fixed more FilesSystemRMStateStore issues. Contributed by Vinod Kumar Vavilapalli.
|
2015-05-28 15:25:56 -07:00 |
|
Allen Wittenauer
|
d6e3164d4a
|
YARN-2355. MAX_APP_ATTEMPTS_ENV may no longer be a useful env var for a container (Darrell Taylor via aw)
|
2015-05-27 16:40:56 -07:00 |
|
Wangda Tan
|
ec0a852a37
|
YARN-3647. RMWebServices api's should use updated api from CommonNodeLabelsManager to get NodeLabel object. (Sunil G via wangda)
|
2015-05-27 12:51:20 -07:00 |
|
Wangda Tan
|
cdbd66be11
|
YARN-3686. CapacityScheduler should trim default_node_label_expression. (Sunil G via wangda)
|
2015-05-26 15:58:47 -07:00 |
|
Jian He
|
10732d515f
|
YARN-3632. Ordering policy should be allowed to reorder an application when demand changes. Contributed by Craig Welch
|
2015-05-26 12:00:51 -07:00 |
|
Tsuyoshi Ozawa
|
9a3d617b63
|
YARN-2336. Fair scheduler's REST API returns a missing '[' bracket JSON for deep queue tree. Contributed by Kenji Kikushima and Akira Ajisaka.
|
2015-05-26 19:07:40 +09:00 |
|
Karthik Kambatla
|
4513761869
|
YARN-3675. FairScheduler: RM quits when node removal races with continuous-scheduling on the same node. (Anubhav Dhoot via kasha)
|
2015-05-21 13:44:42 -07:00 |
|
Jian He
|
8966d42179
|
YARN-3609. Load node labels from storage inside RM serviceStart. Contributed by Wangda Tan
|
2015-05-20 16:30:07 -07:00 |
|