Szilard Nemeth
|
0debe55d6c
|
YARN-10160. Add auto queue creation related configs to RMWebService#CapacitySchedulerQueueInfo. Contributed by Prabhu Joseph
|
2020-05-05 13:11:28 +02:00 |
|
Inigo Goiri
|
d125d39108
|
YARN-6973. Adding RM Cluster Id in ApplicationReport. Contributed by Bilwa S T.
|
2020-04-29 11:23:58 -07:00 |
|
Szilard Nemeth
|
410c605aec
|
YARN-10247. Application priority queue ACLs are not respected. Contributed by Sunil G
|
2020-04-29 15:53:30 +02:00 |
|
Akira Ajisaka
|
6ef01646ba
|
YARN-9848. Revert YARN-4946. Contributed by Steven Rand.
|
2020-04-28 05:35:36 +09:00 |
|
Szilard Nemeth
|
f91e21ac10
|
YARN-10194. YARN RMWebServices /scheduler-conf/validate leaks ZK Connections. Contributed by Prabhu Joseph
|
2020-04-27 08:26:11 +02:00 |
|
Szilard Nemeth
|
d4874585f4
|
YARN-10237. Add isAbsoluteResource config for queue in scheduler response. Contributed by Prabhu Joseph
|
2020-04-24 17:04:47 +02:00 |
|
Szilard Nemeth
|
92b28e38b7
|
YARN-9996. Code cleanup in QueueAdminConfigurationMutationACLPolicy. Contributed by Siddharth Ahuja
|
2020-04-18 10:13:37 +02:00 |
|
Szilard Nemeth
|
76900b4f5b
|
YARN-10189. Code cleanup in LeveldbRMStateStore. Contributed by Benjamin Teke
|
2020-04-18 09:57:27 +02:00 |
|
Jonathan Hung
|
3601054822
|
YARN-9954. Configurable max application tags and max tag length. Contributed by Bilwa S T
|
2020-04-17 10:34:44 -07:00 |
|
Sunil G
|
2fe122e322
|
YARN-10154. CS Dynamic Queues cannot be configured with absolute resources. Contributed by Manikandan R.
|
2020-04-17 18:51:19 +05:30 |
|
Szilard Nemeth
|
4db598e0e6
|
YARN-9999. TestFSSchedulerConfigurationStore: Extend from ConfigurationStoreBaseTest, general code cleanup. Contributed by Benjamin Teke
|
2020-04-15 13:18:44 +02:00 |
|
Szilard Nemeth
|
55fcbcb5c2
|
YARN-10234. FS-CS converter: don't enable auto-create queue property for root. Contributed by Peter Bacsko
|
2020-04-15 07:24:04 +02:00 |
|
Jonathan Hung
|
23481ad378
|
YARN-10212. Create separate configuration for max global AM attempts. Contributed by Bilwa S T
|
2020-04-09 11:06:11 -07:00 |
|
Sunil G
|
6fb29d0f17
|
YARN-10226. NPE in Capacity Scheduler while using %primary_group queue mapping. Contributed by Peter Bacsko.
|
2020-04-09 18:51:42 +05:30 |
|
Szilard Nemeth
|
45362a9f4c
|
YARN-10001. Add explanation of unimplemented methods in InMemoryConfigurationStore. Contributed by Siddharth Ahuja
|
2020-04-07 15:51:55 +02:00 |
|
Brahma Reddy Battula
|
8914cf9167
|
Preparing for 3.4.0 development
|
2020-03-29 23:24:25 +05:30 |
|
Szilard Nemeth
|
3d5ade1839
|
YARN-10043. FairOrderingPolicy Improvements. Contributed by Manikandan R
|
2020-03-26 13:23:43 +01:00 |
|
Szilard Nemeth
|
9a297ff31d
|
YARN-10197. FS-CS converter: fix emitted ordering policy string and max-am-resource percent value. Contributed by Peter Bacsko
|
2020-03-26 12:35:10 +01:00 |
|
Szilard Nemeth
|
348685dcb9
|
YARN-9998. Code cleanup in LeveldbConfigurationStore. Contributed by Benjamin Teke
|
2020-03-26 12:18:15 +01:00 |
|
Jonathan Hung
|
6ce189c621
|
YARN-10200. Add number of containers to RMAppManager summary
|
2020-03-25 10:41:59 -07:00 |
|
Sunil G
|
cdb2107066
|
YARN-9879. Allow multiple leaf queues with the same name in CapacityScheduler. Contributed by Gergely Pollak.
|
2020-03-25 16:50:19 +05:30 |
|
Prabhu Joseph
|
d312991ead
|
YARN-10198. Remove Validation of Queue Exist under Managed Parent Queue
Contributed by Peter Bacsko. Reviewed by Manikandan R.
|
2020-03-23 18:01:14 +05:30 |
|
Prabhu Joseph
|
f2d3ac2a3f
|
YARN-10034. Remove Allocation Tags from released container from Decommission node
Contributed by Kyungwan Nam. Reviewed by Adam Antal.
|
2020-03-19 12:55:14 +05:30 |
|
Weiwei Yang
|
b9d825f178
|
YARN-9567. Add diagnostics for outstanding resource requests on app attempts page. Contributed by Tao Yang.
|
2020-03-13 14:39:36 -07:00 |
|
Szilard Nemeth
|
5ead9c15ca
|
YARN-9997. Code cleanup in ZKConfigurationStore. Contributed by Andras Gyori
|
2020-03-12 12:29:03 +01:00 |
|
Szilard Nemeth
|
38d87883b6
|
YARN-10193. FS-CS converter: fix incorrect capacity conversion. Contributed by Peter Bacsko
|
2020-03-12 12:18:37 +01:00 |
|
Sunil G
|
0fd8bf5f6b
|
YARN-10191. FS-CS converter: call System.exit function call for every code path in main method. Contributed by Peter Bacsko.
|
2020-03-12 15:03:12 +05:30 |
|
Szilard Nemeth
|
cf9cf83a43
|
YARN-9354. Resources should be created with ResourceTypesTestHelper instead of TestUtils. Contributed by Andras Gyori
|
2020-03-10 16:44:48 +01:00 |
|
Szilard Nemeth
|
61f4cf3055
|
YARN-10002. Code cleanup and improvements in ConfigurationStoreBaseTest. Contributed by Benjamin Teke
|
2020-03-10 16:35:04 +01:00 |
|
Szilard Nemeth
|
9314ef947f
|
YARN-10168. FS-CS Converter: tool doesn't handle min/max resource conversion correctly. Contributed by Peter Bacsko
|
2020-03-10 16:07:46 +01:00 |
|
Szilard Nemeth
|
ea0444851d
|
YARN.10003. YarnConfigurationStore#checkVersion throws exception that belongs to RMStateStore. Contributed by Benjamin Teke
|
2020-03-06 17:49:45 +01:00 |
|
Szilard Nemeth
|
004e955348
|
YARN-10167. FS-CS Converter: Need to validate c-s.xml after converting. Contributed by Peter Bacsko
|
2020-03-05 09:56:42 +01:00 |
|
Szilard Nemeth
|
c0d084247c
|
YARN-10175. FS-CS converter: only convert placement rules if a cmd line switch is defined. Contributed by Peter Bacsko
|
2020-03-03 09:46:32 +01:00 |
|
Szilard Nemeth
|
e9eecedf69
|
YARN-10148. addendum: Fix method call parameter order of setAdminAndSubmitACL in TestCapacitySchedulerQueueACLs. Contributed by Kinga Marton
|
2020-03-02 16:25:14 +01:00 |
|
Inigo Goiri
|
b420ddeada
|
YARN-10155. TestDelegationTokenRenewer.testTokenThreadTimeout fails in trunk. Contributed by Manikandan R.
|
2020-02-27 12:53:20 -08:00 |
|
Szilard Nemeth
|
10461e0193
|
YARN-10148. Add Unit test for queue ACL for both FS and CS. Contributed by Kinga Marton
|
2020-02-27 20:10:32 +01:00 |
|
Szilard Nemeth
|
d68616b045
|
YARN-10130. FS-CS converter: Do not allow output dir to be the same as input dir. Contributed by Adam Antal
|
2020-02-25 21:30:04 +01:00 |
|
Szilard Nemeth
|
72fa9c7f1b
|
YARN-10135. FS-CS converter tool: issue warning on dynamic auto-create mapping rules. Contributed by Peter Bacsko
|
2020-02-24 21:54:07 +01:00 |
|
Szilard Nemeth
|
34cf63c7d0
|
YARN-10157. FS-CS converter: initPropertyActions() is not called without rules file. Contributed by Peter Bacsko
|
2020-02-24 21:45:49 +01:00 |
|
Sunil G
|
6526f95bd2
|
YARN-10139. ValidateAndGetSchedulerConfiguration API fails when cluster max allocation > default 8GB. Contributed by Prabhu Joseph.
|
2020-02-19 11:17:22 +05:30 |
|
Prabhu Joseph
|
e637797211
|
YARN-10127. Remove setting App Ordering Policy to ParentQueue in FSQueueConverter
Contributed by Peter Bacsko.
|
2020-02-11 22:01:58 +05:30 |
|
Sunil G
|
28f730b317
|
YARN-10109. Allow stop and convert from leaf to parent queue in a single Mutation API call. Contributed by Prabhu Joseph
|
2020-02-09 21:14:53 +05:30 |
|
Vinayakumar B
|
7dac7e1d13
|
HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency (#1635). Contributed by Vinayakumar B.
|
2020-02-07 14:51:24 +05:30 |
|
Jonathan Hung
|
314e2f9d2e
|
YARN-10116. Expose diagnostics in RMAppManager summary
|
2020-02-04 17:44:05 -08:00 |
|
Szilard Nemeth
|
a7d72c523a
|
YARN-10099. FS-CS converter: handle allow-undeclared-pools and user-as-default-queue properly and fix misc issues. Contributed by Peter Bacsko
|
2020-01-30 16:03:38 +01:00 |
|
Eric Badger
|
e578e52aae
|
YARN-10084. Allow inheritance of max app lifetime / default app lifetime. Contributed by Eric Payne.
|
2020-01-29 03:54:43 +00:00 |
|
Inigo Goiri
|
5abd0148eb
|
YARN-9768. RM Renew Delegation token thread should timeout and retry. Contributed by Manikandan R.
|
2020-01-28 10:06:37 -08:00 |
|
Prabhu Joseph
|
1ab9c692fa
|
YARN-10022. RM Rest API to validate the CapacityScheduler Configuration change
Contributed by Kinga Marton.
|
2020-01-28 23:16:04 +05:30 |
|
Szilard Nemeth
|
94f060242e
|
YARN-10104. FS-CS converter: dry run should work without output defined. Contributed by Peter Bacsko
|
2020-01-28 15:36:04 +01:00 |
|
Szilard Nemeth
|
ca29768035
|
YARN-10085. FS-CS converter: remove mixed ordering policy check. Contributed by Peter Bacsko
|
2020-01-28 15:22:48 +01:00 |
|
Szilard Nemeth
|
9520b2ad79
|
YARN-10083. Provide utility to ask whether an application is in final status. Contributed by Adam Antal
|
2020-01-22 16:25:07 +01:00 |
|
Inigo Goiri
|
b4870bce3a
|
Revert "YARN-9768. RM Renew Delegation token thread should timeout and retry. Contributed by Manikandan R."
This reverts commit 0696828a09.
|
2020-01-21 17:45:17 -08:00 |
|
Inigo Goiri
|
0696828a09
|
YARN-9768. RM Renew Delegation token thread should timeout and retry. Contributed by Manikandan R.
|
2020-01-21 13:41:01 -08:00 |
|
Szilard Nemeth
|
581072a8f0
|
YARN-7913. Improve error handling when application recovery fails with exception. Contributed by Wilfred Spiegelenburg
|
2020-01-20 13:10:32 +01:00 |
|
Szilard Nemeth
|
8b3ee2f7e9
|
YARN-9462. TestResourceTrackerService.testNodeRemovalGracefully fails sporadically. Contributed by Prabhu Joseph
|
2020-01-20 09:54:22 +01:00 |
|
Prabhu Joseph
|
a0ff42d761
|
YARN-10070. Fix NPE if no queue mapping defined for proxy user when using application tag based placement.
Contributed by Kinga Marton. Reviewed by Adam Antal.
|
2020-01-16 12:55:27 +05:30 |
|
Szilard Nemeth
|
2aa065d98f
|
YARN-10082. FS-CS converter: disable terminal placement rule checking. Contributed by Peter Bacsko
|
2020-01-15 12:42:13 +01:00 |
|
Szilard Nemeth
|
7c5cecc3b3
|
YARN-9970. Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping. Contributed by Manikandan R
|
2020-01-15 09:55:41 +01:00 |
|
Szilard Nemeth
|
1c51f36be7
|
YARN-9788. Queue Management API does not support parallel updates. Contributed by Prabhu Joseph
|
2020-01-14 12:26:03 +01:00 |
|
Szilard Nemeth
|
621c5eac38
|
YARN-9912. Capacity scheduler: support u:user2:%secondary_group queue mapping. Contributed by Manikandan R
|
2020-01-13 17:23:00 +01:00 |
|
Szilard Nemeth
|
b7ef8a333f
|
YARN-9868. Validate %primary_group queue in CS queue manager. Contributed by Manikandan R
|
2020-01-13 17:15:09 +01:00 |
|
Szilard Nemeth
|
d842dfffa5
|
YARN-9866. u:user2:%primary_group is not working as expected. Contributed by Manikandan R
|
2020-01-12 14:04:15 +01:00 |
|
Szilard Nemeth
|
24e6a9e43a
|
YARN-10067. Add dry-run feature to FS-CS converter tool. Contributed by Peter Bacsko
|
2020-01-12 13:48:39 +01:00 |
|
Eric E Payne
|
b1e07d27cc
|
YARN-7387: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently. Contributed by Jim Brennan (Jim_Brennan)
|
2020-01-08 19:26:01 +00:00 |
|
Eric E Payne
|
6899be5a17
|
YARN-10072: TestCSAllocateCustomResource failures. Contributed by Jim Brennan (Jim_Brennan)
|
2020-01-08 17:29:56 +00:00 |
|
Szilard Nemeth
|
768ee22e9e
|
YARN-10035. Add ability to filter the Cluster Applications API request by name. Contributed by Adam Antal
|
2020-01-06 16:26:33 +01:00 |
|
Prabhu Joseph
|
eca7e14c2f
|
YARN-10053. Use Shared Group Mapping Service in Placement Rules.
Contributed by Wilfred Spiegelenburg.
|
2020-01-02 14:13:57 +05:30 |
|
Prabhu Joseph
|
21ada4d1b0
|
Revert "YARN-10053. Use Shared Group Mapping Service in Placement Rules."
This reverts commit 217b56ffdd.
|
2020-01-02 14:12:43 +05:30 |
|
Prabhu Joseph
|
217b56ffdd
|
YARN-10053. Use Shared Group Mapping Service in Placement Rules.
Contributed by Wilfred Spiegelenburg.
|
2020-01-02 14:07:49 +05:30 |
|
Eric Badger
|
412035b47a
|
YARN-10009. In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined. Contributed by Eric Payne.
|
2019-12-20 18:07:00 +00:00 |
|
Giovanni Matteo Fumarola
|
ef59ffd362
|
YARN-10038. [UI] Finish Time is not correctly parsed in the RM Apps page. Contributed by Inigo Goiri.
|
2019-12-19 11:37:17 -08:00 |
|
Jonathan Hung
|
7b93575b92
|
YARN-9894. CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues. Contributed by Eric Payne
|
2019-12-18 13:18:11 -08:00 |
|
Jonathan Hung
|
fddc3d55c3
|
YARN-10039. Allow disabling app submission from REST endpoints
|
2019-12-18 10:48:05 -08:00 |
|
Eric Badger
|
f47dcf2d4c
|
YARN-10033. TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources. Contributed by Eric Payne.
|
2019-12-17 17:11:23 +00:00 |
|
prabhujoseph
|
d4bde134e3
|
YARN-7721. Fix TestContinuousScheduling fails sporadically with NPE.
Contributed by Wilfred Spiegelenburg.
|
2019-12-10 15:00:23 +05:30 |
|
Jonathan Hung
|
6d970d8100
|
YARN-10012. Guaranteed and max capacity queue metrics for custom resources. Contributed by Manikandan R
|
2019-12-08 16:35:02 -08:00 |
|
Jonathan Hung
|
cd4779f317
|
Revert "YARN-10012. Guaranteed and max capacity queue metrics for custom resources"
This reverts commit 92bce918dc.
|
2019-12-08 16:34:46 -08:00 |
|
Jonathan Hung
|
92bce918dc
|
YARN-10012. Guaranteed and max capacity queue metrics for custom resources
|
2019-12-08 15:52:17 -08:00 |
|
prabhujoseph
|
e575df5ca6
|
YARN-10006. IOException used in place of YARNException in CapaitySheduler
Contributed by Adam Antal. Reviewed by Szilard Nemeth.
|
2019-12-06 12:51:28 +05:30 |
|
Szilard Nemeth
|
cf68857631
|
YARN-9938. Validate Parent Queue for QueueMapping contains dynamic group as parent queue. Contributed by Manikandan R
|
2019-12-05 21:04:42 +01:00 |
|
Szilard Nemeth
|
5cc6f945da
|
YARN-9789. Disable Option for Write Ahead Logs of LogMutation. Contributed by Prabhu Joseph
|
2019-12-05 20:43:26 +01:00 |
|
Szilard Nemeth
|
4627dd6708
|
YARN-9780. SchedulerConf Mutation API does not Allow Stop and Remove Queue in a single call. Contributed by Prabhu Joseph
|
2019-12-05 20:38:37 +01:00 |
|
Szilard Nemeth
|
c71befaf8f
|
YARN-9781. SchedConfCli to get current stored scheduler configuration. Contributed by Prabhu Joseph
|
2019-12-05 20:31:24 +01:00 |
|
Szilard Nemeth
|
520fe2c99b
|
YARN-5106. Provide a builder interface for FairScheduler allocations for use in tests. Contributed by Adam Antal
|
2019-12-05 17:37:40 +01:00 |
|
Sunil G
|
682e6fdeda
|
YARN-9052. Replace all MockRM submit method definitions with a builder. Contributed by Szilard Nemeth.
|
2019-12-05 13:26:23 +05:30 |
|
Szilard Nemeth
|
ef950b0863
|
YARN-9290. Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler. Contributed by Prabhu Joseph
|
2019-11-26 22:04:07 +01:00 |
|
prabhujoseph
|
aa7ab2719f
|
YARN-9991. Fix Application Tag prefix to userid. Contributed by Szilard Nemeth.
|
2019-11-27 01:59:12 +05:30 |
|
Szilard Nemeth
|
8c9018d5c7
|
YARN-9899. Migration tool that help to generate CS config based on FS config [Phase 2]. Contributed by Peter Bacsko
|
2019-11-26 21:22:35 +01:00 |
|
Szilard Nemeth
|
448ffb12ec
|
YARN-9937. addendum: Add missing queue configs in RMWebService#CapacitySchedulerQueueInfo. Contributed by Prabhu Joseph
|
2019-11-26 13:41:41 +01:00 |
|
HUAN-PING SU
|
f8e36e03b4
|
YARN-9966. Code duplication in UserGroupMappingPlacementRule (#1709)
|
2019-11-25 15:28:53 +09:00 |
|
Tao Yang
|
8afabe41e4
|
YARN-9838. Fix resource inconsistency for queues when moving app with reserved container to another queue. Contributed by jiulongzhu.
|
2019-11-22 16:06:14 +08:00 |
|
Szilard Nemeth
|
dfdc6d6dd9
|
YARN-9886. Queue mapping based on userid passed through application tag. Contributed by Julia Kinga Marton
|
2019-11-19 21:14:15 +01:00 |
|
Prabhu Joseph
|
30b2096933
|
YARN-9986. Allow app owner to signal container via RMWebServices. Contributed by kyungwan nam.
|
2019-11-19 11:35:00 +00:00 |
|
Sunil G
|
ea68756c0c
|
YARN-8373. RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH. Contributed by Wilfred Spiegelenburg.
|
2019-11-19 14:10:41 +05:30 |
|
Sunil G
|
215f2052fc
|
YARN-9984. FSPreemptionThread can cause NullPointerException while app is unregistered with containers running on a node. Contributed by Wilfred Spiegelenburg.
|
2019-11-19 14:03:02 +05:30 |
|
Szilard Nemeth
|
27642367ef
|
YARN-9011. Race condition during decommissioning. Contributed by Peter Bacsko
|
2019-11-18 16:29:39 +01:00 |
|
Yufei Gu
|
b83b9ab418
|
YARN-9537. Add configuration to disable AM preemption. Contributed by ZhouKang
|
2019-11-12 09:40:16 -08:00 |
|
Abhishek Modi
|
fb512f5087
|
YARN-9697. Efficient allocation of Opportunistic containers. Contributed by Abhishek Modi.
|
2019-11-12 16:34:04 +05:30 |
|
Szilard Nemeth
|
30b93f914b
|
YARN-9865. Capacity scheduler: add support for combined %user + %secondary_group mapping. Contributed by Manikandan R
|
2019-11-11 13:28:02 +01:00 |
|
Sunil G
|
51e7d1b37e
|
YARN-9950. Unset Ordering Policy of Leaf/Parent queue converted from Parent/Leaf queue respectively. Contributed by Prabhu Joseph.
|
2019-11-04 23:27:49 +05:30 |
|