Eric Badger
|
41bcef9486
|
YARN-10348. Allow RM to always cancel tokens after app completes. Contributed by
Jim Brennan
(cherry picked from commit 48f90115b5)
|
2020-07-13 23:12:18 +00:00 |
|
Eric E Payne
|
7044a007b3
|
YARN-10297. TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently. Contributed by Jim Brennan (Jim_Brennan)
(cherry picked from commit 0427100b75)
|
2020-07-13 19:02:40 +00:00 |
|
Akira Ajisaka
|
20df70a895
|
HADOOP-17111. Replace Guava Optional with Java8+ Optional. Contributed by Ahmed Hussein.
(cherry picked from commit 639acb6d89)
|
2020-07-06 16:09:37 +09:00 |
|
Szilard Nemeth
|
439c51425e
|
YARN-10330. Add missing test scenarios to TestUserGroupMappingPlacementRule and TestAppNameMappingPlacementRule. Contributed by Peter Bacsko
|
2020-07-01 17:42:45 +02:00 |
|
Szilard Nemeth
|
8b482744e9
|
YARN-10277. CapacityScheduler test TestUserGroupMappingPlacementRule should build proper hierarchy. Contributed by Szilard Nemeth
|
2020-06-30 11:32:59 +02:00 |
|
Eric E Payne
|
d7696453a0
|
YARN-9903: Support reservations continue looking for Node Labels. Contributed by Jim Brennan (Jim_Brennan).
(cherry picked from commit 74fc13cf91)
|
2020-06-29 18:59:52 +00:00 |
|
Szilard Nemeth
|
fa41e38450
|
YARN-10279. Avoid unnecessary QueueMappingEntity creations. Contributed by Marton Hudaky
(cherry picked from commit 6a8fd73b27)
|
2020-06-25 17:28:48 +02:00 |
|
Szilard Nemeth
|
480919e42d
|
YARN-10316. FS-CS converter: convert maxAppsDefault, maxRunningApps settings. Contributed by Peter Bacsko
|
2020-06-23 16:25:33 +02:00 |
|
Szilard Nemeth
|
8f1b70e367
|
YARN-9930. Support max running app logic for CapacityScheduler. Contributed by Peter Bacsko
|
2020-06-22 12:00:06 +02:00 |
|
Szilard Nemeth
|
ec913398a9
|
YARN-10281. Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule. Contributed by Gergely Pollak
|
2020-06-17 14:36:08 +02:00 |
|
Szilard Nemeth
|
8be302a3b8
|
YARN-10274. Merge QueueMapping and QueueMappingEntity. Contributed by Gergely Pollak
|
2020-06-16 18:25:47 +02:00 |
|
Szilard Nemeth
|
52efe48d79
|
YARN-10292. FS-CS converter: add an option to enable asynchronous scheduling in CapacityScheduler. Contributed by Benjamin Teke
|
2020-06-16 18:01:39 +02:00 |
|
Vinayakumar B
|
534b15caf9
|
HADOOP-17046. Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes (#2026)
|
2020-06-12 23:20:10 +05:30 |
|
Eric E Payne
|
a7526ba9f7
|
YARN-10300: appMasterHost not set in RM ApplicationSummary when AM fails before first heartbeat. Contributed by Eric Badger (ebadger).
(cherry picked from commit 56247db302)
|
2020-06-09 18:51:46 +00:00 |
|
Szilard Nemeth
|
a266e32d82
|
YARN-10286. PendingContainers bugs in the scheduler outputs. Contributed by Andras Gyori
|
2020-06-05 09:50:43 +02:00 |
|
Szilard Nemeth
|
f65f64e8ae
|
YARN-10254. CapacityScheduler incorrect User Group Mapping after leaf queue change. Contributed by Gergely Pollak
|
2020-06-02 18:32:06 +02:00 |
|
Prabhu Joseph
|
07b8963aa3
|
YARN-10259. Fix reservation logic in Multi Node Placement.
Reviewed by Wangda Tan.
(cherry picked from commit 6ce295b787)
|
2020-06-01 18:24:38 +05:30 |
|
Jonathan Hung
|
7a323a45aa
|
YARN-6492. Generate queue metrics for each partition. Contributed by Manikandan R
(cherry picked from commit c30c23cb66)
|
2020-05-29 09:25:08 -07:00 |
|
Szilard Nemeth
|
94358dbc3c
|
YARN-10108. FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping. Contributed by Gergely Pollak
(cherry picked from commit ac4540dd8e)
|
2020-05-27 13:07:17 +02:00 |
|
Szilard Nemeth
|
2c60bcb1c2
|
Revert "FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping. Contributed by Gergely Pollak"
This reverts commit 9ce913a7bf.
Reverting because of missing Jira-ID in the commit message
|
2020-05-27 13:07:01 +02:00 |
|
Szilard Nemeth
|
9ce913a7bf
|
FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping. Contributed by Gergely Pollak
(cherry picked from commit ac4540dd8e)
|
2020-05-22 14:48:53 +02:00 |
|
Jonathan Hung
|
564d3211f2
|
YARN-10260. Allow transitioning queue from DRAINING to RUNNING state. Contributed by Bilwa S T
(cherry picked from commit fff1d2c122)
|
2020-05-12 10:49:10 -07:00 |
|
Szilard Nemeth
|
95e4ed18a6
|
YARN-10160. Add auto queue creation related configs to RMWebService#CapacitySchedulerQueueInfo. Contributed by Prabhu Joseph
|
2020-05-12 09:03:50 +02:00 |
|
Ahmed Hussein
|
7aade932c7
|
YARN-8959. TestContainerResizing fails randomly (Ahmed Hussein via jeagles)
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
(cherry picked from commit 92e3ebb401)
|
2020-05-06 12:28:04 -05:00 |
|
Akira Ajisaka
|
dfa7f160a5
|
Preparing for 3.3.1 development
|
2020-04-30 13:33:42 +09:00 |
|
Szilard Nemeth
|
8ffe1f313c
|
YARN-10247. Application priority queue ACLs are not respected. Contributed by Sunil G
(cherry picked from commit 410c605aec)
|
2020-04-29 15:54:32 +02:00 |
|
Szilard Nemeth
|
75433a658d
|
YARN-10237. Add isAbsoluteResource config for queue in scheduler response. Contributed by Prabhu Joseph
|
2020-04-29 09:36:37 +02:00 |
|
Akira Ajisaka
|
62ee5970f8
|
YARN-9848. Revert YARN-4946. Contributed by Steven Rand.
(cherry picked from commit 6ef01646ba)
|
2020-04-28 05:45:37 +09:00 |
|
Szilard Nemeth
|
c0b7b38e22
|
YARN-10194. YARN RMWebServices /scheduler-conf/validate leaks ZK Connections. Contributed by Prabhu Joseph
(cherry picked from commit f91e21ac10)
|
2020-04-27 08:26:46 +02:00 |
|
Szilard Nemeth
|
7a3f190d89
|
YARN-10189. Code cleanup in LeveldbRMStateStore. Contributed by Benjamin Teke
|
2020-04-24 17:09:35 +02:00 |
|
Szilard Nemeth
|
61ca459c74
|
YARN-9999. TestFSSchedulerConfigurationStore: Extend from ConfigurationStoreBaseTest, general code cleanup. Contributed by Benjamin Teke
|
2020-04-24 11:28:52 +02:00 |
|
Szilard Nemeth
|
1340518cd8
|
YARN-9996. Code cleanup in QueueAdminConfigurationMutationACLPolicy. Contributed by Siddharth Ahuja
|
2020-04-23 14:55:50 +02:00 |
|
Jonathan Hung
|
49ae9b2137
|
YARN-9954. Configurable max application tags and max tag length. Contributed by Bilwa S T
|
2020-04-17 10:34:59 -07:00 |
|
Szilard Nemeth
|
f473473355
|
YARN-10234. FS-CS converter: don't enable auto-create queue property for root. Contributed by Peter Bacsko
(cherry picked from commit 55fcbcb5c2)
|
2020-04-15 07:27:47 +02:00 |
|
Jonathan Hung
|
e1dd78143b
|
YARN-10212. Create separate configuration for max global AM attempts. Contributed by Bilwa S T
(cherry picked from commit 57659422abbf6d9bf52e6e27fca775254bb77a56)
|
2020-04-09 11:06:49 -07:00 |
|
Sunil G
|
94df6b513b
|
YARN-10226. NPE in Capacity Scheduler while using %primary_group queue mapping. Contributed by Peter Bacsko.
(cherry picked from commit 6fb29d0f17)
|
2020-04-09 18:52:52 +05:30 |
|
Szilard Nemeth
|
7abc6221a3
|
YARN-10001. Add explanation of unimplemented methods in InMemoryConfigurationStore. Contributed by Siddharth Ahuja
(cherry picked from commit 45362a9f4c)
|
2020-04-07 16:01:47 +02:00 |
|
Szilard Nemeth
|
3d5ade1839
|
YARN-10043. FairOrderingPolicy Improvements. Contributed by Manikandan R
|
2020-03-26 13:23:43 +01:00 |
|
Szilard Nemeth
|
9a297ff31d
|
YARN-10197. FS-CS converter: fix emitted ordering policy string and max-am-resource percent value. Contributed by Peter Bacsko
|
2020-03-26 12:35:10 +01:00 |
|
Szilard Nemeth
|
348685dcb9
|
YARN-9998. Code cleanup in LeveldbConfigurationStore. Contributed by Benjamin Teke
|
2020-03-26 12:18:15 +01:00 |
|
Jonathan Hung
|
6ce189c621
|
YARN-10200. Add number of containers to RMAppManager summary
|
2020-03-25 10:41:59 -07:00 |
|
Sunil G
|
cdb2107066
|
YARN-9879. Allow multiple leaf queues with the same name in CapacityScheduler. Contributed by Gergely Pollak.
|
2020-03-25 16:50:19 +05:30 |
|
Prabhu Joseph
|
d312991ead
|
YARN-10198. Remove Validation of Queue Exist under Managed Parent Queue
Contributed by Peter Bacsko. Reviewed by Manikandan R.
|
2020-03-23 18:01:14 +05:30 |
|
Prabhu Joseph
|
f2d3ac2a3f
|
YARN-10034. Remove Allocation Tags from released container from Decommission node
Contributed by Kyungwan Nam. Reviewed by Adam Antal.
|
2020-03-19 12:55:14 +05:30 |
|
Weiwei Yang
|
b9d825f178
|
YARN-9567. Add diagnostics for outstanding resource requests on app attempts page. Contributed by Tao Yang.
|
2020-03-13 14:39:36 -07:00 |
|
Szilard Nemeth
|
5ead9c15ca
|
YARN-9997. Code cleanup in ZKConfigurationStore. Contributed by Andras Gyori
|
2020-03-12 12:29:03 +01:00 |
|
Szilard Nemeth
|
38d87883b6
|
YARN-10193. FS-CS converter: fix incorrect capacity conversion. Contributed by Peter Bacsko
|
2020-03-12 12:18:37 +01:00 |
|
Sunil G
|
0fd8bf5f6b
|
YARN-10191. FS-CS converter: call System.exit function call for every code path in main method. Contributed by Peter Bacsko.
|
2020-03-12 15:03:12 +05:30 |
|
Szilard Nemeth
|
cf9cf83a43
|
YARN-9354. Resources should be created with ResourceTypesTestHelper instead of TestUtils. Contributed by Andras Gyori
|
2020-03-10 16:44:48 +01:00 |
|
Szilard Nemeth
|
61f4cf3055
|
YARN-10002. Code cleanup and improvements in ConfigurationStoreBaseTest. Contributed by Benjamin Teke
|
2020-03-10 16:35:04 +01:00 |
|
Szilard Nemeth
|
9314ef947f
|
YARN-10168. FS-CS Converter: tool doesn't handle min/max resource conversion correctly. Contributed by Peter Bacsko
|
2020-03-10 16:07:46 +01:00 |
|
Szilard Nemeth
|
ea0444851d
|
YARN.10003. YarnConfigurationStore#checkVersion throws exception that belongs to RMStateStore. Contributed by Benjamin Teke
|
2020-03-06 17:49:45 +01:00 |
|
Szilard Nemeth
|
004e955348
|
YARN-10167. FS-CS Converter: Need to validate c-s.xml after converting. Contributed by Peter Bacsko
|
2020-03-05 09:56:42 +01:00 |
|
Szilard Nemeth
|
c0d084247c
|
YARN-10175. FS-CS converter: only convert placement rules if a cmd line switch is defined. Contributed by Peter Bacsko
|
2020-03-03 09:46:32 +01:00 |
|
Szilard Nemeth
|
e9eecedf69
|
YARN-10148. addendum: Fix method call parameter order of setAdminAndSubmitACL in TestCapacitySchedulerQueueACLs. Contributed by Kinga Marton
|
2020-03-02 16:25:14 +01:00 |
|
Inigo Goiri
|
b420ddeada
|
YARN-10155. TestDelegationTokenRenewer.testTokenThreadTimeout fails in trunk. Contributed by Manikandan R.
|
2020-02-27 12:53:20 -08:00 |
|
Szilard Nemeth
|
10461e0193
|
YARN-10148. Add Unit test for queue ACL for both FS and CS. Contributed by Kinga Marton
|
2020-02-27 20:10:32 +01:00 |
|
Szilard Nemeth
|
d68616b045
|
YARN-10130. FS-CS converter: Do not allow output dir to be the same as input dir. Contributed by Adam Antal
|
2020-02-25 21:30:04 +01:00 |
|
Szilard Nemeth
|
72fa9c7f1b
|
YARN-10135. FS-CS converter tool: issue warning on dynamic auto-create mapping rules. Contributed by Peter Bacsko
|
2020-02-24 21:54:07 +01:00 |
|
Szilard Nemeth
|
34cf63c7d0
|
YARN-10157. FS-CS converter: initPropertyActions() is not called without rules file. Contributed by Peter Bacsko
|
2020-02-24 21:45:49 +01:00 |
|
Sunil G
|
6526f95bd2
|
YARN-10139. ValidateAndGetSchedulerConfiguration API fails when cluster max allocation > default 8GB. Contributed by Prabhu Joseph.
|
2020-02-19 11:17:22 +05:30 |
|
Prabhu Joseph
|
e637797211
|
YARN-10127. Remove setting App Ordering Policy to ParentQueue in FSQueueConverter
Contributed by Peter Bacsko.
|
2020-02-11 22:01:58 +05:30 |
|
Sunil G
|
28f730b317
|
YARN-10109. Allow stop and convert from leaf to parent queue in a single Mutation API call. Contributed by Prabhu Joseph
|
2020-02-09 21:14:53 +05:30 |
|
Vinayakumar B
|
7dac7e1d13
|
HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency (#1635). Contributed by Vinayakumar B.
|
2020-02-07 14:51:24 +05:30 |
|
Jonathan Hung
|
314e2f9d2e
|
YARN-10116. Expose diagnostics in RMAppManager summary
|
2020-02-04 17:44:05 -08:00 |
|
Szilard Nemeth
|
a7d72c523a
|
YARN-10099. FS-CS converter: handle allow-undeclared-pools and user-as-default-queue properly and fix misc issues. Contributed by Peter Bacsko
|
2020-01-30 16:03:38 +01:00 |
|
Eric Badger
|
e578e52aae
|
YARN-10084. Allow inheritance of max app lifetime / default app lifetime. Contributed by Eric Payne.
|
2020-01-29 03:54:43 +00:00 |
|
Inigo Goiri
|
5abd0148eb
|
YARN-9768. RM Renew Delegation token thread should timeout and retry. Contributed by Manikandan R.
|
2020-01-28 10:06:37 -08:00 |
|
Prabhu Joseph
|
1ab9c692fa
|
YARN-10022. RM Rest API to validate the CapacityScheduler Configuration change
Contributed by Kinga Marton.
|
2020-01-28 23:16:04 +05:30 |
|
Szilard Nemeth
|
94f060242e
|
YARN-10104. FS-CS converter: dry run should work without output defined. Contributed by Peter Bacsko
|
2020-01-28 15:36:04 +01:00 |
|
Szilard Nemeth
|
ca29768035
|
YARN-10085. FS-CS converter: remove mixed ordering policy check. Contributed by Peter Bacsko
|
2020-01-28 15:22:48 +01:00 |
|
Szilard Nemeth
|
9520b2ad79
|
YARN-10083. Provide utility to ask whether an application is in final status. Contributed by Adam Antal
|
2020-01-22 16:25:07 +01:00 |
|
Inigo Goiri
|
b4870bce3a
|
Revert "YARN-9768. RM Renew Delegation token thread should timeout and retry. Contributed by Manikandan R."
This reverts commit 0696828a09.
|
2020-01-21 17:45:17 -08:00 |
|
Inigo Goiri
|
0696828a09
|
YARN-9768. RM Renew Delegation token thread should timeout and retry. Contributed by Manikandan R.
|
2020-01-21 13:41:01 -08:00 |
|
Szilard Nemeth
|
581072a8f0
|
YARN-7913. Improve error handling when application recovery fails with exception. Contributed by Wilfred Spiegelenburg
|
2020-01-20 13:10:32 +01:00 |
|
Szilard Nemeth
|
8b3ee2f7e9
|
YARN-9462. TestResourceTrackerService.testNodeRemovalGracefully fails sporadically. Contributed by Prabhu Joseph
|
2020-01-20 09:54:22 +01:00 |
|
Prabhu Joseph
|
a0ff42d761
|
YARN-10070. Fix NPE if no queue mapping defined for proxy user when using application tag based placement.
Contributed by Kinga Marton. Reviewed by Adam Antal.
|
2020-01-16 12:55:27 +05:30 |
|
Szilard Nemeth
|
2aa065d98f
|
YARN-10082. FS-CS converter: disable terminal placement rule checking. Contributed by Peter Bacsko
|
2020-01-15 12:42:13 +01:00 |
|
Szilard Nemeth
|
7c5cecc3b3
|
YARN-9970. Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping. Contributed by Manikandan R
|
2020-01-15 09:55:41 +01:00 |
|
Szilard Nemeth
|
1c51f36be7
|
YARN-9788. Queue Management API does not support parallel updates. Contributed by Prabhu Joseph
|
2020-01-14 12:26:03 +01:00 |
|
Szilard Nemeth
|
621c5eac38
|
YARN-9912. Capacity scheduler: support u:user2:%secondary_group queue mapping. Contributed by Manikandan R
|
2020-01-13 17:23:00 +01:00 |
|
Szilard Nemeth
|
b7ef8a333f
|
YARN-9868. Validate %primary_group queue in CS queue manager. Contributed by Manikandan R
|
2020-01-13 17:15:09 +01:00 |
|
Szilard Nemeth
|
d842dfffa5
|
YARN-9866. u:user2:%primary_group is not working as expected. Contributed by Manikandan R
|
2020-01-12 14:04:15 +01:00 |
|
Szilard Nemeth
|
24e6a9e43a
|
YARN-10067. Add dry-run feature to FS-CS converter tool. Contributed by Peter Bacsko
|
2020-01-12 13:48:39 +01:00 |
|
Eric E Payne
|
b1e07d27cc
|
YARN-7387: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently. Contributed by Jim Brennan (Jim_Brennan)
|
2020-01-08 19:26:01 +00:00 |
|
Eric E Payne
|
6899be5a17
|
YARN-10072: TestCSAllocateCustomResource failures. Contributed by Jim Brennan (Jim_Brennan)
|
2020-01-08 17:29:56 +00:00 |
|
Szilard Nemeth
|
768ee22e9e
|
YARN-10035. Add ability to filter the Cluster Applications API request by name. Contributed by Adam Antal
|
2020-01-06 16:26:33 +01:00 |
|
Prabhu Joseph
|
eca7e14c2f
|
YARN-10053. Use Shared Group Mapping Service in Placement Rules.
Contributed by Wilfred Spiegelenburg.
|
2020-01-02 14:13:57 +05:30 |
|
Prabhu Joseph
|
21ada4d1b0
|
Revert "YARN-10053. Use Shared Group Mapping Service in Placement Rules."
This reverts commit 217b56ffdd.
|
2020-01-02 14:12:43 +05:30 |
|
Prabhu Joseph
|
217b56ffdd
|
YARN-10053. Use Shared Group Mapping Service in Placement Rules.
Contributed by Wilfred Spiegelenburg.
|
2020-01-02 14:07:49 +05:30 |
|
Eric Badger
|
412035b47a
|
YARN-10009. In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined. Contributed by Eric Payne.
|
2019-12-20 18:07:00 +00:00 |
|
Giovanni Matteo Fumarola
|
ef59ffd362
|
YARN-10038. [UI] Finish Time is not correctly parsed in the RM Apps page. Contributed by Inigo Goiri.
|
2019-12-19 11:37:17 -08:00 |
|
Jonathan Hung
|
7b93575b92
|
YARN-9894. CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues. Contributed by Eric Payne
|
2019-12-18 13:18:11 -08:00 |
|
Jonathan Hung
|
fddc3d55c3
|
YARN-10039. Allow disabling app submission from REST endpoints
|
2019-12-18 10:48:05 -08:00 |
|
Eric Badger
|
f47dcf2d4c
|
YARN-10033. TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources. Contributed by Eric Payne.
|
2019-12-17 17:11:23 +00:00 |
|
prabhujoseph
|
d4bde134e3
|
YARN-7721. Fix TestContinuousScheduling fails sporadically with NPE.
Contributed by Wilfred Spiegelenburg.
|
2019-12-10 15:00:23 +05:30 |
|
Jonathan Hung
|
6d970d8100
|
YARN-10012. Guaranteed and max capacity queue metrics for custom resources. Contributed by Manikandan R
|
2019-12-08 16:35:02 -08:00 |
|
Jonathan Hung
|
cd4779f317
|
Revert "YARN-10012. Guaranteed and max capacity queue metrics for custom resources"
This reverts commit 92bce918dc.
|
2019-12-08 16:34:46 -08:00 |
|
Jonathan Hung
|
92bce918dc
|
YARN-10012. Guaranteed and max capacity queue metrics for custom resources
|
2019-12-08 15:52:17 -08:00 |
|
prabhujoseph
|
e575df5ca6
|
YARN-10006. IOException used in place of YARNException in CapaitySheduler
Contributed by Adam Antal. Reviewed by Szilard Nemeth.
|
2019-12-06 12:51:28 +05:30 |
|