Weiwei Yang
|
251f528814
|
YARN-8222. Fix potential NPE when gets RMApp from RM context. Contributed by Tao Yang.
|
2018-05-02 17:54:46 +08:00 |
|
Weiwei Yang
|
2d319e3793
|
YARN-8212. Pending backlog for async allocation threads should be configurable. Contributed by Tao Yang.
|
2018-05-01 09:47:10 +08:00 |
|
Konstantinos Karanasos
|
9b09555451
|
YARN-8195. Fix constraint cardinality check in the presence of multiple target allocation tags. Contributed by Weiwei Yang.
|
2018-04-30 11:54:30 -07:00 |
|
Wangda Tan
|
92c5331423
|
YARN-8005. Add unit tests for queue priority with dominant resource calculator. (Zian Chen via wangda)
Change-Id: I17a645f20869a1e5d86fa7a325c93fec908b91dc
|
2018-04-27 13:08:43 -07:00 |
|
Rohith Sharma K S
|
ef3ecc308d
|
YARN-8221. RMWebServices also need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G.
|
2018-04-27 22:58:10 +05:30 |
|
Sunil G
|
71220d218d
|
YARN-8004. Add unit tests for inter queue preemption for dominant resource calculator. Contributed by Zian Chen.
|
2018-04-27 10:42:30 +05:30 |
|
Sunil G
|
1634de0fc1
|
YARN-8205. Application State is not updated to ATS if AM launching is delayed. Contributed by Rohith Sharma K S.
|
2018-04-27 10:26:57 +05:30 |
|
Wangda Tan
|
2a0fa50f9d
|
YARN-8193. YARN RM hangs abruptly (stops allocating resources) when running successive applications. (Zian Chen via wangda)
Change-Id: Ia83dd2499ee9000b9e09ae5a932f21a13c0ddee6
|
2018-04-26 13:54:40 -07:00 |
|
Sunil G
|
7ac0abdc13
|
YARN-8188. RM Nodes UI data table index for sorting column need to be corrected post Application tags display. Contributed by Weiwei Yang.
|
2018-04-26 13:54:40 -07:00 |
|
Wangda Tan
|
ebedd69e25
|
YARN-8183. Fix ConcurrentModificationException inside RMAppAttemptMetrics#convertAtomicLongMaptoLongMap. (Suma Shivaprasad via wangda)
Change-Id: I347871d672001653a3afe2e99adefd74e0d798cd
|
2018-04-26 13:54:40 -07:00 |
|
Owen O'Malley
|
2adda92de1
|
HDFS-7240 git commit fixup
Signed-off-by: Owen O'Malley <omalley@apache.org>
|
2018-04-26 13:52:17 -07:00 |
|
Anu Engineer
|
4e61bc431e
|
HDFS-13258. Ozone: restructure Hdsl/Ozone code to separated maven subprojects.
Contributed by Elek Marton, Mukul Kumar Singh, Xiaoyu Yao, Ajay Kumar, Anu Engineer, Lokesh Jain, Nanda Kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Robert Kanter
|
7ab08a9c37
|
HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter)
|
2018-04-23 15:44:15 -07:00 |
|
Konstantinos Karanasos
|
28e2244390
|
YARN-8111. Simplify PlacementConstraints API by removing allocationTagToIntraApp. Contributed by Weiwei Yang.
|
2018-04-20 12:24:48 -07:00 |
|
Jason Lowe
|
766544c0b0
|
YARN-7786. NullPointerException while launching ApplicationMaster. Contributed by lujie
|
2018-04-20 13:22:20 -05:00 |
|
Sunil G
|
7d06806dfd
|
YARN-6827. [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart. Contributed by Rohith Sharma K S.
|
2018-04-20 00:05:53 +05:30 |
|
Shashikant Banerjee
|
e4c39f3247
|
HADOOP-15396. Some java source files are executable
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-04-19 08:35:38 +09:00 |
|
Rohith Sharma K S
|
241d985467
|
YARN-8145. yarn rmadmin -getGroups doesn't return updated groups for user. Contributed by Sunil G.
|
2018-04-18 13:39:41 +05:30 |
|
Yufei
|
d426b980ac
|
YARN-7966. Remove method AllocationConfiguration#getQueueAcl and related unit tests. Contributed by Sen Zhao.
|
2018-04-17 22:53:32 -07:00 |
|
Haibo Chen
|
bb92bfb4ef
|
YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)
|
2018-04-17 11:15:20 -07:00 |
|
Haibo Chen
|
86dfb70875
|
Revert "YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)"
This reverts commit 0c14b6f0d8 .
|
2018-04-17 06:04:38 -07:00 |
|
Haibo Chen
|
0c14b6f0d8
|
YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)
|
2018-04-17 05:59:03 -07:00 |
|
Inigo Goiri
|
f1461b2487
|
YARN-8164. Fix a potential NPE in AbstractSchedulerPlanFollower. Contributed by lujie.
|
2018-04-16 17:32:19 -07:00 |
|
Inigo Goiri
|
dd5e18c4ae
|
YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan.
|
2018-04-16 16:52:17 -07:00 |
|
Wangda Tan
|
896b473f1b
|
YARN-8138. Add unit test to validate queue priority preemption works under node partition. (Zian Chen via wangda)
Change-Id: Ibebfab98a714c12c2dc643b6d7b9754a7f813632
(cherry picked from commit 6ee62e6b1c9b4bc3447ce870446068e626b1a492)
|
2018-04-14 11:08:36 -07:00 |
|
Eric E Payne
|
18844599ae
|
YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe
|
2018-04-12 17:53:57 +00:00 |
|
Eric E Payne
|
6bb128dfb8
|
YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe.
|
2018-04-12 16:04:23 +00:00 |
|
Weiwei Yang
|
7eb783e263
|
YARN-8127. Resource leak when async scheduling is enabled. Contributed by Tao Yang.
|
2018-04-11 17:15:25 +08:00 |
|
Sunil G
|
821b0de4c5
|
YARN-7574. Add support for Node Labels on Auto Created Leaf Queue Template. Contributed by Suma Shivaprasad.
|
2018-04-09 21:17:22 +05:30 |
|
Wangda Tan
|
d4e63ccca0
|
YARN-8048. Support auto-spawning of admin configured services during bootstrap of RM (Rohith Sharma K S via wangda)
Change-Id: I2d8d61ccad55e1118009294d7e17822df3cd0fd5
|
2018-04-06 21:24:58 -07:00 |
|
Vrushali C
|
345e7624d5
|
YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S
|
2018-04-04 15:08:03 -07:00 |
|
Konstantinos Karanasos
|
7853ec8d2f
|
YARN-8013. Support application tags when defining application namespaces for placement constraints. Contributed by Weiwei Yang.
|
2018-04-04 10:51:58 -07:00 |
|
Haibo Chen
|
93d47a0ed5
|
YARN-8051. TestRMEmbeddedElector#testCallbackSynchronization is flaky. (Robert Kanter via Haibo Chen)
|
2018-04-03 07:59:20 -07:00 |
|
Wangda Tan
|
c78cb18c61
|
YARN-8091. Revisit checkUserAccessToQueue RM REST API. (wangda)
Change-Id: I5fab3fe229c34e967487b7327c7b3c8ddf7cb795
|
2018-04-02 15:22:05 -07:00 |
|
Weiwei Yang
|
1606dad133
|
YARN-7497. Add file system based scheduler configuration store. Contributed by Jiandan Yang.
|
2018-03-30 21:41:33 +08:00 |
|
Eric Yang
|
8fb00c3fce
|
YARN-6257. Fix CapacityScheduler REST API JSON output.
Contributed By Tao Yang
|
2018-03-29 17:36:34 -04:00 |
|
Sunil G
|
7a59d60e0c
|
YARN-8085. ResourceProfilesManager should be set in RMActiveServiceContext. Contributed by Tao Yang.
|
2018-03-29 21:41:16 +05:30 |
|
Wangda Tan
|
47f711eebc
|
YARN-6629. NPE occurred when container allocation proposal is applied but its resource requests are removed before. (Tao Yang via wangda)
Change-Id: I805880f90b3f6798ec96ed8e8e75755f390a9ad5
|
2018-03-28 11:07:45 -07:00 |
|
Wangda Tan
|
24bc5e0e4d
|
YARN-8072. RM log is getting flooded with MemoryPlacementConstraintManager info logs. (Zian Chen via wangda)
Change-Id: I2567f4669ad868e13c4301fe44c4bde85bb92c37
|
2018-03-26 11:20:16 -07:00 |
|
Wangda Tan
|
9eef19b2ad
|
YARN-8068. Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+ (Sunil G via wangda)
Change-Id: I7910bd1064a1b4dbbe2084080c060822ea6f3b48
|
2018-03-26 11:19:15 -07:00 |
|
Wangda Tan
|
5d381570f8
|
YARN-8062. yarn rmadmin -getGroups returns group from which the user has been removed. (Sunil G via wangda)
Change-Id: I80ed63846502bf7751b890b6c6c6a7c0679e2b4a
|
2018-03-26 11:16:06 -07:00 |
|
Wangda Tan
|
a90471b3e6
|
YARN-8016. Refine PlacementRule interface and add a app-name queue mapping rule as an example. (Zian Chen via wangda)
Change-Id: I35caf1480e0f76f5f3a53528af09312e39414bbb
|
2018-03-23 16:43:40 -07:00 |
|
Wangda Tan
|
a08921ca6c
|
YARN-8002. Support NOT_SELF and ALL namespace types for allocation tag. (Weiwei Yang via wangda)
Change-Id: I63b4e4192a95bf7ded98c54e46a2871c72869700
|
2018-03-19 11:04:27 -07:00 |
|
Sunil G
|
6bd130ea45
|
YARN-8028. Support authorizeUserAccessToQueue in RMWebServices. Contributed by Wangda Tan.
|
2018-03-18 11:00:30 +05:30 |
|
Weiwei Yang
|
154cfb2b62
|
YARN-7636. Re-reservation count may overflow when cluster resource exhausted for a long time. contributed by Tao Yang.
|
2018-03-16 18:57:31 +08:00 |
|
Wangda Tan
|
4bf622043f
|
YARN-7952. RM should be able to recover log aggregation status after restart/fail-over. (Xuan Gong via wangda)
Change-Id: I725c9afe64831eda0aa6b0bebdbc79d2dd165707
|
2018-03-15 13:26:45 -07:00 |
|
Wangda Tan
|
b167d60763
|
YARN-7657. Queue Mapping could provide options to provide 'user' specific auto-created queues under a specified group parent queue. (Suma Shivaprasad via wangda)
Change-Id: I32d566e8727840e43c0d66e39a77edef017e3a83
|
2018-03-13 17:55:51 -07:00 |
|
Yufei Gu
|
ff31d8aefa
|
YARN-8024. LOG in class MaxRunningAppsEnforcer is initialized with a faulty class. Contributed by Sen Zhao.
|
2018-03-12 16:35:26 -07:00 |
|
Weiwei Yang
|
b451889e8e
|
YARN-8011. TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails intermittently. Contributed by Tao Yang.
|
2018-03-08 18:13:36 +08:00 |
|
Wangda Tan
|
e718ac597f
|
Revert "YARN-7891. LogAggregationIndexedFileController should support read from HAR file. (Xuan Gong via wangda)"
This reverts commit 4d53ef7eef .
|
2018-03-07 15:46:47 -08:00 |
|
Wangda Tan
|
4d53ef7eef
|
YARN-7891. LogAggregationIndexedFileController should support read from HAR file. (Xuan Gong via wangda)
Change-Id: Ie16e34039d57df50128c73b37516ad0bc7c9590e
|
2018-03-07 11:30:06 -08:00 |
|
Arun Suresh
|
1054b48c27
|
YARN-7972. Support inter-app placement constraints for allocation tags by application ID. (Weiwei Yang via asuresh)
|
2018-03-05 11:24:17 -08:00 |
|
Yufei Gu
|
6ca4e3017b
|
YARN-5028. RMStateStore should trim down app state for completed applications(addendum). Contributed by Rohith Sharma K S.
|
2018-03-01 08:38:53 -08:00 |
|
Arpit Agarwal
|
2fa7963c3d
|
HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi.
|
2018-02-24 14:41:55 -08:00 |
|
Carlo Curino
|
514794e1a5
|
YARN-7934. [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos. (Contributed by curino)
|
2018-02-22 18:12:12 -08:00 |
|
Yufei Gu
|
92cbbfe79e
|
YARN-5028. RMStateStore should trim down app state for completed applications. Contributed by Gergo Repas.
|
2018-02-21 11:42:51 -08:00 |
|
Sunil G
|
bdd2a184d7
|
YARN-7947. Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps. Contributed by Eric Payne.
|
2018-02-21 14:35:57 +05:30 |
|
Jason Lowe
|
9497215084
|
YARN-7813. Capacity Scheduler Intra-queue Preemption should be configurable for each queue. Contributed by Eric Payne
|
2018-02-19 14:06:28 -06:00 |
|
fang zhenyi
|
4d4dde5112
|
HADOOP-15223. Replace Collections.EMPTY* with empty* when available
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-02-18 22:19:39 +09:00 |
|
Arun Suresh
|
a1e56a6286
|
YARN-7918. Fix TestAMRMClientPlacementConstraints. (Gergely Novák via asuresh)
|
2018-02-17 03:24:55 -08:00 |
|
Sunil G
|
aae629913c
|
YARN-7292. Retrospect Resource Profile Behavior for overriding capability. Contributed by Wangda Tan.
|
2018-02-16 12:37:40 +05:30 |
|
Konstantinos Karanasos
|
0b489e564c
|
YARN-7920. Simplify configuration for PlacementConstraints. Contributed by Wangda Tan.
|
2018-02-15 14:23:38 -08:00 |
|
Eric Payne
|
bddfe42e2c
|
Revert "YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue"
This reverts commit c5e6e3de1c .
|
2018-02-14 14:29:20 -06:00 |
|
Wangda Tan
|
042ef2fa7b
|
YARN-7789. Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator. (Zian Chen via wangda)
Change-Id: I1f6a451fe16758def6f47c046a9b8a67ad7255af
|
2018-02-14 23:11:10 +08:00 |
|
Eric Payne
|
c5e6e3de1c
|
YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue
|
2018-02-13 10:11:02 -06:00 |
|
Wangda Tan
|
d02e42cee4
|
YARN-7739. DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation. (wangda)
Change-Id: I10cc9341237d9a2fc0f8c855efb98a36b91389e2
|
2018-02-12 10:29:37 +08:00 |
|
Wangda Tan
|
60f9e60b3b
|
Preparing for 3.2.0 development
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
|
2018-02-11 11:17:38 +08:00 |
|
Yufei Gu
|
1bc03ddf97
|
YARN-7655. Avoid AM preemption caused by RRs for specific nodes or racks. Contributed by Steven Rand.
|
2018-02-08 12:32:43 -08:00 |
|
Robert Kanter
|
814d701d46
|
YARN-7841. Cleanup AllocationFileLoaderService's reloadAllocations method (snemeth via rkanter)
|
2018-02-06 14:36:49 -08:00 |
|
Weiwei Yang
|
bff858e910
|
YARN-7860. Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning. Contributed by Sunil G.
|
2018-02-06 19:33:04 +08:00 |
|
Konstantinos Karanasos
|
50723889cc
|
YARN-7778. Merging of placement constraints defined at different levels. Contributed by Weiwei Yang.
|
2018-02-02 14:46:20 -08:00 |
|
Arun Suresh
|
6e5ba9366f
|
YARN-7839. Modify PlacementAlgorithm to Check node capacity before placing request on node. (Panagiotis Garefalakis via asuresh)
|
2018-02-02 10:28:22 -08:00 |
|
Arun Suresh
|
d481344783
|
YARN-7822. Constraint satisfaction checker support for composite OR and AND constraints. (Weiwei Yang via asuresh)
|
2018-01-31 01:51:08 -08:00 |
|
Arun Suresh
|
add993e26a
|
YARN-6597. Add RMContainer recovery test to verify tag population in the AllocationTagsManager. (Panagiotis Garefalakis via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
f8c5f5b237
|
YARN-7784. Fix Cluster metrics when placement processor is enabled. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
c23980c4f2
|
YARN-7795. Fix jenkins issues of YARN-6592 branch. (Sunil G via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
644afe5fd8
|
YARN-7807. Assume intra-app anti-affinity as default for scheduling request inside AppPlacementAllocator. (Wangda Tan via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
a4c539fcdb
|
YARN-7783. Add validation step to ensure constraints are not violated due to order in which a request is processed. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Sunil G
|
9b81cb0537
|
YARN-7779. Display allocation tags in RM web UI and expose same through REST API. Contributed by Weiwei Yang.
|
2018-01-31 01:30:17 -08:00 |
|
Konstantinos Karanasos
|
adbe87abf8
|
YARN-7788. Factor out management of temp tags from AllocationTagsManager. (Arun Suresh via kkaranasos)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
8bf7c44436
|
YARN-7763. Allow Constraints specified in the SchedulingRequest to override application level constraints. (Weiwei Yang via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
28fe7f3318
|
YARN-7774. Miscellaneous fixes to the PlacementProcessor. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
38af237969
|
YARN-6599. Support anti-affinity constraint via AppPlacementAllocator. (Wangda Tan via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
8779a35742
|
YARN-7709. Remove SELF from TargetExpression type. (Konstantinos Karanasos via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Wangda Tan
|
29d9e4d581
|
YARN-6619. AMRMClient Changes to use the PlacementConstraint and SchcedulingRequest objects. (Arun Suresh via wangda)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
a5c1fc881e
|
YARN-7696. Add container tags to ContainerTokenIdentifier, api.Container and NMContainerStatus to handle all recovery cases. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
4eda58c136
|
YARN-7681. Double-check placement constraints in scheduling phase before actual allocation is made. (Weiwei Yang via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
bdba01f73b
|
YARN-7682. Expose canSatisfyConstraints utility function to validate a placement against a constraint. (Panagiotis Garefalakis via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
a52d11fb8c
|
YARN-7613. Implement Basic algorithm for constraint based placement. (Panagiotis Garefalakis via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
f9af15d659
|
YARN-7612. Add Processor Framework for Rich Placement Constraints. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
1efb2b6f25
|
YARN-6596. Introduce Placement Constraint Manager module. (Konstantinos Karanasos via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
37f1a7b64f
|
YARN-7653. Node group support for AllocationTagsManager. (Panagiotis Garefalakis via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
06eb63e64b
|
YARN-7669. API and interface modifications for placement constraint processor. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
88d8d3f40b
|
YARN-7670. Modifications to the ResourceScheduler API to support SchedulingRequests. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
801c0988b5
|
YARN-7522. Introduce AllocationTagsManager to associate allocation tags to nodes. (Wangda Tan via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Sunil G
|
e9c72d04be
|
YARN-7790. Improve Capacity Scheduler Async Scheduling to better handle node failures. Contributed by Wangda Tan.
|
2018-01-29 20:44:38 +05:30 |
|
Jinjiang Ling
|
3400d0c535
|
YARN-7698. A misleading variable's name in ApplicationAttemptEventDispatcher
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-01-30 00:00:57 +09:00 |
|
Wangda Tan
|
75618c0dec
|
YARN-7760. [UI2] Clicking 'Master Node' or link next to 'AM Node Web UI' under application's appAttempt page goes to OLD RM UI. (Vasudevan Skm / Sunil G via wangda)
Change-Id: Ia7e2b955d3551ca43c6852fe253fd01983b56565
|
2018-01-26 15:44:55 +08:00 |
|
Wangda Tan
|
e0cfb0a31a
|
YARN-7817. Add Resource reference to RM's NodeInfo object so REST API can get non memory/vcore resource usages. (Sunil G via wangda)
Change-Id: Ia7ceeabd82046645ddeaf487c763288f36cfbdee
|
2018-01-26 15:43:27 +08:00 |
|
Jason Lowe
|
ff8378eb1b
|
YARN-7102. NM heartbeat stuck when responseId overflows MAX_INT. Contributed by Botong Huang
|
2018-01-25 17:47:19 -06:00 |
|