Sunil G
|
89b3ebd11e
|
YARN-8092. Expose Node Attributes info via RM nodes REST API. Contributed by Weiwei Yang.
|
2018-09-12 16:01:00 +05:30 |
|
Sunil G
|
6f4bc49c6d
|
YARN-7988. Refactor FSNodeLabelStore code for Node Attributes store support. Contributed by Bibin A Chundatt.
|
2018-09-12 16:01:00 +05:30 |
|
Naganarasimha
|
3b3b6efe21
|
YARN-7871. Node attributes reporting from NM to RM. Contributed by Weiwei Yang.
|
2018-09-12 16:01:00 +05:30 |
|
Naganarasimha
|
86d024ef2a
|
YARN-7965. NodeAttributeManager add/get API is not working properly. Contributed by Weiwei Yang.
|
2018-09-12 16:01:00 +05:30 |
|
Sunil G
|
2f7712be09
|
YARN-6858. Attribute Manager to store and provide node attributes in RM. Contributed by Naganarasimha G R.
|
2018-09-12 16:01:00 +05:30 |
|
Naganarasimha
|
1f42ce907a
|
YARN-6855. [YARN-3409] CLI Proto Modifications to support Node Attributes. Contributed by Naganarasimha G R.
|
2018-09-12 16:00:59 +05:30 |
|
Eric E Payne
|
987d8191ad
|
YARN-8709: CS preemption monitor always fails since one under-served queue was deleted. Contributed by Tao Yang.
|
2018-09-10 19:55:20 +00:00 |
|
Giovanni Matteo Fumarola
|
9af96d4ed4
|
HADOOP-15707. Add IsActiveServlet to be used for Load Balancers. Contributed by Lukas Majercak.
|
2018-09-05 10:50:25 -07:00 |
|
Weiwei Yang
|
3fa4639421
|
YARN-8723. Fix a typo in CS init error message when resource calculator is not correctly set. Contributed by Abhishek Modi.
|
2018-08-29 11:13:44 +08:00 |
|
Sunil G
|
1ac01444a2
|
YARN-8015. Support all types of placement constraint support for Capacity Scheduler. Contributed by Weiwei Yang.
|
2018-08-23 10:05:43 +05:30 |
|
Weiwei Yang
|
9c3fc3ef28
|
YARN-7494. Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision. Contributed by Sunil Govindan.
|
2018-08-21 22:42:28 +08:00 |
|
Weiwei Yang
|
54d0bf8935
|
YARN-8683. Support to display pending scheduling requests in RM app attempt page. Contributed by Tao Yang.
|
2018-08-21 19:00:31 +08:00 |
|
Giovanni Matteo Fumarola
|
8736fc39ac
|
YARN-8673. [AMRMProxy] More robust responseId resync after an YarnRM master slave switch. Contributed by Botong Huang.
|
2018-08-20 12:22:36 -07:00 |
|
Rohith Sharma K S
|
4aacbfff60
|
YARN-8679. [ATSv2] If HBase cluster is down for long time, high chances that NM ContainerManager dispatcher get blocked. Contributed by Wangda Tan.
|
2018-08-18 10:26:55 +05:30 |
|
Wei-Chiu Chuang
|
bdd0e01ed9
|
HADOOP-14212. Addendum patch: Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal.
|
2018-08-14 18:25:38 -07:00 |
|
Wei-Chiu Chuang
|
363bd16e31
|
HADOOP-14212. Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal.
|
2018-08-14 17:19:00 -07:00 |
|
Weiwei Yang
|
0a71bf1452
|
YARN-8575. Avoid committing allocation proposal to unavailable nodes in async scheduling. Contributed by Tao Yang.
|
2018-08-10 14:37:45 +08:00 |
|
Weiwei Yang
|
08d5060605
|
YARN-8521. NPE in AllocationTagsManager when a container is removed more than once. Contributed by Weiwei Yang.
|
2018-08-10 08:32:02 +08:00 |
|
Robert Kanter
|
b2517dd66b
|
YARN-4946. RM should not consider an application as COMPLETED when log aggregation is not in a terminal state (snemeth via rkanter)
|
2018-08-09 14:58:04 -07:00 |
|
Wangda Tan
|
344c335a92
|
YARN-8588. Logging improvements for better debuggability. (Suma Shivaprasad via wangda)
Change-Id: I66aa4b0ec031ae5ce0fae558e2f8cbcbbfebc442
|
2018-08-09 11:04:02 -07:00 |
|
Weiwei Yang
|
d352f167eb
|
YARN-8559. Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint. Contributed by Weiwei Yang.
|
2018-08-09 23:46:53 +08:00 |
|
Haibo Chen
|
889df6f194
|
YARN-7948. Enable fair scheduler to refresh maximum allocation for multiple resource types. (Szilard Nemeth via Haibo Chen)
|
2018-08-02 10:10:12 -07:00 |
|
Sunil G
|
12a095a496
|
YARN-7159. Normalize unit of resource objects in RM to avoid unit conversion in critical path. Contributed by Manikandan R.
|
2018-08-02 22:29:21 +05:30 |
|
Sunil G
|
735b492556
|
YARN-8593. Add RM web service endpoint to get user information. Contributed by Akhil PB.
|
2018-08-02 08:34:09 +05:30 |
|
Sunil G
|
a48a0cc7fd
|
YARN-8606. Opportunistic scheduling does not work post RM failover. Contributed by Bibin A Chundatt.
|
2018-08-01 12:17:18 +05:30 |
|
Sunil G
|
6310c0d17d
|
YARN-8397. Potential thread leak in ActivitiesManager. Contributed by Rohith Sharma K S.
|
2018-08-01 08:33:30 +05:30 |
|
Eric Yang
|
c7ebcd76bf
|
YARN-8579. Recover NMToken of previous attempted component data.
Contributed by Gour Saha
|
2018-07-31 18:01:02 -04:00 |
|
Haibo Chen
|
8aa93a575e
|
YARN-8605. TestDominantResourceFairnessPolicy.testModWhileSorting is flaky. (Wilfred Spiegelenburg via Haibo Chen)
|
2018-07-31 11:32:40 -07:00 |
|
Jonathan Hung
|
3e06a5dcea
|
YARN-7974. Allow updating application tracking url after registration. Contributed by Jonathan Hung
|
2018-07-30 17:44:18 -07:00 |
|
Robert Kanter
|
2cccf4061c
|
YARN-8517. getContainer and getContainers ResourceManager REST API methods are not documented (snemeth via rkanter)
|
2018-07-27 14:35:03 -07:00 |
|
Eric Yang
|
f93ecf5c1e
|
YARN-8330. Improved publishing ALLOCATED events to ATS.
Contributed by Suma Shivaprasad
|
2018-07-25 18:49:30 -04:00 |
|
Eric E Payne
|
9485c9aee6
|
YARN-4606. CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps. Contributed by Manikandan R
|
2018-07-25 16:22:04 +00:00 |
|
Weiwei Yang
|
5be9f4a5d0
|
YARN-8546. Resource leak caused by a reserved container being released more than once under async scheduling. Contributed by Tao Yang.
|
2018-07-25 17:35:27 +08:00 |
|
Haibo Chen
|
ea2c6c8c9a
|
YARN-7133. Clean up lock-try order in fair scheduler. (Szilard Nemeth via Haibo Chen)
|
2018-07-24 12:46:59 -07:00 |
|
bibinchundatt
|
e673dd1d4d
|
YARN-8541. RM startup failure on recovery after user deletion. Contributed by Bibin A Chundatt.
|
2018-07-24 23:26:59 +05:30 |
|
Sunil G
|
35ce6eb1f5
|
YARN-7748. TestContainerResizing.testIncreaseContainerUnreservedWhenApplicationCompleted fails due to multiple container fail events. Contributed by Weiwei Yang.
|
2018-07-24 22:20:17 +05:30 |
|
bibinchundatt
|
ff7c2eda34
|
YARN-8548. AllocationRespose proto setNMToken initBuilder not done. Contributed by Bilwa S T.
|
2018-07-24 16:17:20 +05:30 |
|
bibinchundatt
|
8461278833
|
YARN-8544. [DS] AM registration fails when hadoop authorization is enabled. Contributed by Bibin A Chundatt.
|
2018-07-24 13:09:17 +05:30 |
|
Haibo Chen
|
8a6bb8409c
|
YARN-6964. Fair scheduler misuses Resources operations. (Daniel Templeton and Szilard Nemeth via Haibo Chen)
|
2018-07-20 10:46:28 -07:00 |
|
Weiwei Yang
|
cbf2026483
|
YARN-8528. Final states in ContainerAllocation might be modified externally causing unexpected allocation results. Contributed by Xintong Song.
|
2018-07-20 22:34:06 +08:00 |
|
Haibo Chen
|
2564884757
|
YARN-8436. FSParentQueue: Comparison method violates its general contract. (Wilfred Spiegelenburg via Haibo Chen)
|
2018-07-19 13:22:31 -07:00 |
|
Eric Yang
|
5836e0a46b
|
YARN-8501. Reduce complexity of RMWebServices getApps method.
Contributed by Szilard Nemeth
|
2018-07-19 12:30:38 -04:00 |
|
Wangda Tan
|
238ffff999
|
YARN-8524. Single parameter Resource / LightWeightResource constructor looks confusing. (Szilard Nemeth via wangda)
Change-Id: I4ae97548b5b8d76a6bcebb2d3d70bf8e0be3c125
|
2018-07-16 10:58:00 -07:00 |
|
Wangda Tan
|
a2e49f41a8
|
YARN-8361. Change App Name Placement Rule to use App Name instead of App Id for configuration. (Zian Chen via wangda)
Change-Id: I17e5021f8f611a9c5e3bd4b38f25e08585afc6b1
|
2018-07-16 10:57:37 -07:00 |
|
Wangda Tan
|
752dcce5f4
|
YARN-8511. When AM releases a container, RM removes allocation tags before it is released by NM. (Weiwei Yang via wangda)
Change-Id: I6f9f409f2ef685b405cbff547dea9623bf3322d9
|
2018-07-16 10:54:41 -07:00 |
|
Eric E Payne
|
937ef39b3f
|
YARN-8421: when moving app, activeUsers is increased, even though app does not have outstanding request. Contributed by Kyungwan Nam
|
2018-07-16 16:24:21 +00:00 |
|
Akira Ajisaka
|
88625f5cd9
|
HADOOP-15531. Use commons-text instead of commons-lang in some classes to fix deprecation warnings. Contributed by Takanobu Asanuma.
|
2018-07-13 11:42:12 -04:00 |
|
Giovanni Matteo Fumarola
|
82ac3aa6d0
|
YARN-8502. Use path strings consistently for webservice endpoints in RMWebServices. Contributed by Szilard Nemeth.
|
2018-07-10 10:36:17 -07:00 |
|
Robert Kanter
|
a129e3e74e
|
YARN-7451. Add missing tests to verify the presence of custom resources of RM apps and scheduler webservice endpoints (snemeth via rkanter)
|
2018-07-06 11:04:00 -07:00 |
|
Haibo Chen
|
9edc74f64a
|
YARN-7556. Fair scheduler configuration should allow resource types in the minResources and maxResources properties. (Daniel Templeton and Szilard Nemeth via Haibo Chen)
|
2018-07-06 11:03:48 -07:00 |
|
Anu Engineer
|
39ad98903a
|
Revert "Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into trunk"
This reverts commit c163d1797a , reversing
changes made to 0d9804dcef .
|
2018-07-05 12:22:18 -07:00 |
|
Robert Kanter
|
99febe7fd5
|
YARN-7451. Add missing tests to verify the presence of custom resources of RM apps and scheduler webservice endpoints (snemeth via rkanter)
|
2018-07-05 10:54:19 -07:00 |
|
Haibo Chen
|
1726247024
|
YARN-7556. Fair scheduler configuration should allow resource types in the minResources and maxResources properties. (Daniel Templeton and Szilard Nemeth via Haibo Chen)
|
2018-07-05 10:42:39 -07:00 |
|
Sunil G
|
51654a3962
|
YARN-8459. Improve Capacity Scheduler logs to debug invalid states. Contributed by Wangda Tan.
|
2018-07-03 09:59:20 -07:00 |
|
Junping Du
|
d9ba6f3656
|
yarn.resourcemanager.fail-fast is used inconsistently. Contributed by Yuanbo Liu.
|
2018-07-03 14:46:44 +08:00 |
|
Sunil G
|
291194302c
|
YARN-8379. Improve balancing resources in already satisfied queues by using Capacity Scheduler preemption. Contributed by Zian Chen.
|
2018-06-28 10:23:31 -07:00 |
|
Eric Yang
|
384764cdea
|
YARN-8409. Fixed NPE in ActiveStandbyElectorBasedElectorService.
Contributed by Chandni Singh
|
2018-06-28 12:39:49 -04:00 |
|
Wangda Tan
|
bedc4fe079
|
YARN-8464. Async scheduling thread could be interrupted when there are no NodeManagers in cluster. (Sunil G via wangda)
Change-Id: I4f5f856373378685713e77752ba6cf0988a66065
|
2018-06-26 19:27:17 -07:00 |
|
Eric Yang
|
b69ba0f330
|
YARN-8108. Added option to disable loading existing filters to prevent
security filter from initialize twice.
Contributed by Sunil Govindan
|
2018-06-26 17:34:57 -04:00 |
|
Weiwei Yang
|
440140cea6
|
YARN-8443. Total #VCores in cluster metrics is wrong when CapacityScheduler reserved some containers. Contributed by Tao Yang.
|
2018-06-25 09:15:31 +08:00 |
|
Inigo Goiri
|
99948565cb
|
YARN-8412. Move ResourceRequest.clone logic everywhere into a proper API. Contributed by Botong Huang.
|
2018-06-21 18:24:10 -07:00 |
|
Miklos Szegedi
|
46f9058164
|
YARN-8441. Typo in CSQueueUtils local variable names: queueGuranteedResource. Contributed by Szilard Nemeth.
|
2018-06-20 11:58:18 -07:00 |
|
Miklos Szegedi
|
9a9e969570
|
YARN-8391. Investigate AllocationFileLoaderService.reloadListener locking issue. Contributed by Szilard Nemeth.
|
2018-06-20 10:59:33 -07:00 |
|
Rohith Sharma K S
|
9119b3cf8f
|
YARN-8155. Improve ATSv2 client logging in RM and NM publisher. Contributed by Abhishek Modi.
|
2018-06-14 12:38:10 +05:30 |
|
Sunil G
|
6307962b93
|
YARN-8404. Timeline event publish need to be async to avoid Dispatcher thread leak in case ATS is down. Contributed by Rohith Sharma K S
|
2018-06-13 16:09:16 +05:30 |
|
Weiwei Yang
|
29024a6203
|
YARN-8394. Improve data locality documentation for Capacity Scheduler. Contributed by Weiwei Yang.
|
2018-06-13 09:28:05 +08:00 |
|
Haibo Chen
|
10d0e4be6e
|
YARN-8325. Miscellaneous QueueManager code clean up. (Szilard Nemeth via Haibo Chen)
|
2018-06-12 10:11:30 -07:00 |
|
Akira Ajisaka
|
652bcbb3e4
|
YARN-8363. Upgrade commons-lang version to 3.7 in hadoop-yarn-project. Contributed by Takanobu Asanuma.
|
2018-06-13 00:35:37 +09:00 |
|
Rohith Sharma K S
|
2df73dace0
|
YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri.
|
2018-06-12 17:13:09 +05:30 |
|
Haibo Chen
|
180b3c960b
|
YARN-8321. AllocationFileLoaderService.getAllocationFile() should be declared as VisibleForTest. (Szilard Nemeth via Haibo Chen)
|
2018-06-11 11:19:33 -07:00 |
|
Haibo Chen
|
676dcffff5
|
YARN-8322. Change log level when there is an IOException when the allocation file is loaded. (Szilard Nemeth via Haibo Chen)
|
2018-06-11 11:16:21 -07:00 |
|
Haibo Chen
|
c190ac2be8
|
YARN-8323. FairScheduler.allocConf should be declared as volatile. (Szilard Nemeth via Haibo Chen)
|
2018-06-11 11:12:44 -07:00 |
|
Robert Kanter
|
0cd145a443
|
YARN-4677. RMNodeResourceUpdateEvent update from scheduler can lead to race condition (wilfreds and gphillips via rkanter)
|
2018-06-04 15:32:03 -07:00 |
|
Haibo Chen
|
ba12f87dcb
|
YARN-8390. Fix API incompatible changes in FairScheduler's AllocationFileLoaderService. (Gergo Repas via Haibo Chen)
|
2018-06-04 09:15:23 -07:00 |
|
Wangda Tan
|
ff583d3fa3
|
YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda)
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
|
2018-06-01 14:49:18 -07:00 |
|
Wangda Tan
|
931f78718f
|
YARN-7962. Race Condition When Stopping DelegationTokenRenewer causes RM crash during failover. (BELUGA BEHR via wangda)
Change-Id: I617e2645f60a57080058ad5f06af860fb3f682c8
|
2018-06-01 14:49:18 -07:00 |
|
Yufei Gu
|
6b21a599fb
|
YARN-7340. Fix the missing time stamp in exception message in Class
NoOverCommitPolicy. Contributed by Dinesh Chitlangia.
|
2018-05-31 22:30:12 -07:00 |
|
Weiwei Yang
|
6468071f13
|
YARN-8367. Fix NPE in SingleConstraintAppPlacementAllocator when placement constraint in SchedulingRequest is null. Contributed by Weiwei Yang.
|
2018-05-31 20:46:39 +08:00 |
|
Wangda Tan
|
17aa40f669
|
YARN-8369. Javadoc build failed due to 'bad use of >'. (Takanobu Asanuma via wangda)
Change-Id: I79a42154e8f86ab1c3cc939b3745024b8eebe5f4
|
2018-05-29 09:27:36 -07:00 |
|
Sunil G
|
7c343669ba
|
YARN-4781. Support intra-queue preemption for fairness ordering policy. Contributed by Eric Payne.
|
2018-05-28 16:32:53 +05:30 |
|
Wangda Tan
|
f24c842d52
|
YARN-8213. Add Capacity Scheduler performance metrics. (Weiwei Yang via wangda)
Change-Id: Ieea6f3eeb83c90cd74233fea896f0fcd0f325d5f
|
2018-05-25 21:53:20 -07:00 |
|
Eric E Payne
|
8d5509c681
|
YARN-8292: Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative. Contributed by Wangda Tan.
|
2018-05-25 16:06:09 +00:00 |
|
Haibo Chen
|
86bc6425d4
|
YARN-8191. Fair scheduler: queue deletion without RM restart. (Gergo Repas via Haibo Chen)
|
2018-05-24 17:12:34 -07:00 |
|
Rohith Sharma K S
|
c05b5d424b
|
YARN-8319. More YARN pages need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G.
|
2018-05-24 14:19:46 +05:30 |
|
Wangda Tan
|
bd15d2396e
|
YARN-8290. SystemMetricsPublisher.appACLsUpdated should be invoked after application information is published to ATS to avoid "User is not set in the application report" Exception. (Eric Yang via wangda)
Change-Id: I0ac6ddd19740d1aa7dd07111cd11af71ddc2fcaf
|
2018-05-22 13:33:33 -07:00 |
|
Eric E Payne
|
0b4c44bdee
|
YARN-8179: Preemption does not happen due to natural_termination_factor when DRF is used. Contributed by Kyungwan Nam.
|
2018-05-21 20:14:58 +00:00 |
|
Haibo Chen
|
f48fec83d0
|
YARN-8248. Job hangs when a job requests a resource that its queue does not have. (Szilard Nemeth via Haibo Chen)
|
2018-05-21 08:10:41 -07:00 |
|
Arun Suresh
|
3159bffce2
|
YARN-7900. [AMRMProxy] AMRMClientRelayer for stateful FederationInterceptor. (Botong Huang via asuresh)
|
2018-05-17 20:00:52 -07:00 |
|
Haibo Chen
|
1f10a36021
|
YARN-8268. Fair scheduler: reservable queue is configured both as parent and leaf queue. (Gergo Repas via Haibo Chen)
|
2018-05-11 11:34:00 -07:00 |
|
Weiwei Yang
|
9db9cd95bd
|
YARN-7003. DRAINING state of queues is not recovered after RM restart. Contributed by Tao Yang.
|
2018-05-11 10:47:04 +08:00 |
|
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
d76fbbc9b8
|
YARN-8249. Fixed few REST APIs in RMWebServices to have static-user check. Contributed by Sunil Govindan.
|
2018-05-10 19:05:35 -07:00 |
|
Robert Kanter
|
c8b53c4364
|
YARN-8202. DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation (snemeth via rkanter)
|
2018-05-10 09:31:59 -07:00 |
|
bibinchundatt
|
cc0310a526
|
YARN-8201. Skip stacktrace of few exception from ClientRMService. Contributed by Bilwa S T.
|
2018-05-10 09:15:46 +05:30 |
|
Rohith Sharma K S
|
eb7b256cc2
|
YARN-8239. [UI2] Clicking on Node Manager UI under AM container info / App Attempt page goes to old RM UI. Contributed by Sunil G.
|
2018-05-09 12:00:43 +05:30 |
|
Wangda Tan
|
6b96a73bb0
|
YARN-8232. RMContainer lost queue name when RM HA happens. (Hu Ziqian via wangda)
Change-Id: Ia21e1da6871570c993bbedde76ce32929e95970f
|
2018-05-08 11:34:45 -07:00 |
|
Weiwei Yang
|
67f239c42f
|
YARN-8025. UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty. Contributed by Tao Yang.
|
2018-05-07 11:33:14 +08:00 |
|
Inigo Goiri
|
6a69239d86
|
YARN-8163. Add support for Node Labels in opportunistic scheduling. Contributed by Abhishek Modi.
|
2018-05-04 14:59:59 -07:00 |
|
Rohith Sharma K S
|
ee2ce923a9
|
YARN-8217. RmAuthenticationFilterInitializer and TimelineAuthenticationFilterInitializer should use Configuration.getPropsWithPrefix instead of iterator. Contributed by Suma Shivaprasad.
|
2018-05-03 14:43:40 +05:30 |
|
Inigo Goiri
|
e6a80e476d
|
YARN-8151. Yarn RM Epoch should wrap around. Contributed by Young Chen.
|
2018-05-02 17:23:17 -07:00 |
|
Weiwei Yang
|
251f528814
|
YARN-8222. Fix potential NPE when gets RMApp from RM context. Contributed by Tao Yang.
|
2018-05-02 17:54:46 +08:00 |
|