Robert Kanter
|
7a55044803
|
YARN-7622. Allow fair-scheduler configuration on HDFS (gphillips via rkanter)
|
2018-01-03 15:31:50 -08:00 |
|
Arpit Agarwal
|
4379113bda
|
HADOOP-15093. Deprecation of yarn.resourcemanager.zk-address is undocumented. Contributed by Ajay Kumar.
|
2018-01-03 14:32:47 -08:00 |
|
Haibo Chen
|
2f6c038be6
|
YARN-7602. NM should reference the singleton JvmMetrics instance.
|
2018-01-03 09:41:26 -08:00 |
|
Rohith Sharma K S
|
c9bf813c9a
|
YARN-7692. Skip validating priority acls while recovering applications. Contributed by Sunil G.
|
2018-01-03 18:20:04 +05:30 |
|
Arun Suresh
|
c0c7cce81d
|
YARN-7691. Add Unit Tests for ContainersLauncher. (Sampada Dehankar via asuresh)
|
2018-01-02 22:03:00 -08:00 |
|
Miklos Szegedi
|
7f515f57ed
|
YARN-7585. NodeManager should go unhealthy when state store throws DBException. Contributed by Wilfred Spiegelenburg.
|
2018-01-02 18:03:04 -08:00 |
|
Miklos Szegedi
|
80440231d4
|
YARN-6894. RM Apps API returns only active apps when query parameter queue used. Contributed by Gergely Novák.
|
2018-01-02 17:59:10 -08:00 |
|
Miklos Szegedi
|
626b5103d4
|
YARN-7688. Miscellaneous Improvements To ProcfsBasedProcessTree. Contributed by BELUGA BEHR.
|
2018-01-02 17:39:50 -08:00 |
|
Miklos Szegedi
|
33ae2a4ae1
|
YARN-7687. ContainerLogAppender Improvements. Contributed by BELUGA BEHR.
|
2018-01-02 16:36:51 -08:00 |
|
Wangda Tan
|
7467e8fe5a
|
YARN-7555. Support multiple resource types in YARN native services. (wangda)
Change-Id: I330e6ee17a73962dcaadd766a3e72d2888681731
|
2017-12-29 15:34:08 -08:00 |
|
Miklos Szegedi
|
b82049b4f0
|
YARN-7580. ContainersMonitorImpl logged message lacks detail when exceeding memory limits. Contributed by Wilfred Spiegelenburg.
|
2017-12-29 12:49:37 -08:00 |
|
Arun Suresh
|
a55884c68e
|
YARN-7542. Fix issue that causes some Running Opportunistic Containers to be recovered as PAUSED. (Sampada Dehankar via asuresh)
|
2017-12-28 22:20:42 -08:00 |
|
Robert Kanter
|
382215c72b
|
YARN-7577. Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart (miklos.szegedi@cloudera.com via rkanter)
|
2017-12-20 13:39:00 -08:00 |
|
Rohith Sharma K S
|
13ad7479b0
|
YARN-7674. Update Timeline Reader web app address in UI2. Contributed by Sunil G.
|
2017-12-20 22:28:28 +05:30 |
|
Sunil G
|
d62932c3b2
|
YARN-7032. [ATSv2] NPE while starting hbase co-processor when HBase authorization is enabled. Contributed by Rohith Sharma K S.
|
2017-12-20 11:31:15 +05:30 |
|
Eric Yang
|
41b581012a
|
YARN-7616. Map YARN application status to Service Status more accurately. (Contributed by Gour Saha)
|
2017-12-19 19:14:45 -05:00 |
|
Eric Yang
|
94a2ac6b71
|
YARN-7466. addendum patch for failing unit test. (Contributed by Chandni Singh)
|
2017-12-19 18:42:27 -05:00 |
|
Eric Yang
|
989c75109a
|
YARN-7543. Add check for max cpu limit and missing file for YARN service.
(Contributed by Jian He)
|
2017-12-19 16:45:04 -05:00 |
|
Varun Saxena
|
c0aeb666a4
|
YARN-7662. [ATSv2] Define new set of configurations for reader and collectors to bind (Rohith Sharma K S via Varun Saxena)
|
2017-12-19 22:29:24 +05:30 |
|
Sunil G
|
fe5b057c81
|
YARN-7620. Allow node partition filters on Queues page of new YARN UI. Contributed by Vasudevan Skm.
|
2017-12-19 20:27:25 +05:30 |
|
Junping Du
|
a7f8caf58e
|
Add 2.8.3 release jdiff files.
(cherry picked from commit c89f99aade575ab1f6a9836df719cda272293d90)
|
2017-12-18 22:39:01 -08:00 |
|
Jason Lowe
|
811fabdebe
|
YARN-7661. NodeManager metrics return wrong value after update node resource. Contributed by Yang Wang
|
2017-12-18 15:20:06 -06:00 |
|
Akira Ajisaka
|
001008958d
|
YARN-7664. Several javadoc errors. Contributed by Sean Mackrory.
|
2017-12-18 22:24:51 +09:00 |
|
Weiwei Yang
|
9289641020
|
YARN-7617. Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started. Contributed by Weiwei Yang.
|
2017-12-18 10:07:16 +08:00 |
|
Wangda Tan
|
44825f0960
|
YARN-7629. TestContainerLaunch# fails after YARN-7381. (Jason Lowe via wangda)
Change-Id: Ia6a3f05c9a7e797d8190123d304ecc4e2b018e33
|
2017-12-15 15:40:56 -08:00 |
|
Wangda Tan
|
631b5c2db7
|
YARN-5418. When partial log aggregation is enabled, display the list of aggregated files on the container log page. (Xuan Gong via wangda)
Change-Id: I1befb0bbaeb89fb315bafe3e2f3379663f8cf1ec
|
2017-12-15 15:38:36 -08:00 |
|
Sunil G
|
6681dd1007
|
YARN-7633. Documentation for auto queue creation feature and related configurations. Contributed by Suma Shivaprasad.
|
2017-12-15 23:07:15 +05:30 |
|
Rohith Sharma K S
|
09d996fdd4
|
YARN-7190. Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath. Contributed by Varun Saxena.
|
2017-12-15 21:50:28 +05:30 |
|
Sunil G
|
890d3d0645
|
YARN-7638. Unit tests related to preemption for auto created leaf queues feature.Contributed by Suma Shivaprasad.
|
2017-12-15 13:00:57 +05:30 |
|
Weiwei Yang
|
89b6c482c1
|
YARN-7642. Add test case to verify context update after container promotion or demotion with or without auto update. Contributed by Weiwei Yang.
|
2017-12-15 11:58:52 +08:00 |
|
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
95d4ec7fc0
|
YARN-7565. Addendum to fix an incompatible change. Contributed by Wangda Tan.
|
2017-12-14 17:10:37 -08:00 |
|
Subru Krishnan
|
17ba74be29
|
YARN-7630. Fix AMRMToken rollover handling in AMRMProxy. Contributed by Botong Huang.
|
2017-12-14 14:03:55 -08:00 |
|
Sunil G
|
2564b4d07f
|
YARN-7119. Support multiple resource types in rmadmin updateNodeResource command. Contributed by Manikandan R.
|
2017-12-14 16:11:57 +05:30 |
|
Eric Yang
|
438c1d333e
|
YARN-7540. Route YARN service CLI function through YARN Service API. (Contributed by Eric Yang)
|
2017-12-13 19:29:04 -05:00 |
|
Chen Liang
|
46e18c8da7
|
HADOOP-14914. Change to a safely casting long to int. Contributed by Ajay Kumar.
|
2017-12-13 14:56:14 -08:00 |
|
Sunil G
|
cb87e4dc92
|
YARN-7643. Handle recovery of applications in case of auto-created leaf queue mapping. Contributed by Suma Shivaprasad.
|
2017-12-13 22:49:58 +05:30 |
|
Sunil G
|
10fc8d2a7d
|
YARN-7383. Node resource is not parsed correctly for resource names containing dot. Contributed by Gergely Novák.
|
2017-12-13 22:00:07 +05:30 |
|
Sunil G
|
880cd754a5
|
YARN-7536. em-table improvement for better filtering in new YARN UI. Contributed by Vasudevan Skm. This closes #313.
|
2017-12-13 16:46:12 +05:30 |
|
Sunil G
|
fa4ecd8b98
|
YARN-7641. Allow searchable filter for Application page log viewer in new YARN UI. Contributed by Vasudevan Skm. This closes #312.
|
2017-12-13 15:51:49 +05:30 |
|
Weiwei Yang
|
7efc4f7688
|
YARN-7647. NM print inappropriate error log when node-labels is enabled. Contributed by Yang Wang.
|
2017-12-13 13:11:41 +08:00 |
|
Jason Lowe
|
2abab1d7c5
|
YARN-7595. Container launching code suppresses close exceptions after writes. Contributed by Jim Brennan
|
2017-12-12 16:04:15 -06:00 |
|
Jian He
|
3ebe6a7819
|
YARN-7565. Yarn service pre-maturely releases the container after AM restart. Contributed by Chandni Singh
|
2017-12-12 13:35:56 -08:00 |
|
Jason Lowe
|
06f0eb2dce
|
YARN-7625. Expose NM node/containers resource utilization in JVM metrics. Contributed by Weiwei Yang
|
2017-12-12 12:56:26 -06:00 |
|
Sunil G
|
8bb83a8f62
|
Queue ACL validations should validate parent queue ACLs before auto-creating leaf queues. Contributed by Suma Shivaprasad.
|
2017-12-12 15:20:59 +05:30 |
|
Sunil G
|
5c87fb2f62
|
YARN-7635. TestRMWebServicesSchedulerActivities fails in trunk. Contributed by Sunil G.
|
2017-12-12 15:08:18 +05:30 |
|
Sunil G
|
312ceebde8
|
YARN-7632. Effective min and max resource need to be set for auto created leaf queues upon creation and capacity management. Contributed by Suma Shivaprasad.
|
2017-12-11 19:20:02 +05:30 |
|
Weiwei Yang
|
a2edc4cbf5
|
YARN-7608. Incorrect sTarget column causing DataTable warning on RM application and scheduler web page. Contributed by Gergely Novák.
|
2017-12-11 10:31:46 +08:00 |
|
Subru Krishnan
|
670e8d4ec7
|
YARN-6704. Add support for work preserving NM restart when FederationInterceptor is enabled in AMRMProxyService. (Botong Huang via Subru).
|
2017-12-08 15:39:18 -08:00 |
|
Wangda Tan
|
04b84da245
|
YARN-7443. Add native FPGA module support to do isolation with cgroups. (Zhankun Tang via wangda)
Change-Id: Ic4b7f9f3e032986b8f955139c9fe4d3a6c818a53
|
2017-12-08 15:18:22 -08:00 |
|
Wangda Tan
|
adca1a72e4
|
YARN-7591. NPE in async-scheduling mode of CapacityScheduler. (Tao Yang via wangda)
Change-Id: I46689e530550ee0a6ac7a29786aab2cc1bdf314f
|
2017-12-08 15:17:02 -08:00 |
|
Wangda Tan
|
a8316df8c0
|
YARN-7520. Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues. (Suma Shivaprasad via wangda)
Change-Id: I482f086945bd448d512cb5b3879d7371e37ee134
|
2017-12-08 15:11:28 -08:00 |
|
Wangda Tan
|
f548bfffbd
|
YARN-7420. YARN UI changes to depict auto created queues. (Suma Shivaprasad via wangda)
Change-Id: I8039d3772a191ddede132cd1f8b08a8ca2e275b7
|
2017-12-08 15:10:47 -08:00 |
|
Wangda Tan
|
b38643c9a8
|
YARN-7473. Implement Framework and policy for capacity management of auto created queues. (Suma Shivaprasad via wangda)
Change-Id: Icca7805fe12f6f7fb335effff4b121b6f7f6337b
|
2017-12-08 15:10:16 -08:00 |
|
Wangda Tan
|
74665e3a7d
|
YARN-7274. Ability to disable elasticity at leaf queue level. (Zian Chen via wangda)
Change-Id: Ic8d43e297f0f5de788b562f7eff8106c5c35e8d2
|
2017-12-08 15:07:56 -08:00 |
|
Sunil G
|
532bbf4602
|
YARN-7533. Documentation for absolute resource support in Capacity Scheduler. Contributed by Sunil G.
|
2017-12-07 18:56:54 -08:00 |
|
Sunil G
|
4db4a4a165
|
YARN-7575. NPE in scheduler UI when max-capacity is not configured. Contributed by Sunil G.
|
2017-12-07 18:56:54 -08:00 |
|
Sunil G
|
daa1cdd062
|
YARN-7564. Cleanup to fix checkstyle issues of YARN-5881 branch. Contributed by Sunil G.
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
1012b901c8
|
YARN-7544. Use queue-path.capacity/maximum-capacity to specify absolute min/max resources. (Sunil G via wangda)
Change-Id: I685341be213eee500f51e02f01c91def89391c17
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
b7b8cd5324
|
YARN-7538. Fix performance regression introduced by Capacity Scheduler absolute min/max resource refactoring. (Sunil G via wangda)
Change-Id: Ic9bd7e599c56970fe01cb0e1bba6df7d1f77eb29
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
7462c38277
|
YARN-7483. CapacityScheduler test cases cleanup post YARN-5881. (Sunil G via wangda)
Change-Id: I9741a6baf5cb7352d05636efb6c0b24790e7589a
|
2017-12-07 18:56:54 -08:00 |
|
Rohith Sharma K S
|
e65ca92fb6
|
YARN-7482. Max applications calculation per queue has to be retrospected with absolute resource support. Contributed by Sunil G.
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
034b312d9f
|
YARN-7411. Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee. (Sunil G via wangda)
Change-Id: I41b1d7558c20fc4eb2050d40134175a2ef6330cb
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
aa3f62740f
|
YARN-7332. Compute effectiveCapacity per each resource vector. (Sunil G via wangda)
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
d52627a7cb
|
YARN-7254. UI and metrics changes related to absolute resource configuration. (Sunil G via wangda)
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
5e798b1a0d
|
YARN-6471. Support to add min/max resource configuration for a queue. (Sunil G via wangda)
Change-Id: I9213f5297a6841fab5c573e85ee4c4e5f4a0b7ff
|
2017-12-07 18:56:54 -08:00 |
|
Weiwei Yang
|
e411dd6666
|
YARN-7607. Remove the trailing duplicated timestamp in container diagnostics message. Contributed by Weiwei Yang.
|
2017-12-07 17:29:40 +08:00 |
|
Weiwei Yang
|
40b0045ebe
|
YARN-7610. Extend Distributed Shell to support launching job with opportunistic containers. Contributed by Weiwei Yang.
|
2017-12-06 17:52:41 +08:00 |
|
Weiwei Yang
|
05c347fe51
|
YARN-7611. Node manager web UI should display container type in containers page. Contributed by Weiwei Yang.
|
2017-12-06 12:21:52 +08:00 |
|
Wangda Tan
|
0311cf0535
|
YARN-7381. Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml. (Xuan Gong via wangda)
Change-Id: I1ed58dafad5cc276eea5c0b0813cf04f57d73a87
|
2017-12-05 13:09:49 -08:00 |
|
Sunil G
|
a957f1c60e
|
YARN-7438. Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm. Contributed by Wangda Tan
|
2017-12-05 22:50:07 +05:30 |
|
Sunil G
|
99ccca341f
|
YARN-7092. Render application specific log under application tab in new YARN UI. Contributed by Akhil PB.
|
2017-12-05 19:41:07 +05:30 |
|
Sunil G
|
f9f317b702
|
YARN-7586. Application Placement should be done before ACL checks in ResourceManager. Contributed by Suma Shivaprasad.
|
2017-12-05 18:28:31 +05:30 |
|
Arpit Agarwal
|
e00c7f78c1
|
HADOOP-14976. Set HADOOP_SHELL_EXECNAME explicitly in scripts.
|
2017-12-04 21:02:04 -08:00 |
|
Robert Kanter
|
d8863fc16f
|
YARN-5594. Handle old RMDelegationToken format when recovering RM (rkanter)
|
2017-12-04 13:14:55 -08:00 |
|
Eric Yang
|
d30d57828f
|
YARN-6669. Implemented Kerberos security for YARN service framework. (Contributed by Jian He)
|
2017-12-04 15:11:00 -05:00 |
|
Arun Suresh
|
37ca416950
|
YARN-7587. Skip dispatching opportunistic containers to nodes whose queue is already full. (Weiwei Yang via asuresh)
|
2017-12-03 22:22:01 -08:00 |
|
Sunil G
|
81f6e46b2f
|
YARN-6907. Node information page in the old web UI should report resource types. Contributed by Gergely Novák.
|
2017-12-04 11:27:23 +05:30 |
|
Sunil G
|
30f2646b15
|
YARN-7594. TestNMWebServices#testGetNMResourceInfo fails on trunk. Contributed by Gergely Novák.
|
2017-12-04 10:45:07 +05:30 |
|
Jason Lowe
|
60f95fb719
|
YARN-7455. quote_and_append_arg can overflow buffer. Contributed by Jim Brennan
|
2017-12-01 15:47:01 -06:00 |
|
Jason Lowe
|
25df505421
|
YARN-7589. TestPBImplRecords fails with NullPointerException. Contributed by Daniel Templeton
|
2017-12-01 15:37:36 -06:00 |
|
Robert Kanter
|
c83fe44917
|
YARN-4813. TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently (grepas via rkanter)
|
2017-12-01 12:18:13 -08:00 |
|
Wangda Tan
|
7225ec0ceb
|
YARN-6507. Add support in NodeManager to isolate FPGA devices with CGroups. (Zhankun Tang via wangda)
Change-Id: Ic9afd841805f1035423915a0b0add5f3ba96cf9d
|
2017-12-01 10:50:49 -08:00 |
|
Sunil G
|
556aea3f36
|
YARN-7487. Ensure volume to include GPU base libraries after created by plugin. Contributed by Wangda Tan.
|
2017-12-01 13:36:28 +05:30 |
|
Sunil G
|
4653aa3eb3
|
YARN-7546. Layout changes in Queue UI to show queue details on right pane. Contributed by Vasudevan Skm.
|
2017-12-01 13:26:01 +05:30 |
|
Wangda Tan
|
a63d19d365
|
YARN-6124. Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues. (Zian Chen via wangda)
Change-Id: Id93656f3af7dcd78cafa94e33663c78d410d43c2
|
2017-11-30 15:57:22 -08:00 |
|
Junping Du
|
a409425986
|
YARN-7558. yarn logs command fails to get logs for running containers if UI authentication is enabled. Contributed by Xuan Gong.
|
2017-11-30 13:47:47 -08:00 |
|
Jason Lowe
|
5cfaee2e6d
|
YARN-7495. Improve robustness of the AggregatedLogDeletionService. Contributed by Jonathan Eagles
|
2017-11-30 12:39:18 -06:00 |
|
Wangda Tan
|
c9a54aab6b
|
YARN-7573. Gpu Information page could be empty for nodes without GPU. (Sunil G via wangda)
Change-Id: I7f614e5a589a09ce4e4286c84b706e05c29abd14
|
2017-11-29 17:46:16 -08:00 |
|
Wei Yan
|
333ef303ff
|
YARN-6851. Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat.
|
2017-11-29 14:38:07 -08:00 |
|
Daniel Templeton
|
8498d287cd
|
YARN-7541. Node updates don't update the maximum cluster capability for resources other than CPU and memory
|
2017-11-29 11:11:36 -08:00 |
|
Jason Lowe
|
a2c7a73e33
|
YARN-6647. RM can crash during transitionToStandby due to InterruptedException. Contributed by Bibin A Chundatt
|
2017-11-28 11:15:44 -06:00 |
|
Sunil G
|
6b76695f88
|
YARN-7480. Render tooltips on columns where text is clipped in new YARN UI. Contributed by Vasudevan Skm. This closes #293
|
2017-11-28 22:41:52 +05:30 |
|
Sunil G
|
641ba5c7a1
|
YARN-7499. Layout changes to Application details page in new YARN UI. Contributed by Vasudevan Skm.
|
2017-11-28 18:37:11 +05:30 |
|
Yufei Gu
|
d8923cdbf1
|
YARN-7363. ContainerLocalizer don't have a valid log4j config in case of Linux container executor. (Contributed by Yufei Gu)
|
2017-11-27 14:31:52 -08:00 |
|
Jian He
|
fedabcad42
|
YARN-6168. Restarted RM may not inform AM about all existing containers. Contributed by Chandni Singh
|
2017-11-27 10:19:58 -08:00 |
|
Yufei Gu
|
2bde3aedf1
|
YARN-7290. Method canContainerBePreempted can return true when it shouldn't. (Contributed by Steven Rand)
|
2017-11-24 23:32:46 -08:00 |
|
Wangda Tan
|
834e91ee91
|
YARN-7509. AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby. (Tao Yang via wangda)
Change-Id: I7477fe355419fd4a0a6e2bdda7319abad4c4c748
|
2017-11-23 19:59:03 -08:00 |
|
Arun Suresh
|
b46ca7e73b
|
YARN-6483. Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM. (Juan Rodriguez Hortala via asuresh)
|
2017-11-22 19:18:30 -08:00 |
|
Sunil G
|
aab439593b
|
YARN-7330. Add support to show GPU in UI including metrics. Contributed by Wangda Tan.
|
2017-11-23 07:54:20 +05:30 |
|
Yufei Gu
|
4cc9479dae
|
YARN-7524. Remove unused FairSchedulerEventLog. (Contributed by Wilfred Spiegelenburg)
|
2017-11-22 14:18:36 -08:00 |
|