Arun Suresh
|
35dc782923
|
YARN-5977. ContainerManagementProtocol changes to support change of container ExecutionType. (Kartheek Muthyala via asuresh)
|
2017-08-03 21:15:40 -07:00 |
|
Subru Krishnan
|
0542e6f86e
|
YARN-6932. Fix TestFederationRMFailoverProxyProvider test case failure.
|
2017-08-03 14:18:03 -07:00 |
|
Yufei Gu
|
c617fe02b3
|
YARN-6832. Tests use assertTrue(....equals(...)) instead of assertEquals()). (Daniel Templeton via Yufei Gu)
|
2017-08-03 11:33:37 -07:00 |
|
Haibo Chen
|
293c74a81b
|
YARN-6673 Add cpu cgroup configurations for opportunistic containers. (Miklos Szegedi via Haibo Chen)
|
2017-08-03 09:56:51 -07:00 |
|
Haibo Chen
|
c5d256c760
|
YARN-6674 Add memory cgroup settings for opportunistic containers. (Miklos Szegedi via Haibo Chen)
|
2017-08-03 09:52:35 -07:00 |
|
Sunil G
|
f64cfeaf61
|
YARN-6678. Handle IllegalStateException in Async Scheduling mode of CapacityScheduler. Contributed by Tao Yang.
|
2017-08-03 19:27:10 +05:30 |
|
Eric Payne
|
8ce8672b6b
|
YARN-5349. TestWorkPreservingRMRestart#testUAMRecoveryOnRMWorkPreservingRestart fail intermittently. Contributed by Jason Lowe.
|
2017-08-02 12:53:22 -05:00 |
|
Yufei Gu
|
45535f8afa
|
YARN-6895. [FairScheduler] Preemption reservation may cause regular reservation leaks. (Miklos Szegedi via Yufei Gu)
|
2017-08-02 09:25:19 -07:00 |
|
Eric Payne
|
48899134d2
|
YARN-6846. Nodemanager can fail to fully delete application local directories when applications are killed. Contributed by Jason Lowe.
|
2017-08-02 10:59:33 -05:00 |
|
Jian He
|
f9139ac8f6
|
YARN-6872. [Addendum patch] Ensure apps could run given NodeLabels are disabled post RM switchover/restart. Contributed by Sunil G
|
2017-08-02 00:03:25 -07:00 |
|
Carlo Curino
|
acda6b96a4
|
YARN-5412. Create a proxy chain for ResourceManager REST API in the Router. (Contributed by Giovanni Matteo Fumarola via curino)
(cherry picked from commit b6240b92abf453affc5fd64e1eedf2d29842aa75)
|
2017-08-01 17:28:28 -07:00 |
|
Subru Krishnan
|
86f05c3312
|
YARN-6866. Minor clean-up and fixes in anticipation of YARN-2915 merge with trunk. (Botong Huang via Subru).
(cherry picked from commit 40453879ec860819b080ccc82454480a436c0adc)
|
2017-08-01 17:28:28 -07:00 |
|
Subru Krishnan
|
8737c2a8e9
|
Bumping up hadoop-yarn-server-router module to 3.0.0-beta1 post rebase.
(cherry picked from commit 69e3ed26809e12dd62cb66d258ef51c66db3be0a)
|
2017-08-01 17:28:27 -07:00 |
|
Subru Krishnan
|
712e97d4cf
|
Bumping up yarn-server-router (new) module pom to beta1 and fixing imports post rebase.
(cherry picked from commit f1eff212c5f13c62e8fc45b0af794b5bbeb577da)
|
2017-08-01 17:28:27 -07:00 |
|
Subru Krishnan
|
3e1dc7ece0
|
YARN-6821. Move FederationStateStore SQL DDL files from test resource to sbin.
(cherry picked from commit cd9db822f0c1efc52005b1c069d52910d88038d9)
|
2017-08-01 17:28:27 -07:00 |
|
Subru Krishnan
|
825108d08a
|
YARN-6815. FederationStateStoreFacade return behavior should be consistent irrespective of whether caching is enabled or not.
(cherry picked from commit 8820693cd769065eed83193b673ec5d919d69500)
|
2017-08-01 17:28:27 -07:00 |
|
Subru Krishnan
|
43a97174fe
|
YARN-3659. Federation: routing client invocations transparently to multiple RMs. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 52daa6d971ae408d121b3737ea8c0575e7e8516d)
|
2017-08-01 17:28:26 -07:00 |
|
Subru Krishnan
|
4cfec943b1
|
YARN-6724. Add ability to blacklist sub-clusters when invoking Routing policies. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit f8e5de59697cb78686f0e605dc7e93628b5f3297)
|
2017-08-01 17:28:26 -07:00 |
|
Subru Krishnan
|
70b1a757f1
|
YARN-6511. Federation: transparently spanning application across multiple sub-clusters. (Botong Huang via Subru).
(cherry picked from commit 8c988d235eaf0972783985b1ab24680d029aea79)
|
2017-08-01 17:28:26 -07:00 |
|
Subru Krishnan
|
bed1832c93
|
YARN-3666. Federation Intercepting and propagating AM- home RM communications. (Botong Huang via Subru).
(cherry picked from commit 2399eb8200609246cb623c74450ca4a2032063cc)
|
2017-08-01 17:28:25 -07:00 |
|
Subru Krishnan
|
42949a6e01
|
YARN-6666. Fix unit test failure in TestRouterClientRMService. (Botong Huang via Subru).
(cherry picked from commit e750907d0a7e2fb4b33a7c876eaa4d9122a1deea)
|
2017-08-01 17:28:25 -07:00 |
|
Subru Krishnan
|
f317e0cb48
|
Bumping up hadoop-yarn-server-router module to 3.0.0-alpha4 post rebase.
(cherry picked from commit bd9c7b1bec3293fe338553c0d5c3612e6176fb26)
|
2017-08-01 17:28:25 -07:00 |
|
Subru Krishnan
|
859aa1f9d6
|
YARN-5531. UnmanagedAM pool manager for federating application across clusters. (Botong Huang via Subru).
(cherry picked from commit 73bb2102ce4b82b3a3bed91319f7c8f067ddc3e8)
|
2017-08-01 17:28:24 -07:00 |
|
Subru Krishnan
|
7444406d6d
|
YARN-5413. Create a proxy chain for ResourceManager Admin API in the Router. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 67846a5519b5905c2d925cf4c602f715b653e72c)
|
2017-08-01 17:28:24 -07:00 |
|
Subru Krishnan
|
80e1904000
|
YARN-5411. Create a proxy chain for ApplicationClientProtocol in the Router. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 4846069061b6baa06da3b524b9e36567dd368388)
|
2017-08-01 17:28:24 -07:00 |
|
Carlo Curino
|
5272af8c7e
|
YARN-3663. Federation State and Policy Store (DBMS implementation). (Giovanni Matteo Fumarola via curino).
(cherry picked from commit be99c1fe2eb150fabd69902118d65941f82971f6)
|
2017-08-01 17:28:24 -07:00 |
|
Carlo Curino
|
c4bbdfeb66
|
YARN-6203: Occasional test failure in TestWeightedRandomRouterPolicy (curino)
(cherry picked from commit 121d55bd29ac44289afad9a15e8737397ede298b)
|
2017-08-01 17:28:23 -07:00 |
|
Subru Krishnan
|
e1da8f0667
|
YARN-5602. Utils for Federation State and Policy Store. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 326a2e6bde1cf266ecc7d3b513cdaac6abcebbe4)
|
2017-08-01 17:28:23 -07:00 |
|
Carlo Curino
|
1c64e1709b
|
YARN-6370. Properly handle rack requests for non-active subclusters in LocalityMulticastAMRMProxyPolicy. (Contributed by Botong Huang via curino).
(cherry picked from commit ce419881c32b178c48c3a01b5a15e4e3a3e750f5)
|
2017-08-01 17:28:23 -07:00 |
|
Subru Krishnan
|
86b2bec56e
|
YARN-6247. Share a single instance of SubClusterResolver instead of instantiating one per AM. (Botong Huang via Subru)
(cherry picked from commit 51aeb2ce0c599176aca9466a939c3ad55df30036)
|
2017-08-01 17:28:23 -07:00 |
|
Carlo Curino
|
8623644f45
|
YARN-6190. Validation and synchronization fixes in LocalityMulticastAMRMProxyPolicy. (Botong Huang via curino)
(cherry picked from commit 5c486961cd3a175b122ef86275c99b72964f2c50)
|
2017-08-01 17:28:22 -07:00 |
|
Subru Krishnan
|
193ec456d6
|
YARN-5410. Bootstrap Router server module. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 04f111394b08de7d16a86f8025221f6f5e0dbcc5)
|
2017-08-01 17:28:22 -07:00 |
|
Subru Krishnan
|
98b45b0ed3
|
YARN-6093. Minor bugs with AMRMtoken renewal and state store availability when using FederationRMFailoverProxyProvider during RM failover. (Botong Huang via Subru).
(cherry picked from commit 66500f4fa6155d29435d7c92fd6d68079c4cab86)
|
2017-08-01 17:28:22 -07:00 |
|
Subru Krishnan
|
91803305e5
|
YARN-5872. Add AlwayReject policies for router and amrmproxy. (Carlo Curino via Subru).
(cherry picked from commit db26bade059ff9b38da0aa160f56653769bd0143)
|
2017-08-01 17:28:22 -07:00 |
|
Subru Krishnan
|
78032e51d9
|
YARN-5905. Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP.
(cherry picked from commit e0f0e7afed51aac4ac9093ac362f6ce64601884d)
|
2017-08-01 17:28:22 -07:00 |
|
Subru Krishnan
|
4128c9522d
|
YARN-5676. Add a HashBasedRouterPolicy, and small policies and test refactoring. (Carlo Curino via Subru).
(cherry picked from commit 575137f41c27eb72d05d923337f3030a35403e8f)
|
2017-08-01 17:28:21 -07:00 |
|
Subru Krishnan
|
083a05bc14
|
YARN-5634. Simplify initialization/use of RouterPolicy via a RouterPolicyFacade. (Carlo Curino via Subru).
(cherry picked from commit d7672ce2bddb40fbaa77d3f6fec8c99f5589177f)
|
2017-08-01 17:28:21 -07:00 |
|
Subru Krishnan
|
93d9fdeca6
|
YARN-5391. PolicyManager to tie together Router/AMRM Federation policies. (Carlo Curino via Subru).
(cherry picked from commit 20893682eced98dfba55d88edd63296993087c85)
|
2017-08-01 17:28:21 -07:00 |
|
Subru Krishnan
|
1dadd0b45a
|
YARN-5325. Stateless ARMRMProxy policies implementation. (Carlo Curino via Subru).
(cherry picked from commit 11c5336522d3504598fb94eee288d54df73418c6)
|
2017-08-01 17:28:21 -07:00 |
|
Subru Krishnan
|
0662996b6a
|
YARN-5324. Stateless Federation router policies implementation. (Carlo Curino via Subru).
(cherry picked from commit 1298127bdad60a961441dc7e25cdc2553c119f33)
|
2017-08-01 17:28:21 -07:00 |
|
Subru Krishnan
|
81472778d7
|
YARN-5323. Policies APIs for Federation Router and AMRMProxy policies. (Carlo Curino via Subru).
(cherry picked from commit f8208fe0b536f29aa65af71d20c3b3e3765679fd)
|
2017-08-01 17:28:20 -07:00 |
|
Jian He
|
2797507d51
|
YARN-5601. Make the RM epoch base value configurable. Contributed by Subru Krishnan
(cherry picked from commit 9ca2aba9cc65090162b3517b194b5e655ee4a157)
|
2017-08-01 17:28:20 -07:00 |
|
Subru Krishnan
|
1882bc10fb
|
YARN-5612. Return SubClusterId in FederationStateStoreFacade#addApplicationHomeSubCluster for Router Failover. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit ac1ba2a30427263f4a2eed2018515b2f759fa591)
|
2017-08-01 17:28:20 -07:00 |
|
Jian He
|
94a24567d6
|
YARN-3671. Integrate Federation services with ResourceManager. Contributed by Subru Krishnan
(cherry picked from commit 8573c286e27623155c715a632d56a68f23523c72)
|
2017-08-01 17:28:20 -07:00 |
|
Jian He
|
bdfad4523f
|
YARN-3673. Create a FailoverProxy for Federation services. Contributed by Subru Krishnan
(cherry picked from commit 3307564a5f8c8abc5fe84efcd05ee0f7dfdd921c)
|
2017-08-01 17:28:20 -07:00 |
|
Subru Krishnan
|
cfafd173bd
|
YARN-5467. InputValidator for the FederationStateStore internal APIs. (Giovanni Matteo Fumarola via Subru)
(cherry picked from commit bd44182e70c273ad3371a6f9b458fe0f8a7a6abc)
|
2017-08-01 17:28:19 -07:00 |
|
Jian He
|
5c84382397
|
YARN-3672. Create Facade for Federation State and Policy Store. Contributed by Subru Krishnan
(cherry picked from commit 5e976cd2b90ccf1bccb6039edf14140677804c4e)
|
2017-08-01 17:28:19 -07:00 |
|
Subru Krishnan
|
52558df620
|
YARN-5519. Add SubClusterId in AddApplicationHomeSubClusterResponse for Router Failover. (Ellen Hui via Subru)
(cherry picked from commit e4f928cf9cb2a0d57131e4b7960f47a8dac7940c)
|
2017-08-01 17:28:19 -07:00 |
|
Subru Krishnan
|
0733088c29
|
YARN-5407. In-memory based implementation of the FederationApplicationStateStore/FederationPolicyStateStore. (Ellen Hui via Subru)
(cherry picked from commit b747d59f41f08dabe4f3a486a2dbd4bed5723867)
|
2017-08-01 17:28:19 -07:00 |
|
Subru Krishnan
|
e0c3a44396
|
YARN-5408. Compose Federation membership/application/policy APIs into an uber FederationStateStore API. (Ellen Hui via Subru).
(cherry picked from commit 268389d0211a757439289bea84d502bed6f6ad52)
|
2017-08-01 17:28:19 -07:00 |
|
Subru Krishnan
|
f1a508bdef
|
YARN-3664. Federation PolicyStore internal APIs
(cherry picked from commit 2f377263a17ec36547625dff23cc65c9aa89c58e)
|
2017-08-01 17:28:18 -07:00 |
|
Subru Krishnan
|
047a16bf15
|
YARN-5307. Federation Application State Store internal APIs
(cherry picked from commit 1af5292042a336a5789b72f0fb6d5f4636d64d49)
|
2017-08-01 17:28:18 -07:00 |
|
Subru Krishnan
|
d19b677301
|
YARN-5390. Federation Subcluster Resolver. Contributed by Ellen Hui.
(cherry picked from commit d3dc461a935c2af4ec3f0312ff0c26918c408467)
|
2017-08-01 17:28:18 -07:00 |
|
Subru Krishnan
|
dcf8c52d80
|
YARN-5406. In-memory based implementation of the FederationMembershipStateStore. Contributed by Ellen Hui.
(cherry picked from commit 20d1d2be91bf841e0fee32522ee7b560a6f2598f)
|
2017-08-01 17:28:18 -07:00 |
|
Subru Krishnan
|
3e22896f86
|
YARN-3662. Federation Membership State Store internal APIs.
(cherry picked from commit 5424d0899cd68cb728f60adcefd2a95877cddbca)
|
2017-08-01 17:28:17 -07:00 |
|
Jian He
|
91f120f743
|
YARN-6872. Ensure apps could run given NodeLabels are disabled post RM switchover/restart. Contributed by Sunil G
|
2017-08-01 09:56:33 -07:00 |
|
Akira Ajisaka
|
b38a1eea8e
|
HADOOP-14245. Use Mockito.when instead of Mockito.stub. Contributed by Andras Bokor.
|
2017-08-01 15:15:43 +09:00 |
|
Akira Ajisaka
|
a4aa1cb405
|
Revert "YARN-6873. Moving logging APIs over to slf4j in hadoop-yarn-server-applicationhistoryservice. Contributed by Yeliang Cang."
This reverts commit 1a78c0ff01 .
|
2017-08-01 12:15:03 +09:00 |
|
Akira Ajisaka
|
1a78c0ff01
|
YARN-6873. Moving logging APIs over to slf4j in hadoop-yarn-server-applicationhistoryservice. Contributed by Yeliang Cang.
|
2017-08-01 10:53:32 +09:00 |
|
Akira Ajisaka
|
f8bed5e9a7
|
YARN-5728. TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization timeout.
|
2017-07-31 11:09:13 +09:00 |
|
Arun Suresh
|
890e14c02a
|
YARN-6870. Fix floating point inaccuracies in resource availability check in AllocationBasedResourceUtilizationTracker. (Brook Zhou via asuresh)
|
2017-07-28 16:32:43 -07:00 |
|
Subru Krishnan
|
bcde66bed1
|
YARN-6897. Refactoring RMWebServices by moving some util methods to RMWebAppUtil. (Giovanni Matteo Fumarola via Subru).
|
2017-07-28 15:44:36 -07:00 |
|
Yufei Gu
|
9ea01fd956
|
YARN-6802. Add max AM resource and AM resource usage to leaf queue view in FairScheduler WebUI. (YunFan Zhou via Yufei Gu)
|
2017-07-28 09:52:53 -07:00 |
|
Yufei Gu
|
9902be72cb
|
YARN-6864. FSPreemptionThread cleanup for readability. (Daniel Templeton via Yufei Gu)
|
2017-07-27 23:19:39 -07:00 |
|
Akira Ajisaka
|
38c6fa5c7a
|
HADOOP-11875. [JDK9] Adding a second copy of Hamlet without _ as a one-character identifier.
|
2017-07-28 09:10:52 +09:00 |
|
Varun Saxena
|
11ece0bda1
|
Addendum for YARN-5548. Use MockRMMemoryStateStore to reduce test failures (Bibin A Chundatt via Varun Saxena)
|
2017-07-28 00:10:45 +05:30 |
|
Varun Saxena
|
f66fd11e51
|
YARN-5548. Use MockRMMemoryStateStore to reduce test failures (Bibin A Chundatt via Varun Saxena)
|
2017-07-27 23:14:50 +05:30 |
|
Daniel Templeton
|
f81a4efb8c
|
YARN-6307. Refactor FairShareComparator#compare (Contributed by Yufei Gu via Daniel Templeton)
|
2017-07-25 13:00:31 -07:00 |
|
Jian He
|
ac9489f7fc
|
YARN-6804. Allow custom hostname for docker containers in native services. Contributed by Billie Rinaldi
|
2017-07-25 09:57:14 -07:00 |
|
Akira Ajisaka
|
cca51e916b
|
HADOOP-14681. Remove MockitoMaker class. Contributed by Andras Bokor.
|
2017-07-25 15:24:56 +09:00 |
|
Akira Ajisaka
|
218b1b33ff
|
YARN-6150. TestContainerManagerSecurity tests for Yarn Server are flakey. Contributed by Daniel Sturman and Ray Chiang.
|
2017-07-25 15:12:08 +09:00 |
|
Daniel Templeton
|
10583625c1
|
YARN-6845. Variable scheduler of FSLeafQueue duplicates the one of its parent FSQueue.
(Contributed by Yufei Gu via Daniel Templeton)
|
2017-07-24 13:44:00 -07:00 |
|
Daniel Templeton
|
bb30bd3771
|
YARN-6779. DominantResourceFairnessPolicy.DominantResourceFairnessComparator.calculateShares() should be @VisibleForTesting
(Contributed by Yeliang Cang via Daniel Templeton)
|
2017-07-24 12:13:50 -07:00 |
|
Sunil G
|
e315328428
|
YARN-6102. RMActiveService context to be updated with new RMContext on failover. Contributed by Rohith Sharma K S.
|
2017-07-24 11:39:03 +05:30 |
|
Brahma Reddy Battula
|
2054324d47
|
Revert "YARN-6804. [YARN core changes] Allow custom hostname for docker containers in native services. Contributed by Billie Rinaldi"
This reverts commit 4a771d9010 .
|
2017-07-23 12:56:18 +08:00 |
|
Jian He
|
4a771d9010
|
YARN-6804. [YARN core changes] Allow custom hostname for docker containers in native services. Contributed by Billie Rinaldi
|
2017-07-21 11:31:33 -07:00 |
|
Jason Lowe
|
c8df3668ec
|
YARN-6837. Null LocalResource visibility or resource type can crash the nodemanager. Contributed by Jinjiang Ling
|
2017-07-20 11:03:04 -05:00 |
|
Arun Suresh
|
077fcf6a96
|
YARN-6777. Support for ApplicationMasterService processing chain of interceptors. (asuresh)
|
2017-07-19 12:26:40 -07:00 |
|
Rohith Sharma K S
|
845c4e52bd
|
YARN-6819. Application report fails if app rejected due to nodesize. Contributed by Bibin A Chundatt.
|
2017-07-19 11:10:52 +05:30 |
|
Yufei Gu
|
daaf530fce
|
YARN-6778. In ResourceWeights, weights and setWeights() should be final. (Daniel Templeton via Yufei Gu)
|
2017-07-18 16:38:07 -07:00 |
|
Ray Chiang
|
f5f14a2ad6
|
YARN-6798. Fix NM startup failure with old state store due to version mismatch. (Botong Huang via rchiang)
|
2017-07-18 12:35:08 -07:00 |
|
Sunil G
|
0b7afc060c
|
Addendum patch for YARN-5731
|
2017-07-18 11:49:09 +05:30 |
|
Arun Suresh
|
5b007921cd
|
YARN-6706. Refactor ContainerScheduler to make oversubscription change easier. (Haibo Chen via asuresh)
|
2017-07-17 14:11:14 -07:00 |
|
Yufei Gu
|
9e0cde1469
|
YARN-6625. yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environment. (Yufei Gu)
|
2017-07-14 14:10:45 -07:00 |
|
Jason Lowe
|
a5ae5ac50e
|
YARN-3260. AM attempt fail to register before RM processes launch event. Contributed by Bibin A Chundatt
|
2017-07-14 14:56:00 -05:00 |
|
bibinchundatt
|
75c0220b44
|
YARN-6759. Fix TestRMRestart.testRMRestartWaitForPreviousAMToFinish failure. Contributed by Naganarasimha G R
|
2017-07-14 13:53:39 +05:30 |
|
Yufei Gu
|
4a574e9a84
|
YARN-6769. Make schedulables without demand less needy in FairSharePolicy#compare. (Yunfan Zhou via Yufei Gu)
|
2017-07-13 23:10:10 -07:00 |
|
Sunil G
|
228ddaa31d
|
YARN-6792. Incorrect XML convertion in NodeIDsInfo and LabelsToNodesInfo. Contributed by Giovanni Matteo Fumarola.
|
2017-07-14 08:07:05 +05:30 |
|
Jason Lowe
|
ebc048cc05
|
YARN-6805. NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code. Contributed by Jason Lowe
|
2017-07-13 17:44:47 -05:00 |
|
Jason Lowe
|
0ffca5d347
|
Revert "YARN-6805. NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code. Contributed by Jason Lowe"
This reverts commit f76f5c0919 .
|
2017-07-13 17:42:38 -05:00 |
|
Jason Lowe
|
f76f5c0919
|
YARN-6805. NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code. Contributed by Jason Lowe
|
2017-07-13 17:38:17 -05:00 |
|
Jason Lowe
|
5f1ee72b0e
|
YARN-6654. RollingLevelDBTimelineStore backwards incompatible after fst upgrade. Contributed by Jonathan Eagles
|
2017-07-13 17:27:40 -05:00 |
|
Wangda Tan
|
945c0958bb
|
YARN-6775. CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls. (Nathan Roberts via wangda)
Change-Id: I84ccd54200ccbaae23018ef320028e42b4c3509a
|
2017-07-13 10:30:15 -07:00 |
|
Sunil G
|
cf0d0844d6
|
YARN-5731. Preemption calculation is not accurate when reserved containers are present in queue. Contributed by Wangda Tan.
|
2017-07-13 16:48:29 +05:30 |
|
Xuan
|
9845bea59c
|
YARN-6689. PlacementRule should be configurable. (Jonathan Hung via xgong)
|
2017-07-12 15:40:45 -07:00 |
|
Sunil G
|
34f113df5c
|
YARN-6714. IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. Contributed by Tao Yang.
|
2017-07-11 14:52:44 +05:30 |
|
Arun Suresh
|
5496a34c0c
|
YARN-6776. Refactor ApplicaitonMasterService to move actual processing logic to a separate class. (asuresh)
|
2017-07-10 14:34:58 -07:00 |
|
Steve Loughran
|
09653ea098
|
HADOOP-14634. Remove jline from main Hadoop pom.xml.
Contributed by Ray Chiang.
|
2017-07-10 11:53:13 +01:00 |
|
Yufei Gu
|
3de47ab5ea
|
YARN-6764. Simplify the logic in FairScheduler#attemptScheduling. Contributed by Yufei Gu.
|
2017-07-09 16:09:12 -07:00 |
|
Naganarasimha
|
626d730bfc
|
YARN-6428. Queue AM limit is not honored in CS always. Contributed by Bibin A Chundatt.
|
2017-07-09 17:26:09 +05:30 |
|
Daniel Templeton
|
9d27880442
|
YARN-6410. FSContext.scheduler should be final (Contributed by Yeliang Cang via Daniel Templeton)
|
2017-07-09 19:34:35 +09:00 |
|
Daniel Templeton
|
c5a0c38d8e
|
YARN-6746. SchedulerUtils.checkResourceRequestMatchingNodePartition() is dead code
(Contributed by Deepti Sawhney via Daniel Templeton)
|
2017-07-09 19:27:32 +09:00 |
|
Daniel Templeton
|
0615985886
|
YARN-6752. Display reserved resources in web UI per application
(Contributed by Abdullah Yousufi via Daniel Templeton)
|
2017-07-09 19:02:31 +09:00 |
|
Jason Lowe
|
7576a688ea
|
YARN-6708. Nodemanager container crash after ext3 folder limit. Contributed by Bibin A Chundatt
|
2017-07-06 09:40:09 -05:00 |
|
Naganarasimha
|
fa1aaee87b
|
YARN-6681. Eliminate double-copy of child queues in canAssignToThisQueue. Contributed by Daryn Sharp.
|
2017-07-01 12:29:39 +05:30 |
|
Andrew Wang
|
af2773f609
|
Updating version for 3.0.0-beta1 development
|
2017-06-29 17:57:40 -07:00 |
|
Daniel Templeton
|
ec97519779
|
YARN-6751. Display reserved resources in web UI per queue
(Contributed by Abdullah Yousufi via Daniel Templeton)
|
2017-06-29 16:53:50 -07:00 |
|
Sunil G
|
c1edca101c
|
YARN-6280. Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API. Contributed by Lantao Jin.
|
2017-06-28 15:40:58 -07:00 |
|
Jason Lowe
|
63ce1593c5
|
YARN-6738. LevelDBCacheTimelineStore should reuse ObjectMapper instances. Contributed by Zoltan Haindrich
|
2017-06-27 17:12:42 -05:00 |
|
Yufei Gu
|
0b77262890
|
YARN-5876. TestResourceTrackerService#testGracefulDecommissionWithApp fails intermittently on trunk. (Robert Kanter via Yufei Gu)
|
2017-06-23 13:26:03 -07:00 |
|
Sunil G
|
ca13b224b2
|
YARN-5892. Support user-specific minimum user limit percentage in Capacity Scheduler. Contributed by Eric Payne.
|
2017-06-22 23:50:57 -07:00 |
|
Naganarasimha
|
740204b292
|
YARN-5006. ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zk. Contributed by Bibin A Chundatt.
|
2017-06-23 07:52:41 +05:30 |
|
Arun Suresh
|
49aa60e50d
|
YARN-6127. Add support for work preserving NM restart when AMRMProxy is enabled. (Botong Huang via asuresh).
|
2017-06-22 11:27:13 -07:00 |
|
Akira Ajisaka
|
099dfe92a9
|
YARN-6713. Fix dead link in the Javadoc of FairSchedulerEventLog.java. Contributed by Weiwei Yang.
|
2017-06-20 17:20:27 +09:00 |
|
Naganarasimha
|
ee89ac84e6
|
YARN-6680. Avoid locking overhead for NO_LABEL lookups. Contributed by Daryn Sharp
|
2017-06-19 22:42:45 +05:30 |
|
Naganarasimha
|
e9c2aa1bc3
|
YARN-6467. CSQueueMetrics needs to update the current metrics for default partition only. Contributed by Manikandan R.
|
2017-06-19 21:31:40 +05:30 |
|
bibinchundatt
|
d64c842743
|
YARN-6703. RM startup failure with old state store due to version mismatch. Contributed by Varun Saxena
|
2017-06-12 18:07:43 +05:30 |
|
Eric Payne
|
5578af8603
|
YARN-6585. RM fails to start when upgrading from 2.7 for clusters with node labels. Contributed by Sunil G.
|
2017-06-09 16:16:34 -05:00 |
|
Naganarasimha
|
99634d10ed
|
YARN-6682. Improve performance of AssignmentInformation datastructures. Contributed by Daryn Sharp.
|
2017-06-09 11:10:13 +05:30 |
|
Daniel Templeton
|
a062374c39
|
YARN-6679. Reduce Resource instance overhead via non-PBImpl
(Contributed by Daryn Sharp via Daniel Templeton)
|
2017-06-08 10:08:08 -07:00 |
|
Carlo Curino
|
547cb53e8a
|
YARN-6634. [API] Refactor ResourceManager WebServices to make API explicit. (Giovanni Matteo Fumarola via curino)
|
2017-06-07 13:41:06 -07:00 |
|
Varun Saxena
|
0b7bff706e
|
YARN-6604. Allow metric TTL for Application table to be specified through cmd (Haibo Chen via Varun Saxena)
|
2017-06-07 21:51:07 +05:30 |
|
Jian He
|
7311015ace
|
YARN-6683. Invalid event: COLLECTOR_UPDATE at KILLED. Contributed by Rohith Sharma K S
|
2017-06-05 13:16:57 -07:00 |
|
Daniel Templeton
|
73ecb19312
|
YARN-6208. Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application
(Contributed by Akira Ajisaka via Daniel Templeton)
|
2017-06-02 08:50:19 -07:00 |
|
vrushali
|
d95c82cb79
|
YARN-6316 Provide help information and documentation for TimelineSchemaCreator (Contributed by Haibo Chen via Vrushali C)
|
2017-06-01 18:30:23 -07:00 |
|
Daniel Templeton
|
d5b71e4175
|
YARN-6246. Identifying starved apps does not need the scheduler writelock
(Contributed by Karthik Kambatla via Daniel Templeton)
|
2017-05-31 15:48:04 -07:00 |
|
Nathan Roberts
|
4369690ce6
|
YARN-6649. RollingLevelDBTimelineServer throws RuntimeException if object decoding ever fails runtime exception. Contributed by Jon Eagles.
|
2017-05-31 11:32:32 -05:00 |
|
Jonathan Eagles
|
cbfed0e82f
|
YARN-6497. Method length of ResourceManager#serviceInit() is too long (Gergely Novák via jeagles)
|
2017-05-31 10:18:42 -05:00 |
|
Varun Vasudev
|
547f18cb96
|
YARN-6366. Refactor the NodeManager DeletionService to support additional DeletionTask types. Contributed by Shane Kumpf.
|
2017-05-31 16:15:35 +05:30 |
|
Andrew Wang
|
16ad896d5c
|
Update maven version for 3.0.0-alpha4 development
|
2017-05-26 14:09:44 -07:00 |
|
Daniel Templeton
|
d81372dfad
|
YARN-6646. Modifier 'static' is redundant for inner enums
(Contributed by ZhangBing Lin via Daniel Templeton)
|
2017-05-26 12:05:48 -07:00 |
|
Jason Lowe
|
aea42930bb
|
YARN-6641. Non-public resource localization on a bad disk causes subsequent containers failure. Contributed by Kuhu Shukla
|
2017-05-26 09:37:56 -05:00 |
|
Haibo Chen
|
47474fffac
|
YARN-6555. Store application flow context in NM state store for work-preserving restart. (Rohith Sharma K S via Haibo Chen)
|
2017-05-25 21:15:27 -07:00 |
|
Yufei Gu
|
87590090c8
|
YARN-6582. FSAppAttempt demand can be updated atomically in updateDemand(). (Karthik Kambatla via Yufei Gu)
|
2017-05-25 14:22:13 -07:00 |
|
Jason Lowe
|
3fd6a2da4e
|
YARN-6643. TestRMFailover fails rarely due to port conflict. Contributed by Robert Kanter
|
2017-05-25 16:07:52 -05:00 |
|
Varun Vasudev
|
1a56a3db59
|
Addendum patch to fix Docker sanitization.
|
2017-05-25 14:53:57 +05:30 |
|
Akira Ajisaka
|
bc28da65fb
|
YARN-6141. ppc64le on Linux doesn't trigger __linux get_executable codepath. Contributed by Sonia Garudi and Ayappan.
|
2017-05-25 17:06:26 +09:00 |
|
Jason Lowe
|
8bf1949c0e
|
YARN-6615. AmIpFilter drops query parameters on redirect. Contributed by Wilfred Spiegelenburg
|
2017-05-24 11:22:42 -05:00 |
|
Wangda Tan
|
8e0f83e49a
|
YARN-6493. Print requested node partition in assignContainer logs. (Jonathan Hung via wangda)
Change-Id: Ib20326daac10acad363befb0ae0998441fa5b32d
|
2017-05-22 14:28:55 -07:00 |
|
Wangda Tan
|
c583ab02c7
|
YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Sunil G via wangda)
Change-Id: I9b19f69788068be05b3295247cdd7b972f8a573c
|
2017-05-22 14:26:13 -07:00 |
|
Sunil G
|
b6f66b0da1
|
YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang.
|
2017-05-22 14:10:06 +05:30 |
|
Jian He
|
e135c0b207
|
YARN-6627. Use deployed webapp folder to launch new YARN UI. Contributed by Sunil G
|
2017-05-19 20:14:03 -07:00 |
|
Robert Kanter
|
9855225a79
|
YARN-6602. Impersonation does not work if standby RM is contacted first (rkanter)
|
2017-05-19 15:43:22 -07:00 |
|
Yufei Gu
|
66bba8c024
|
YARN-6249. TestFairSchedulerPreemption fails inconsistently. (Tao Jie via Yufei Gu)
|
2017-05-19 14:53:27 -07:00 |
|
Eric Payne
|
19482e0d09
|
YARN-6618. TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once. Contributed by Jason Lowe.
|
2017-05-19 11:24:54 -05:00 |
|
Varun Vasudev
|
b46cd315f7
|
Sanitize arguments before launching Docker containers.
|
2017-05-18 10:37:16 +05:30 |
|
Varun Vasudev
|
e120ee865a
|
Validate docker image name before launching container.
|
2017-05-18 10:29:34 +05:30 |
|
Chris Douglas
|
b23fcc86c6
|
YARN-6577. Remove unused ContainerLocalization classes. Contributed by ZhangBing Lin
|
2017-05-17 20:40:06 -07:00 |
|
Rohith Sharma K S
|
d87a63a901
|
HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe.
|
2017-05-17 08:27:45 +05:30 |
|
Robert Kanter
|
18c494a00c
|
YARN-6447. Provide container sandbox policies for groups (gphillips via rkanter)
|
2017-05-16 18:02:39 -07:00 |
|
Jian He
|
8236130b2c
|
YARN-6306. NMClient API change for container upgrade. Contributed by Arun Suresh
|
2017-05-16 10:48:46 -07:00 |
|
Jason Lowe
|
489f85933c
|
YARN-6603. NPE in RMAppsBlock. Contributed by Jason Lowe
|
2017-05-16 09:26:44 -05:00 |
|
Jonathan Eagles
|
c48f2976a3
|
YARN-6598. History server getApplicationReport NPE when fetching report for pre-2.8 job (Jason Lowe via jeagles)
|
2017-05-15 10:32:01 -05:00 |
|
Carlo Curino
|
6600abbb5c
|
YARN-6587. Refactor of ResourceManager#startWebApp in a Util class. (Giovanni Matteo Fumarola via curino).
|
2017-05-12 17:48:55 -07:00 |
|
Haibo Chen
|
6c35001b9f
|
YARN-6580. Incorrect logger for FairSharePolicy. (Vrushali C via Haibo Chen)
|
2017-05-12 13:05:40 -07:00 |
|
Daniel Templeton
|
90cb5b4635
|
YARN-6380. FSAppAttempt keeps redundant copy of the queue
|
2017-05-11 13:47:02 -07:00 |
|
Min Shen
|
2ada100da7
|
YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen.
|
2017-05-11 13:25:31 -07:00 |
|
Brahma Reddy Battula
|
4aae2d40a3
|
HADOOP-14410. Correct spelling of 'beginning' and variants. Contributed By Dongtao Zhang
|
2017-05-11 23:33:45 +05:30 |
|
Carlo Curino
|
5cb6e3e082
|
YARN-6473. Create ReservationInvariantChecker to validate ReservationSystem + Scheduler operations.
|
2017-05-10 14:49:25 -07:00 |
|
Daniel Templeton
|
e7654c4a1f
|
YARN-6571. Fix JavaDoc issues in SchedulingPolicy
(Contributed by Weiwei Yang via Daniel Templeton)
|
2017-05-10 14:34:13 -07:00 |
|
Daniel Templeton
|
74a61438ca
|
YARN-6475. Fix some long function checkstyle issues
(Contributed by Soumabrata Chakraborty via Daniel Templeton)
|
2017-05-10 10:46:50 -07:00 |
|
Jason Lowe
|
6099deebcb
|
YARN-6552. Increase YARN test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
|
2017-05-10 08:47:48 -05:00 |
|
Haibo Chen
|
ab2bb93a2a
|
YARN-6561. Update exception message during timeline collector aux service initialization. (Vrushali C via Haibo Chen)
|
2017-05-09 21:37:30 -07:00 |
|
Haibo Chen
|
461ee44d28
|
YARN-6435. [ATSv2] Can't retrieve more than 1000 versions of metrics in time series. (Rohith Sharma K S via Haibo Chen)
|
2017-05-09 21:12:57 -07:00 |
|
Karthik Kambatla
|
166be0ee95
|
YARN-3742. YARN RM will shut down if ZKClient creation times out. (Daniel Templeton via kasha)
|
2017-05-09 14:44:16 -07:00 |
|
Daniel Templeton
|
a2f680493f
|
YARN-5301. NM mount cpu cgroups failed on some systems
(Contributed by Miklos Szegedi via Daniel Templeton)
|
2017-05-09 12:05:46 -07:00 |
|
Vrushali Channapattan
|
7dd258d8f4
|
YARN-6563 ConcurrentModificationException in TimelineCollectorManager while stopping RM (Contributed by Haibo Chen via Vrushali C)
|
2017-05-09 11:18:12 -07:00 |
|
Andrew Wang
|
543aac9f28
|
HADOOP-14386. Rewind trunk from Guava 21.0 back to Guava 11.0.2.
|
2017-05-09 09:22:53 -07:00 |
|
Subru Krishnan
|
749e5c09b9
|
YARN-6281. Cleanup when AMRMProxy fails to initialize a new interceptor chain. (Botong Huang via Subru)
(cherry picked from commit 57a9afbd45b7ef8e6021cc58f96bd0074bf1389d)
|
2017-05-08 16:55:47 -07:00 |
|
Subru Krishnan
|
cd9ff27ffc
|
YARN-6234. Support multiple attempts on the node when AMRMProxy is enabled. (Giovanni Matteo Fumarola via Subru).
|
2017-05-08 16:41:30 -07:00 |
|
Jason Lowe
|
424887ecb7
|
YARN-3839. Quit throwing NMNotYetReadyException. Contributed by Manikandan R
|
2017-05-08 17:14:37 -05:00 |
|
Subru Krishnan
|
d6eed5acca
|
YARN-6565. Fix memory leak and finish app trigger in AMRMProxy. (Botong Huang via Subru).
|
2017-05-05 16:27:49 -07:00 |
|
Chris Douglas
|
e4f34ecb04
|
HADOOP-14390. Correct spelling of 'succeed' and variants. Contributed by Dongtao Zhang
|
2017-05-05 12:10:50 -07:00 |
|
Vrushali Channapattan
|
54e2b9e876
|
YARN-6375 App level aggregation should not consider metric values reported in the previous aggregation cycle (Varun Saxena via Vrushali C)
|
2017-05-04 15:25:56 -07:00 |
|
Sidharta S
|
fd5cb2c946
|
YARN-6374. Improve test coverage and add utility classes for common Docker operations. Contributed by Shane Kumpf
|
2017-05-03 14:49:30 -07:00 |
|
Daniel Templeton
|
9f0aea0ee2
|
YARN-6481. Yarn top shows negative container number in FS
(Contributed by Tao Jie via Daniel Templeton)
|
2017-05-02 13:06:47 -07:00 |
|
Subru Krishnan
|
6bf42e48ef
|
YARN-5331. Extend RLESparseResourceAllocation with period for supporting recurring reservations in YARN ReservationSystem. (Sangeetha Abdu Jyothi via Subru).
|
2017-05-01 18:48:36 -07:00 |
|
Subru Krishnan
|
e514fc432a
|
YARN-6542. Fix the logger in TestAlignedPlanner and TestGreedyReservationAgent.
|
2017-05-01 18:10:07 -07:00 |
|
Subru Krishnan
|
a3a615eeab
|
YARN-4359. Update LowCost agents logic to take advantage of YARN-4358. (Jonathan Yaniv and Ishai Menache via Subru).
|
2017-05-01 16:01:07 -07:00 |
|
Naganarasimha
|
30fc580196
|
YARN-6519. Fix warnings from Spotbugs in hadoop-yarn-server-resourcemanager. Contributed by Weiwei Yang.
|
2017-05-01 20:15:27 +05:30 |
|
Naganarasimha
|
0f1af3178e
|
YARN-6518. Fix warnings from Spotbugs in hadoop-yarn-server-timelineservice. Contributed by Weiwei Yang.
|
2017-05-01 16:49:30 +05:30 |
|
Daniel Templeton
|
2e52789edf
|
YARN-2962. ZKRMStateStore: Limit the number of znodes under a znode (Contributed by Varun Sexena via Daniel Templeton)
|
2017-04-28 13:30:28 -07:00 |
|
Robert Kanter
|
68e45f554b
|
YARN-6472. Improve Java sandbox regex (gphillips via rkanter)
|
2017-04-28 11:01:50 -07:00 |
|
Robert Kanter
|
371b6467dc
|
YARN-5894. fixed license warning caused by de.ruedigermoeller:fst:jar:2.24 (haibochen via rkanter)
|
2017-04-27 17:49:38 -07:00 |
|
Varun Saxena
|
793bbf216d
|
YARN-6455. Enhance the timelinewriter.flush() race condition fix (Haibo Chen via Varun Saxena)
|
2017-04-27 15:01:58 +05:30 |
|
Akira Ajisaka
|
8a99eba96d
|
Revert "YARN-5007. Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster. Contributed by Andras Bokor."
This reverts commit 34ab8e73d4 .
|
2017-04-26 15:34:23 +09:00 |
|
Wangda Tan
|
2ba21d6376
|
YARN-6392. Add submit time to Application Summary log. (Zhihai Xu via wangda)
|
2017-04-24 13:17:35 -07:00 |
|
Haibo Chen
|
8ac50e1322
|
YARN-6500. Do not mount inaccessible cgroups directories in CgroupsLCEResourcesHandler. (Miklos Szegedi via Haibo Chen)
|
2017-04-24 11:37:52 -07:00 |
|
Eric Payne
|
52adf71914
|
YARN-5617. AMs only intended to run one attempt can be run more than once? Contributed by Jason Lowe.
|
2017-04-24 12:03:28 -05:00 |
|
Daniel Templeton
|
46940d92e2
|
YARN-6302. Fail the node if Linux Container Executor is not configured properly
(Contributed by Miklos Szegedi via Daniel Templeton)
|
2017-04-19 12:23:49 -07:00 |
|
Daniel Templeton
|
dd43b895c2
|
YARN-6202. Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded
(Contributed by Yufei Gu via Daniel Templeton)
|
2017-04-19 11:44:55 -07:00 |
|
Daniel Templeton
|
41ac190dba
|
YARN-6438. Code can be improved in ContainersMonitorImpl.java
(Contributed by Miklos Szegedi via Daniel Templeton)
|
2017-04-19 10:53:08 -07:00 |
|
Sunil G
|
9ff25408bc
|
YARN-6164. Expose Queue Configurations per Node Label through YARN client api. Contributed by Benson Qiu.
|
2017-04-19 20:39:09 +05:30 |
|
Chris Douglas
|
af8e9842d2
|
YARN-6451. Add RM monitor validating metrics invariants. Contributed by Carlo Curino
|
2017-04-18 10:29:44 -07:00 |
|
Junping Du
|
6ed9d36224
|
YARN-6304. Skip rm.transitionToActive call to RM if RM is already active. Contributed by Rohith Sharma K S.
|
2017-04-17 15:51:10 -07:00 |
|
Jason Lowe
|
4168805502
|
YARN-6480. Timeout is too aggressive for TestAMRestart.testPreemptedAMRestartOnRMRestart. Contributed by Eric Badger
|
2017-04-14 17:15:48 -05:00 |
|
Karthik Kambatla
|
8a1d7480f7
|
YARN-6433. Only accessible cgroup mount directories should be selected for a controller. (Miklos Szegedi via kasha)
|
2017-04-14 15:07:14 -07:00 |
|
Eric Payne
|
a41f8dd58e
|
YARN-5994. TestCapacityScheduler.testAMLimitUsage fails intermittently. Contributed by Eric Badger
|
2017-04-14 10:53:09 -05:00 |
|
Karthik Kambatla
|
c3375175d6
|
YARN-6432. FairScheduler: Reserve preempted resources for corresponding applications. (Miklos Szegedi via kasha)
|
2017-04-12 14:21:20 -07:00 |
|
Eric Payne
|
a16ab2be91
|
YARN-6450. TestContainerManagerWithLCE requires override for each new test added to ContainerManagerTest? Contributed by Jason Lowe.
|
2017-04-12 10:20:08 -05:00 |
|