Chris Douglas
|
12e44e7bda
|
HDFS-6984. Serialize FileStatus via protobuf.
|
2017-08-02 12:12:48 -07:00 |
|
Sean Mackrory
|
1a1bf6b7d0
|
HADOOP-13595. Rework hadoop_usage to be broken up by clients/daemons/etc. Contributed by Allen Wittenauer.
|
2017-08-02 12:25:05 -06:00 |
|
Eric Payne
|
8ce8672b6b
|
YARN-5349. TestWorkPreservingRMRestart#testUAMRecoveryOnRMWorkPreservingRestart fail intermittently. Contributed by Jason Lowe.
|
2017-08-02 12:53:22 -05:00 |
|
Yufei Gu
|
45535f8afa
|
YARN-6895. [FairScheduler] Preemption reservation may cause regular reservation leaks. (Miklos Szegedi via Yufei Gu)
|
2017-08-02 09:25:19 -07:00 |
|
Eric Payne
|
48899134d2
|
YARN-6846. Nodemanager can fail to fully delete application local directories when applications are killed. Contributed by Jason Lowe.
|
2017-08-02 10:59:33 -05:00 |
|
Steve Loughran
|
5e4434f628
|
HADOOP-14709. Fix checkstyle warnings in ContractTestUtils.
Contributed by Thomas Marquardt.
(cherry picked from commit cb4679261097e729b433a523e3a65779fdc83841)
|
2017-08-02 12:48:06 +01:00 |
|
Jian He
|
f9139ac8f6
|
YARN-6872. [Addendum patch] Ensure apps could run given NodeLabels are disabled post RM switchover/restart. Contributed by Sunil G
|
2017-08-02 00:03:25 -07:00 |
|
Masatake Iwasaki
|
3a0b84d9c9
|
HADOOP-14702. Fix formatting issue and regression caused by conversion from APT to Markdown. Contributed by Doris Gu.
|
2017-08-02 06:06:25 +00:00 |
|
Haohui Mai
|
6814324c33
|
HDFS-12107. FsDatasetImpl#removeVolumes floods the logs when removing the volume. Contributed by Kelvin Chu.
|
2017-08-01 18:34:07 -07:00 |
|
Carlo Curino
|
9625a030de
|
YARN-6853. Add MySql Scripts for FederationStateStore. (Contributed by Giovanni Matteo Fumarola via curino)
(cherry picked from commit 874ddbf0b5b1d34aca70ee7fc303cbffdde67236)
|
2017-08-01 17:28:28 -07:00 |
|
Subru Krishnan
|
894ff83dd6
|
YARN-6902. Update Microsoft JDBC Driver for SQL Server version in License.txt. (Botong Huang via Subru).
(cherry picked from commit c581e9438444966345613cb6e0585482936a783a)
|
2017-08-01 17:28:28 -07:00 |
|
Carlo Curino
|
acda6b96a4
|
YARN-5412. Create a proxy chain for ResourceManager REST API in the Router. (Contributed by Giovanni Matteo Fumarola via curino)
(cherry picked from commit b6240b92abf453affc5fd64e1eedf2d29842aa75)
|
2017-08-01 17:28:28 -07:00 |
|
Subru Krishnan
|
86f05c3312
|
YARN-6866. Minor clean-up and fixes in anticipation of YARN-2915 merge with trunk. (Botong Huang via Subru).
(cherry picked from commit 40453879ec860819b080ccc82454480a436c0adc)
|
2017-08-01 17:28:28 -07:00 |
|
Subru Krishnan
|
8737c2a8e9
|
Bumping up hadoop-yarn-server-router module to 3.0.0-beta1 post rebase.
(cherry picked from commit 69e3ed26809e12dd62cb66d258ef51c66db3be0a)
|
2017-08-01 17:28:27 -07:00 |
|
Subru Krishnan
|
712e97d4cf
|
Bumping up yarn-server-router (new) module pom to beta1 and fixing imports post rebase.
(cherry picked from commit f1eff212c5f13c62e8fc45b0af794b5bbeb577da)
|
2017-08-01 17:28:27 -07:00 |
|
Subru Krishnan
|
3e1dc7ece0
|
YARN-6821. Move FederationStateStore SQL DDL files from test resource to sbin.
(cherry picked from commit cd9db822f0c1efc52005b1c069d52910d88038d9)
|
2017-08-01 17:28:27 -07:00 |
|
Subru Krishnan
|
825108d08a
|
YARN-6815. FederationStateStoreFacade return behavior should be consistent irrespective of whether caching is enabled or not.
(cherry picked from commit 8820693cd769065eed83193b673ec5d919d69500)
|
2017-08-01 17:28:27 -07:00 |
|
Subru Krishnan
|
f427e4201f
|
YARN-6807. Adding required missing configs to Federation configuration guide based on e2e testing. (Tanuj Nayak via Subru).
(cherry picked from commit b4ac9d1b63dd4031eee8b17d2462087721050b9a)
|
2017-08-01 17:28:26 -07:00 |
|
Subru Krishnan
|
43a97174fe
|
YARN-3659. Federation: routing client invocations transparently to multiple RMs. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 52daa6d971ae408d121b3737ea8c0575e7e8516d)
|
2017-08-01 17:28:26 -07:00 |
|
Subru Krishnan
|
4cfec943b1
|
YARN-6724. Add ability to blacklist sub-clusters when invoking Routing policies. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit f8e5de59697cb78686f0e605dc7e93628b5f3297)
|
2017-08-01 17:28:26 -07:00 |
|
Arun Suresh
|
433ee44b58
|
YARN-6691. Update YARN daemon startup/shutdown scripts to include Router service. (Giovanni Matteo Fumarola via asuresh).
(cherry picked from commit 790cba7ab949c665083c4a9702bb1cd4b7824e8d)
|
2017-08-01 17:28:26 -07:00 |
|
Subru Krishnan
|
70b1a757f1
|
YARN-6511. Federation: transparently spanning application across multiple sub-clusters. (Botong Huang via Subru).
(cherry picked from commit 8c988d235eaf0972783985b1ab24680d029aea79)
|
2017-08-01 17:28:26 -07:00 |
|
Subru Krishnan
|
bed1832c93
|
YARN-3666. Federation Intercepting and propagating AM- home RM communications. (Botong Huang via Subru).
(cherry picked from commit 2399eb8200609246cb623c74450ca4a2032063cc)
|
2017-08-01 17:28:25 -07:00 |
|
Subru Krishnan
|
d6c29b2f5b
|
YARN-6484. Documenting the YARN Federation feature. (Carlo Curino via Subru).
(cherry picked from commit 749ca890e6e62671b4df69d020396ec93edadf16)
|
2017-08-01 17:28:25 -07:00 |
|
Subru Krishnan
|
42949a6e01
|
YARN-6666. Fix unit test failure in TestRouterClientRMService. (Botong Huang via Subru).
(cherry picked from commit e750907d0a7e2fb4b33a7c876eaa4d9122a1deea)
|
2017-08-01 17:28:25 -07:00 |
|
Subru Krishnan
|
f317e0cb48
|
Bumping up hadoop-yarn-server-router module to 3.0.0-alpha4 post rebase.
(cherry picked from commit bd9c7b1bec3293fe338553c0d5c3612e6176fb26)
|
2017-08-01 17:28:25 -07:00 |
|
Subru Krishnan
|
859aa1f9d6
|
YARN-5531. UnmanagedAM pool manager for federating application across clusters. (Botong Huang via Subru).
(cherry picked from commit 73bb2102ce4b82b3a3bed91319f7c8f067ddc3e8)
|
2017-08-01 17:28:24 -07:00 |
|
Subru Krishnan
|
7444406d6d
|
YARN-5413. Create a proxy chain for ResourceManager Admin API in the Router. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 67846a5519b5905c2d925cf4c602f715b653e72c)
|
2017-08-01 17:28:24 -07:00 |
|
Subru Krishnan
|
80e1904000
|
YARN-5411. Create a proxy chain for ApplicationClientProtocol in the Router. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 4846069061b6baa06da3b524b9e36567dd368388)
|
2017-08-01 17:28:24 -07:00 |
|
Carlo Curino
|
5272af8c7e
|
YARN-3663. Federation State and Policy Store (DBMS implementation). (Giovanni Matteo Fumarola via curino).
(cherry picked from commit be99c1fe2eb150fabd69902118d65941f82971f6)
|
2017-08-01 17:28:24 -07:00 |
|
Carlo Curino
|
c4bbdfeb66
|
YARN-6203: Occasional test failure in TestWeightedRandomRouterPolicy (curino)
(cherry picked from commit 121d55bd29ac44289afad9a15e8737397ede298b)
|
2017-08-01 17:28:23 -07:00 |
|
Subru Krishnan
|
e1da8f0667
|
YARN-5602. Utils for Federation State and Policy Store. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 326a2e6bde1cf266ecc7d3b513cdaac6abcebbe4)
|
2017-08-01 17:28:23 -07:00 |
|
Carlo Curino
|
1c64e1709b
|
YARN-6370. Properly handle rack requests for non-active subclusters in LocalityMulticastAMRMProxyPolicy. (Contributed by Botong Huang via curino).
(cherry picked from commit ce419881c32b178c48c3a01b5a15e4e3a3e750f5)
|
2017-08-01 17:28:23 -07:00 |
|
Subru Krishnan
|
86b2bec56e
|
YARN-6247. Share a single instance of SubClusterResolver instead of instantiating one per AM. (Botong Huang via Subru)
(cherry picked from commit 51aeb2ce0c599176aca9466a939c3ad55df30036)
|
2017-08-01 17:28:23 -07:00 |
|
Carlo Curino
|
8623644f45
|
YARN-6190. Validation and synchronization fixes in LocalityMulticastAMRMProxyPolicy. (Botong Huang via curino)
(cherry picked from commit 5c486961cd3a175b122ef86275c99b72964f2c50)
|
2017-08-01 17:28:22 -07:00 |
|
Subru Krishnan
|
193ec456d6
|
YARN-5410. Bootstrap Router server module. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 04f111394b08de7d16a86f8025221f6f5e0dbcc5)
|
2017-08-01 17:28:22 -07:00 |
|
Subru Krishnan
|
98b45b0ed3
|
YARN-6093. Minor bugs with AMRMtoken renewal and state store availability when using FederationRMFailoverProxyProvider during RM failover. (Botong Huang via Subru).
(cherry picked from commit 66500f4fa6155d29435d7c92fd6d68079c4cab86)
|
2017-08-01 17:28:22 -07:00 |
|
Subru Krishnan
|
91803305e5
|
YARN-5872. Add AlwayReject policies for router and amrmproxy. (Carlo Curino via Subru).
(cherry picked from commit db26bade059ff9b38da0aa160f56653769bd0143)
|
2017-08-01 17:28:22 -07:00 |
|
Subru Krishnan
|
78032e51d9
|
YARN-5905. Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP.
(cherry picked from commit e0f0e7afed51aac4ac9093ac362f6ce64601884d)
|
2017-08-01 17:28:22 -07:00 |
|
Subru Krishnan
|
4128c9522d
|
YARN-5676. Add a HashBasedRouterPolicy, and small policies and test refactoring. (Carlo Curino via Subru).
(cherry picked from commit 575137f41c27eb72d05d923337f3030a35403e8f)
|
2017-08-01 17:28:21 -07:00 |
|
Subru Krishnan
|
083a05bc14
|
YARN-5634. Simplify initialization/use of RouterPolicy via a RouterPolicyFacade. (Carlo Curino via Subru).
(cherry picked from commit d7672ce2bddb40fbaa77d3f6fec8c99f5589177f)
|
2017-08-01 17:28:21 -07:00 |
|
Subru Krishnan
|
93d9fdeca6
|
YARN-5391. PolicyManager to tie together Router/AMRM Federation policies. (Carlo Curino via Subru).
(cherry picked from commit 20893682eced98dfba55d88edd63296993087c85)
|
2017-08-01 17:28:21 -07:00 |
|
Subru Krishnan
|
1dadd0b45a
|
YARN-5325. Stateless ARMRMProxy policies implementation. (Carlo Curino via Subru).
(cherry picked from commit 11c5336522d3504598fb94eee288d54df73418c6)
|
2017-08-01 17:28:21 -07:00 |
|
Subru Krishnan
|
0662996b6a
|
YARN-5324. Stateless Federation router policies implementation. (Carlo Curino via Subru).
(cherry picked from commit 1298127bdad60a961441dc7e25cdc2553c119f33)
|
2017-08-01 17:28:21 -07:00 |
|
Subru Krishnan
|
81472778d7
|
YARN-5323. Policies APIs for Federation Router and AMRMProxy policies. (Carlo Curino via Subru).
(cherry picked from commit f8208fe0b536f29aa65af71d20c3b3e3765679fd)
|
2017-08-01 17:28:20 -07:00 |
|
Jian He
|
2797507d51
|
YARN-5601. Make the RM epoch base value configurable. Contributed by Subru Krishnan
(cherry picked from commit 9ca2aba9cc65090162b3517b194b5e655ee4a157)
|
2017-08-01 17:28:20 -07:00 |
|
Subru Krishnan
|
1882bc10fb
|
YARN-5612. Return SubClusterId in FederationStateStoreFacade#addApplicationHomeSubCluster for Router Failover. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit ac1ba2a30427263f4a2eed2018515b2f759fa591)
|
2017-08-01 17:28:20 -07:00 |
|
Jian He
|
94a24567d6
|
YARN-3671. Integrate Federation services with ResourceManager. Contributed by Subru Krishnan
(cherry picked from commit 8573c286e27623155c715a632d56a68f23523c72)
|
2017-08-01 17:28:20 -07:00 |
|
Jian He
|
bdfad4523f
|
YARN-3673. Create a FailoverProxy for Federation services. Contributed by Subru Krishnan
(cherry picked from commit 3307564a5f8c8abc5fe84efcd05ee0f7dfdd921c)
|
2017-08-01 17:28:20 -07:00 |
|
Subru Krishnan
|
cfafd173bd
|
YARN-5467. InputValidator for the FederationStateStore internal APIs. (Giovanni Matteo Fumarola via Subru)
(cherry picked from commit bd44182e70c273ad3371a6f9b458fe0f8a7a6abc)
|
2017-08-01 17:28:19 -07:00 |
|