Varun Saxena
|
91d3443806
|
YARN-3359. Recover collector list when RM fails over (Li Lu via Varun Saxena)
|
2017-08-30 11:29:51 +05:30 |
|
Sangjin Lee
|
643a20a358
|
YARN-5265. Make HBase configuration for the timeline service configurable. Contributed by Joep Rottinghuis.
|
2017-08-30 11:29:51 +05:30 |
|
Sangjin Lee
|
05ff04439e
|
YARN-5715. Introduce entity prefix for return and sort order. Contributed by Rohith Sharma K S.
|
2017-08-30 11:29:51 +05:30 |
|
Varun Saxena
|
9bb5cc3d49
|
YARN-3649. Allow configurable prefix for hbase table names like prod, exp, test etc (Vrushali C via Varun Saxena)
|
2017-08-30 11:29:50 +05:30 |
|
Sangjin Lee
|
78b7e070d8
|
YARN-5638. Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery. Contributed by Li Lu.
|
2017-08-30 11:29:50 +05:30 |
|
Li Lu
|
e72e6260da
|
YARN-5229. Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl. (Vrushali C via gtcarrera9)
|
2017-08-30 11:29:50 +05:30 |
|
Sangjin Lee
|
278bd6fcff
|
YARN-5156. YARN_CONTAINER_FINISHED of YARN_CONTAINERs will always have running state (Vrushali C via sjlee)
|
2017-08-30 11:29:50 +05:30 |
|
Rohith Sharma K S
|
4cae120c61
|
YARN-6982. Potential issue on setting AMContainerSpec#tokenConf to null before app is completed. Contributed by Manikandan R.
|
2017-08-30 10:45:11 +05:30 |
|
Jian He
|
8201ed8009
|
YARN-6756. ContainerRequest#executionTypeRequest causes NPE. Contributed by Jian He
|
2017-08-29 20:35:53 -07:00 |
|
Wangda Tan
|
f59332b97b
|
YARN-5219. When an export var command fails in launch_container.sh, the full container launch should fail. (Sunil G via wangda)
Change-Id: Iaa6b978bb89482e9d1d77ba57f4adfdc48e39a3c
|
2017-08-29 15:29:22 -07:00 |
|
Junping Du
|
ad45d19998
|
YARN-7037. Optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices. Contributed by Tao Yang.
|
2017-08-29 15:16:23 -07:00 |
|
Carlo Curino
|
cc8893edc0
|
YARN-7010. Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps). (Contributed by Giovanni Matteo Fumarola via curino)
|
2017-08-29 14:53:09 -07:00 |
|
Jason Lowe
|
1f6dc4ee9a
|
YARN-5816. TestDelegationTokenRenewer#testCancelWithMultipleAppSubmissions is still flakey. Contributed by Robert Kanter
|
2017-08-29 09:52:24 -05:00 |
|
Sunil G
|
7ddc7aa26e
|
YARN-6386. Show decommissioning nodes in new YARN UI. Contributed by Elek Marton.
|
2017-08-29 16:51:14 +05:30 |
|
Junping Du
|
312b1fd9da
|
YARN-7076. yarn application -list -appTypes is not working. Contributed by Jian He.
|
2017-08-28 18:26:51 -07:00 |
|
Wangda Tan
|
51881a863c
|
YARN-7112. TestAMRMProxy is failing with invalid request. (Jason Lowe via wangda)
Change-Id: I432f4523921666ac218fcf9936f826a0d8d635e0
|
2017-08-28 11:37:35 -07:00 |
|
Yufei Gu
|
d5bc958279
|
YARN-7099. ResourceHandlerModule.parseConfiguredCGroupPath only works for privileged yarn users. (Contributed by Miklos Szegedi via Yufei Gu)
|
2017-08-28 10:09:46 -07:00 |
|
Sunil G
|
02599bda04
|
YARN-7051. Avoid concurrent modification exception in FifoIntraQueuePreemptionPlugin. Contributed by Eric Payne.
|
2017-08-28 12:22:56 +05:30 |
|
Li Lu
|
3bee7046c5
|
YARN-6999. Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster. (Linlin Zhou via gtcarrera9)
|
2017-08-25 22:43:25 -07:00 |
|
Eric Payne
|
e864f81471
|
YARN-7087. NM failed to perform log aggregation due to absent container. Contributed by Jason Lowe.
|
2017-08-25 15:37:54 -05:00 |
|
Jason Lowe
|
39a9dc8e4a
|
YARN-7052. RM SchedulingMonitor gives no indication why the spawned thread crashed. Contributed by Eric Payne
|
2017-08-25 15:31:29 -05:00 |
|
Arpit Agarwal
|
8b7cbe3840
|
HADOOP-14729. Upgrade JUnit 3 test cases to JUnit 4. Contributed by Ajay Kumar.
|
2017-08-25 09:55:46 -07:00 |
|
Jason Lowe
|
3a4e861169
|
YARN-6640. AM heartbeat stuck when responseId overflows MAX_INT. Contributed by Botong Huang
|
2017-08-25 09:16:17 -05:00 |
|
Yufei Gu
|
9e2699ac2c
|
YARN-7049. FSAppAttempt preemption related fields have confusing names. (Contributed by Karthik Kambatla via Yufei Gu)
|
2017-08-24 17:52:41 -07:00 |
|
Junping Du
|
c2cb7ea1ef
|
YARN-6876. Create an abstract log writer for extendability. Contributed by Xuan Gong.
|
2017-08-24 13:36:49 -07:00 |
|
bibinchundatt
|
de0cba700b
|
YARN-7074. Fix NM state store update comment. Contributed by Botong Huang
|
2017-08-24 16:34:38 +05:30 |
|
Junping Du
|
652dd434d9
|
YARN-7090. testRMRestartAfterNodeLabelDisabled get failed when CapacityScheduler is configured. Contributed by Wangda Tan.
|
2017-08-23 18:06:29 -07:00 |
|
Wangda Tan
|
f49843a988
|
YARN-6251. Do async container release to prevent deadlock during container updates. (Arun Suresh via wangda)
Change-Id: I6c67d20c5dd4d22752830ebf0ed2340824976ecb
|
2017-08-23 09:56:20 -07:00 |
|
Subru Krishnan
|
4249172e14
|
YARN-7053. Move curator transaction support to ZKCuratorManager. (Jonathan Hung via Subru).
|
2017-08-22 19:20:57 -07:00 |
|
Jason Lowe
|
657dd59cc8
|
YARN-7048. Fix tests faking kerberos to explicitly set ugi auth type. Contributed by Daryn Sharp
|
2017-08-22 13:16:24 -05:00 |
|
Jason Lowe
|
3efcd51c3b
|
YARN-2416. InvalidStateTransitonException in ResourceManager if AMLauncher does not receive response for startContainers() call in time. Contributed by Jonathan Eagles
|
2017-08-22 12:56:09 -05:00 |
|
Akira Ajisaka
|
d5ff57a08f
|
YARN-7047. Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager. Contributed by Yeliang Cang.
|
2017-08-22 17:14:12 +09:00 |
|
Arun Suresh
|
ae8fb13b31
|
YARN-6923. Metrics for Federation Router. (Giovanni Matteo Fumarola via asuresh)
|
2017-08-21 22:50:24 -07:00 |
|
Arun Suresh
|
75abc9a8e2
|
YARN-5603. Metrics for Federation StateStore. (Ellen Hui via asuresh)
|
2017-08-21 22:43:08 -07:00 |
|
Arun Suresh
|
7a82d7bcea
|
YARN-6979. [Addendum patch] Fixed classname and added javadocs. (Kartheek Muthyala via asuresh)
|
2017-08-20 10:24:05 -07:00 |
|
Arun Suresh
|
8410d862d3
|
YARN-6979. Add flag to notify all types of container updates to NM via NodeHeartbeatResponse. (Kartheek Muthyala via asuresh)
|
2017-08-20 07:54:09 -07:00 |
|
Wangda Tan
|
436c2638f9
|
YARN-6852. Native code changes to support isolate GPU devices by using CGroups. (wangda)
Change-Id: I4869cc4d8ad539539ccba4bea5a178cacdb741ab
|
2017-08-18 18:26:36 -07:00 |
|
Yufei Gu
|
8991f0baec
|
YARN-6969. Clean up unused code in class FairSchedulerQueueInfo. (Larry Lo via Yufei Gu)
|
2017-08-18 14:38:44 -07:00 |
|
bibinchundatt
|
e05fa3451d
|
YARN-7007. NPE in RM while using YarnClient.getApplications(). Contributed by Lingfeng Su.
|
2017-08-18 20:28:50 +05:30 |
|
Jason Lowe
|
ab1a8ae85f
|
YARN-6988. container-executor fails for docker when command length > 4096 B. Contributed by Eric Badger
|
2017-08-17 15:50:14 -05:00 |
|
Sunil G
|
f9a0e23381
|
YARN-3254. HealthReport should include disk full information. Contributed by Suma Shivaprasad.
|
2017-08-17 15:07:15 +05:30 |
|
Subru Krishnan
|
de462da04e
|
YARN-6900. ZooKeeper based implementation of the FederationStateStore. (Íñigo Goiri via Subru).
|
2017-08-16 11:43:24 -07:00 |
|
Jason Lowe
|
14553061be
|
YARN-7020. TestAMRMProxy#testAMRMProxyTokenRenewal is flakey. Contributed by Robert Kanter
|
2017-08-16 13:04:36 -05:00 |
|
Akira Ajisaka
|
588c190afd
|
YARN-6965. Duplicate instantiation in FairSchedulerQueueInfo. Contributed by Masahiro Tanaka.
|
2017-08-16 14:06:22 +09:00 |
|
Subru Krishnan
|
75dd866bfb
|
HADOOP-14773. Extend ZKCuratorManager API for more reusability. (Íñigo Goiri via Subru).
|
2017-08-15 16:53:59 -07:00 |
|
Nathan Roberts
|
d265459024
|
YARN-7014. Fix off-by-one error causing heap corruption (Jason Lowe via nroberts)
|
2017-08-15 15:52:48 -05:00 |
|
Sunil G
|
dadb0c2225
|
YARN-5146. Support for Fair Scheduler in new YARN UI. Contributed by Abdullah Yousufi.
|
2017-08-15 21:58:44 +05:30 |
|
Arun Suresh
|
4d7be1d857
|
YARN-5978. ContainerScheduler and ContainerManager changes to support ExecType update. (Kartheek Muthyala via asuresh)
|
2017-08-14 19:46:17 -07:00 |
|
Jason Lowe
|
5558792894
|
YARN-6917. Queue path is recomputed from scratch on every allocation. Contributed by Eric Payne
|
2017-08-14 15:31:34 -05:00 |
|
Jason Lowe
|
3325ef653d
|
YARN-6987. Log app attempt during InvalidStateTransition. Contributed by Jonathan Eagles
|
2017-08-14 14:40:08 -05:00 |
|
Daniel Templeton
|
6b09c32705
|
YARN-6881. LOG is unused in AllocationConfiguration (Contributed by weiyuan via Daniel Templeton)
|
2017-08-14 11:55:33 -07:00 |
|
Vrushali C
|
608a06cca5
|
YARN-6905 Multiple HBaseTimelineStorage test failures due to missing FastNumberFormat (Contributed by Haibo Chen)
|
2017-08-14 11:41:11 -07:00 |
|
Subru Krishnan
|
18f3603bce
|
YARN-6996. Change javax.cache library implementation from JSR107 to Apache Geronimo. (Ray Chiang via Subru).
|
2017-08-14 11:10:00 -07:00 |
|
Jian He
|
e2f6299f6f
|
YARN-6959. RM may allocate wrong AM Container for new attempt. Contributed by Yuqi Wang
|
2017-08-14 10:51:30 -07:00 |
|
Lei Xu
|
ce797a1706
|
HDFS-12221. Replace xcerces in XmlEditsVisitor. (Ajay Kumar via lei)
|
2017-08-14 10:27:47 -07:00 |
|
bibinchundatt
|
d8f74c3964
|
YARN-6741. Deleting all children of a Parent Queue on refresh throws exception. Contributed by Naganarasimha G R.
|
2017-08-14 09:39:00 +05:30 |
|
Carlo Curino
|
28d97b79b6
|
YARN-6687. Validate that the duration of the periodic reservation is less than the periodicity. (subru via curino)
|
2017-08-11 16:58:04 -07:00 |
|
Carlo Curino
|
cc59b5fb26
|
YARN-6896. Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution). (Contributed by Giovanni Matteo Fumarola via curino)
|
2017-08-11 15:58:01 -07:00 |
|
Daniel Templeton
|
0996acde6c
|
YARN-6882. AllocationFileLoaderService.reloadAllocations() should use the diamond operator
(Contributed by Larry Lo via Daniel Templeton)
|
2017-08-11 14:50:46 -07:00 |
|
Daniel Templeton
|
65364defb4
|
YARN-6967. Limit application attempt's diagnostic message size thoroughly
(Contributed by Chengbing Liu via Daniel Templeton)
|
2017-08-11 14:28:55 -07:00 |
|
Daniel Templeton
|
c7680d4cc4
|
YARN-6884. AllocationFileLoaderService.loadQueue() has an if without braces
(Contributed by weiyuan via Daniel Templeton)
|
2017-08-11 14:22:02 -07:00 |
|
Daniel Templeton
|
218588be77
|
YARN-6952. Enable scheduling monitor in FS (Contributed by Yufei Gu via Daniel Templeton)
|
2017-08-11 14:04:19 -07:00 |
|
Subru Krishnan
|
bbbf0e2a41
|
HADOOP-14741. Refactor curator based ZooKeeper communication into common library. (Íñigo Goiri via Subru).
|
2017-08-11 13:58:45 -07:00 |
|
Karthik Kambatla
|
8c4b6d16a5
|
YARN-5927. BaseContainerManagerTest::waitForNMContainerState timeout accounting is not accurate. (Kai Sasaki via kasha)
|
2017-08-11 12:15:43 -07:00 |
|
Sunil G
|
8d953c2359
|
YARN-6631. Refactor loader.js in new Yarn UI. Contributed by Akhil P B.
|
2017-08-10 11:53:26 +05:30 |
|
Wangda Tan
|
ec694145cf
|
YARN-6033. Add support for sections in container-executor configuration file. (Varun Vasudev via wandga)
Change-Id: Ibc6d2a959debe5d8ff2b51504149742449d1f1da
|
2017-08-09 10:51:29 -07:00 |
|
Akira Ajisaka
|
63cfcb90ac
|
YARN-6958. Moving logging APIs over to slf4j in hadoop-yarn-server-timelineservice. Contributed by Yeliang Cang.
|
2017-08-09 23:58:22 +09:00 |
|
Akira Ajisaka
|
1a18d5e514
|
YARN-6515. Fix warnings from Spotbugs in hadoop-yarn-server-nodemanager. Contributed by Naganarasimha G R.
|
2017-08-09 21:56:43 +09:00 |
|
Subru Krishnan
|
ad2a350662
|
YARN-6970. Add PoolInitializationException as retriable exception in FederationFacade. (Giovanni Matteo Fumarola via Subru).
|
2017-08-08 16:48:29 -07:00 |
|
Daniel Templeton
|
e0c24145d2
|
YARN-6879. TestLeafQueue.testDRFUserLimits() has commented out code
(Contributed by Angela Wang via Daniel Templeton)
|
2017-08-08 13:35:22 -07:00 |
|
Wangda Tan
|
1794de3ea4
|
YARN-6726. Fix issues with docker commands executed by container-executor. (Shane Kumpf via wangda)
Change-Id: If1b1827345f98f0a49cc7e39d1ba41fbeed5e911
|
2017-08-08 12:56:29 -07:00 |
|
Jian He
|
acf9bd8b1d
|
YARN-6890. Not display killApp button on UI if UI is unsecured but cluster is secured. Contributed by Junping Du
|
2017-08-08 11:09:38 -07:00 |
|
Daniel Templeton
|
47b145b9b4
|
YARN-6757. Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path
(Contributed by Miklos Szegedi via Daniel Templeton)
|
2017-08-08 10:33:26 -07:00 |
|
Akira Ajisaka
|
98912950b6
|
YARN-6961. Remove commons-logging dependency from hadoop-yarn-server-applicationhistoryservice module. Contributed by Yeliang Cang.
|
2017-08-08 19:38:58 +09:00 |
|
Arun Suresh
|
8d3fd81980
|
YARN-6920. Fix resource leak that happens during container re-initialization. (asuresh)
|
2017-08-07 18:59:25 -07:00 |
|
Subru Krishnan
|
c61f2c4198
|
YARN-6955. Handle concurrent register AM requests in FederationInterceptor. (Botong Huang via Subru).
|
2017-08-07 16:58:29 -07:00 |
|
Wangda Tan
|
adb84f34db
|
YARN-4161. Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration. (Wei Yan via wangda)
Change-Id: Ic441ae4e0bf72e7232411eb54243ec143d5fd0d3
|
2017-08-07 11:32:21 -07:00 |
|
Akira Ajisaka
|
b0fbf17965
|
YARN-6957. Moving logging APIs over to slf4j in hadoop-yarn-server-sharedcachemanager. Contributed by Yeliang Cang.
|
2017-08-07 19:25:40 +09:00 |
|
Akira Ajisaka
|
839e077faf
|
YARN-6873. Moving logging APIs over to slf4j in hadoop-yarn-server-applicationhistoryservice. Contributed by Yeliang Cang.
|
2017-08-07 18:56:00 +09:00 |
|
Sunil G
|
46b7054fa7
|
YARN-6951. Fix debug log when Resource Handler chain is enabled. Contributed by Yang Wang.
|
2017-08-07 13:15:46 +05:30 |
|
Junping Du
|
f44b349b81
|
YARN-6811. [ATS1.5] All history logs should be kept under its own User Directory. Contributed by Rohith Sharma K S.
|
2017-08-04 16:03:56 -07:00 |
|
Arun Suresh
|
35dc782923
|
YARN-5977. ContainerManagementProtocol changes to support change of container ExecutionType. (Kartheek Muthyala via asuresh)
|
2017-08-03 21:15:40 -07:00 |
|
Subru Krishnan
|
0542e6f86e
|
YARN-6932. Fix TestFederationRMFailoverProxyProvider test case failure.
|
2017-08-03 14:18:03 -07:00 |
|
Yufei Gu
|
c617fe02b3
|
YARN-6832. Tests use assertTrue(....equals(...)) instead of assertEquals()). (Daniel Templeton via Yufei Gu)
|
2017-08-03 11:33:37 -07:00 |
|
Haibo Chen
|
293c74a81b
|
YARN-6673 Add cpu cgroup configurations for opportunistic containers. (Miklos Szegedi via Haibo Chen)
|
2017-08-03 09:56:51 -07:00 |
|
Haibo Chen
|
c5d256c760
|
YARN-6674 Add memory cgroup settings for opportunistic containers. (Miklos Szegedi via Haibo Chen)
|
2017-08-03 09:52:35 -07:00 |
|
Sunil G
|
f64cfeaf61
|
YARN-6678. Handle IllegalStateException in Async Scheduling mode of CapacityScheduler. Contributed by Tao Yang.
|
2017-08-03 19:27:10 +05:30 |
|
Sean Mackrory
|
1a1bf6b7d0
|
HADOOP-13595. Rework hadoop_usage to be broken up by clients/daemons/etc. Contributed by Allen Wittenauer.
|
2017-08-02 12:25:05 -06:00 |
|
Eric Payne
|
8ce8672b6b
|
YARN-5349. TestWorkPreservingRMRestart#testUAMRecoveryOnRMWorkPreservingRestart fail intermittently. Contributed by Jason Lowe.
|
2017-08-02 12:53:22 -05:00 |
|
Yufei Gu
|
45535f8afa
|
YARN-6895. [FairScheduler] Preemption reservation may cause regular reservation leaks. (Miklos Szegedi via Yufei Gu)
|
2017-08-02 09:25:19 -07:00 |
|
Eric Payne
|
48899134d2
|
YARN-6846. Nodemanager can fail to fully delete application local directories when applications are killed. Contributed by Jason Lowe.
|
2017-08-02 10:59:33 -05:00 |
|
Jian He
|
f9139ac8f6
|
YARN-6872. [Addendum patch] Ensure apps could run given NodeLabels are disabled post RM switchover/restart. Contributed by Sunil G
|
2017-08-02 00:03:25 -07:00 |
|
Carlo Curino
|
9625a030de
|
YARN-6853. Add MySql Scripts for FederationStateStore. (Contributed by Giovanni Matteo Fumarola via curino)
(cherry picked from commit 874ddbf0b5b1d34aca70ee7fc303cbffdde67236)
|
2017-08-01 17:28:28 -07:00 |
|
Carlo Curino
|
acda6b96a4
|
YARN-5412. Create a proxy chain for ResourceManager REST API in the Router. (Contributed by Giovanni Matteo Fumarola via curino)
(cherry picked from commit b6240b92abf453affc5fd64e1eedf2d29842aa75)
|
2017-08-01 17:28:28 -07:00 |
|
Subru Krishnan
|
86f05c3312
|
YARN-6866. Minor clean-up and fixes in anticipation of YARN-2915 merge with trunk. (Botong Huang via Subru).
(cherry picked from commit 40453879ec860819b080ccc82454480a436c0adc)
|
2017-08-01 17:28:28 -07:00 |
|
Subru Krishnan
|
8737c2a8e9
|
Bumping up hadoop-yarn-server-router module to 3.0.0-beta1 post rebase.
(cherry picked from commit 69e3ed26809e12dd62cb66d258ef51c66db3be0a)
|
2017-08-01 17:28:27 -07:00 |
|
Subru Krishnan
|
712e97d4cf
|
Bumping up yarn-server-router (new) module pom to beta1 and fixing imports post rebase.
(cherry picked from commit f1eff212c5f13c62e8fc45b0af794b5bbeb577da)
|
2017-08-01 17:28:27 -07:00 |
|
Subru Krishnan
|
3e1dc7ece0
|
YARN-6821. Move FederationStateStore SQL DDL files from test resource to sbin.
(cherry picked from commit cd9db822f0c1efc52005b1c069d52910d88038d9)
|
2017-08-01 17:28:27 -07:00 |
|
Subru Krishnan
|
825108d08a
|
YARN-6815. FederationStateStoreFacade return behavior should be consistent irrespective of whether caching is enabled or not.
(cherry picked from commit 8820693cd769065eed83193b673ec5d919d69500)
|
2017-08-01 17:28:27 -07:00 |
|
Subru Krishnan
|
f427e4201f
|
YARN-6807. Adding required missing configs to Federation configuration guide based on e2e testing. (Tanuj Nayak via Subru).
(cherry picked from commit b4ac9d1b63dd4031eee8b17d2462087721050b9a)
|
2017-08-01 17:28:26 -07:00 |
|