Sunil G
a0030c8c6f
YARN-6610. [YARN-3926] DominantResourceCalculator#getResourceAsValue dominant param is updated to handle multiple resources. Contributed by Daniel Templeton.
2017-09-12 09:19:12 -07:00
Sunil G
2b51b262ab
YARN-6892. [YARN-3926] Improve API implementation in Resources and DominantResourceCalculator class. Contributed by Sunil G.
2017-09-12 09:19:12 -07:00
Yufei Gu
d5e9939ebb
YARN-6994. [YARN-3926] Remove last uses of Long from resource types code. (Daniel Templeton via Yufei Gu)
2017-09-12 09:19:11 -07:00
Daniel Templeton
3aeaafecb8
YARN-6788. [YARN-3926] Improve performance of resource profile branch
...
(Contributed by Sunil Govindan via Daniel Templeton)
2017-09-12 09:19:11 -07:00
Sunil G
4e5632d28e
YARN-6786. [YARN-3926] ResourcePBImpl imports cleanup. Contributed by Yeliang Cang.
2017-09-12 09:19:11 -07:00
Sunil G
ca2808d8bb
YARN-6761. Fix build for YARN-3926 branch. Contributed by Varun Vasudev.
2017-09-12 09:19:11 -07:00
Sunil G
58da54640e
YARN-6445. [YARN-3926] Performance improvements in resource profile branch with respect to SLS. Contributed by Varun Vasudev.
2017-09-12 09:19:11 -07:00
Sunil G
dae65f3bef
YARN-6232. Update resource usage and preempted resource calculations to take into account all resource types. Contributed by Varun Vasudev.
2017-09-12 09:19:11 -07:00
Arun Suresh
6708ac3301
YARN-5587. Add support for resource profiles. (vvasudev via asuresh)
2017-09-12 09:19:10 -07:00
Varun Vasudev
c2032e251e
YARN-5708. Implement APIs to get resource profiles from the RM. Contributed by Varun Vasudev.
2017-09-12 09:19:10 -07:00
Varun Vasudev
a9b4426302
YARN-5707. Add manager class for resource profiles. Contributed by Varun Vasudev.
2017-09-12 09:19:10 -07:00
Rohith Sharma K S
239c1824a0
YARN-5586. Update the Resources class to consider all resource types. Contributed by Varun Vasudev.
2017-09-12 09:19:10 -07:00
Rohith Sharma K S
9e4ba6aff5
YARN-5242. Update DominantResourceCalculator to consider all resource types in calculations. Contributed by Varun Vasudev.
2017-09-12 09:19:10 -07:00
Varun Vasudev
759114b006
YARN-4830. Add support for resource types in the nodemanager. Contributed by Varun Vasudev.
2017-09-12 09:19:10 -07:00
Arun Suresh
7ba698997b
YARN-4829. Add support for binary units in Resource class.(vvasudev via asuresh)
2017-09-12 09:19:10 -07:00
Varun Vasudev
ceb12c59a3
YARN-4715. Add support to read resource types from a config file. Contributed by Varun Vasudev.
2017-09-12 09:19:10 -07:00
Wangda Tan
32c91223f1
YARN-4172. Extend DominantResourceCalculator to account for all resources. (Varun Vasudev via wangda)
2017-09-12 09:19:09 -07:00
Wangda Tan
1bbab7c157
YARN-4081. Add support for multiple resource types in the Resource class. (Varun Vasudev via wangda)
2017-09-12 09:19:09 -07:00
Junping Du
3fddabc2fe
YARN-7072. Add a new log aggregation file format controller. Contributed by Xuan Gong.
2017-09-08 15:16:19 -07:00
Sunil G
56d93d2e39
YARN-6600. Introduce default and max lifetime of application at LeafQueue level. Contributed by Rohith Sharma K S.
2017-09-08 07:15:17 +05:30
Jason Lowe
b0b535d9d5
YARN-6930. Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager. Contributed by Shane Kumpf
2017-09-07 16:17:03 -05:00
Junping Du
22de9449f8
YARN-7144. Log Aggregation controller should not swallow the exceptions when it calls closeWriter and closeReader. Contributed by Xuan Gong.
2017-09-06 14:53:31 -07:00
Junping Du
63231a2a30
YARN-7148. TestLogsCLI fails in trunk and branch-2 and javadoc error. Contributed by Xuan Gong.
2017-09-06 13:19:34 -07:00
Andrew Wang
0d419c984f
Preparing for 3.1.0 development
2017-09-01 11:53:48 -07:00
Junping Du
91cc070d67
YARN-6877. Create an abstract log reader for extendability. Contributed by Xuan Gong.
2017-08-31 16:41:43 -07:00
Daniel Templeton
cc23514aba
YARN-7115. Move BoundedAppender to org.hadoop.yarn.util pacakge
...
(Contributed by Jian He via Daniel Templeton)
2017-08-30 17:26:13 -07:00
Varun Saxena
3d00c8f394
Made fixes for whitespace errors and checstyle warnings before merge.
2017-08-30 11:29:54 +05:30
Varun Saxena
16ba4f544f
MAPREDUCE-6838. Addendum to fix code comment
2017-08-30 11:29:54 +05:30
Jian He
08f40bcc7f
MAPREDUCE-6838. [ATSv2 Security] Add timeline delegation token received in allocate response to UGI. Contributed by Varun Saxena
2017-08-30 11:29:54 +05:30
Rohith Sharma K S
e276c75ec1
YARN-7041. Nodemanager NPE running jobs with security off. Contributed by Varun Saxena.
2017-08-30 11:29:54 +05:30
Rohith Sharma K S
7594d1de7b
YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena.
2017-08-30 11:29:53 +05:30
Jian He
ac7f52df83
YARN-5648. [ATSv2 Security] Client side changes for authentication. Contributed by Varun Saxena
2017-08-30 11:29:53 +05:30
Varun Saxena
ff43b8db7a
YARN-6069. CORS support in timeline v2 (Rohith Sharma K S via Varun Saxena)
2017-08-30 11:29:52 +05:30
Sangjin Lee
580d884913
YARN-6094. Update the coprocessor to be a dynamically loaded one. Contributed by Vrushali C.
2017-08-30 11:29:52 +05:30
Sangjin Lee
643a20a358
YARN-5265. Make HBase configuration for the timeline service configurable. Contributed by Joep Rottinghuis.
2017-08-30 11:29:51 +05:30
Varun Saxena
9bb5cc3d49
YARN-3649. Allow configurable prefix for hbase table names like prod, exp, test etc (Vrushali C via Varun Saxena)
2017-08-30 11:29:50 +05:30
Junping Du
ad45d19998
YARN-7037. Optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices. Contributed by Tao Yang.
2017-08-29 15:16:23 -07:00
Junping Du
c2cb7ea1ef
YARN-6876. Create an abstract log writer for extendability. Contributed by Xuan Gong.
2017-08-24 13:36:49 -07:00
Arun Suresh
8410d862d3
YARN-6979. Add flag to notify all types of container updates to NM via NodeHeartbeatResponse. (Kartheek Muthyala via asuresh)
2017-08-20 07:54:09 -07:00
Subru Krishnan
bbbf0e2a41
HADOOP-14741. Refactor curator based ZooKeeper communication into common library. (Íñigo Goiri via Subru).
2017-08-11 13:58:45 -07:00
Daniel Templeton
47b145b9b4
YARN-6757. Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path
...
(Contributed by Miklos Szegedi via Daniel Templeton)
2017-08-08 10:33:26 -07:00
Junping Du
f44b349b81
YARN-6811. [ATS1.5] All history logs should be kept under its own User Directory. Contributed by Rohith Sharma K S.
2017-08-04 16:03:56 -07:00
Arun Suresh
35dc782923
YARN-5977. ContainerManagementProtocol changes to support change of container ExecutionType. (Kartheek Muthyala via asuresh)
2017-08-03 21:15:40 -07:00
Yufei Gu
c617fe02b3
YARN-6832. Tests use assertTrue(....equals(...)) instead of assertEquals()). (Daniel Templeton via Yufei Gu)
2017-08-03 11:33:37 -07:00
Carlo Curino
acda6b96a4
YARN-5412. Create a proxy chain for ResourceManager REST API in the Router. (Contributed by Giovanni Matteo Fumarola via curino)
...
(cherry picked from commit b6240b92abf453affc5fd64e1eedf2d29842aa75)
2017-08-01 17:28:28 -07:00
Subru Krishnan
43a97174fe
YARN-3659. Federation: routing client invocations transparently to multiple RMs. (Giovanni Matteo Fumarola via Subru).
...
(cherry picked from commit 52daa6d971ae408d121b3737ea8c0575e7e8516d)
2017-08-01 17:28:26 -07:00
Subru Krishnan
859aa1f9d6
YARN-5531. UnmanagedAM pool manager for federating application across clusters. (Botong Huang via Subru).
...
(cherry picked from commit 73bb2102ce4b82b3a3bed91319f7c8f067ddc3e8)
2017-08-01 17:28:24 -07:00
Subru Krishnan
7444406d6d
YARN-5413. Create a proxy chain for ResourceManager Admin API in the Router. (Giovanni Matteo Fumarola via Subru).
...
(cherry picked from commit 67846a5519b5905c2d925cf4c602f715b653e72c)
2017-08-01 17:28:24 -07:00
Subru Krishnan
80e1904000
YARN-5411. Create a proxy chain for ApplicationClientProtocol in the Router. (Giovanni Matteo Fumarola via Subru).
...
(cherry picked from commit 4846069061b6baa06da3b524b9e36567dd368388)
2017-08-01 17:28:24 -07:00
Subru Krishnan
86b2bec56e
YARN-6247. Share a single instance of SubClusterResolver instead of instantiating one per AM. (Botong Huang via Subru)
...
(cherry picked from commit 51aeb2ce0c599176aca9466a939c3ad55df30036)
2017-08-01 17:28:23 -07:00
Jian He
bdfad4523f
YARN-3673. Create a FailoverProxy for Federation services. Contributed by Subru Krishnan
...
(cherry picked from commit 3307564a5f8c8abc5fe84efcd05ee0f7dfdd921c)
2017-08-01 17:28:20 -07:00
Jian He
5c84382397
YARN-3672. Create Facade for Federation State and Policy Store. Contributed by Subru Krishnan
...
(cherry picked from commit 5e976cd2b90ccf1bccb6039edf14140677804c4e)
2017-08-01 17:28:19 -07:00
Subru Krishnan
d19b677301
YARN-5390. Federation Subcluster Resolver. Contributed by Ellen Hui.
...
(cherry picked from commit d3dc461a935c2af4ec3f0312ff0c26918c408467)
2017-08-01 17:28:18 -07:00
Akira Ajisaka
38c6fa5c7a
HADOOP-11875. [JDK9] Adding a second copy of Hamlet without _ as a one-character identifier.
2017-07-28 09:10:52 +09:00
Jason Lowe
c8df3668ec
YARN-6837. Null LocalResource visibility or resource type can crash the nodemanager. Contributed by Jinjiang Ling
2017-07-20 11:03:04 -05:00
Arun Suresh
077fcf6a96
YARN-6777. Support for ApplicationMasterService processing chain of interceptors. (asuresh)
2017-07-19 12:26:40 -07:00
Xuan
9845bea59c
YARN-6689. PlacementRule should be configurable. (Jonathan Hung via xgong)
2017-07-12 15:40:45 -07:00
Jason Lowe
655110393b
YARN-6797. TimelineWriter does not fully consume the POST response. Contributed by Jason Lowe
2017-07-12 15:52:56 -05:00
Naganarasimha
626d730bfc
YARN-6428. Queue AM limit is not honored in CS always. Contributed by Bibin A Chundatt.
2017-07-09 17:26:09 +05:30
Xuan
3be2659f83
YARN-6694. Add certain envs to the default yarn.nodemanager.env-whitelist. Contributed by Jian He
2017-06-29 20:10:35 -07:00
Andrew Wang
af2773f609
Updating version for 3.0.0-beta1 development
2017-06-29 17:57:40 -07:00
Daniel Templeton
25d891a784
YARN-6743. yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml
...
(Contributed by Lori Loberg via Daniel Templeton)
2017-06-28 13:17:58 -07:00
Sunil G
ca13b224b2
YARN-5892. Support user-specific minimum user limit percentage in Capacity Scheduler. Contributed by Eric Payne.
2017-06-22 23:50:57 -07:00
Naganarasimha
740204b292
YARN-5006. ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zk. Contributed by Bibin A Chundatt.
2017-06-23 07:52:41 +05:30
Naganarasimha
ee89ac84e6
YARN-6680. Avoid locking overhead for NO_LABEL lookups. Contributed by Daryn Sharp
2017-06-19 22:42:45 +05:30
Naganarasimha
7582dedad1
YARN-6517. Fix warnings from Spotbugs in hadoop-yarn-common(addendum). Contributed by Weiwei Yang.
2017-06-18 19:53:42 +05:30
Daniel Templeton
036a24bab3
MAPREDUCE-6896. Document wrong spelling in usage of MapredTestDriver tools.
...
(Contributed by LiXin Ge via Daniel Templeton)
2017-06-13 13:21:23 -07:00
Eric Payne
5578af8603
YARN-6585. RM fails to start when upgrading from 2.7 for clusters with node labels. Contributed by Sunil G.
2017-06-09 16:16:34 -05:00
Daniel Templeton
a062374c39
YARN-6679. Reduce Resource instance overhead via non-PBImpl
...
(Contributed by Daryn Sharp via Daniel Templeton)
2017-06-08 10:08:08 -07:00
Haibo Chen
4b4a6524f2
YARN-6477. Dispatcher no longer needs the raw types suppression. (Maya Wexler via Haibo Chen)
2017-05-30 16:58:15 -07:00
Andrew Wang
16ad896d5c
Update maven version for 3.0.0-alpha4 development
2017-05-26 14:09:44 -07:00
Wangda Tan
c583ab02c7
YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Sunil G via wangda)
...
Change-Id: I9b19f69788068be05b3295247cdd7b972f8a573c
2017-05-22 14:26:13 -07:00
Robert Kanter
9855225a79
YARN-6602. Impersonation does not work if standby RM is contacted first (rkanter)
2017-05-19 15:43:22 -07:00
Andrew Wang
543aac9f28
HADOOP-14386. Rewind trunk from Guava 21.0 back to Guava 11.0.2.
2017-05-09 09:22:53 -07:00
Haibo Chen
1769b12a77
YARN-6457. Allow custom SSL configuration to be supplied in WebApps. (Sanjay M Pujare via Haibo Chen)
2017-05-08 15:46:12 -07:00
Jason Lowe
424887ecb7
YARN-3839. Quit throwing NMNotYetReadyException. Contributed by Manikandan R
2017-05-08 17:14:37 -05:00
Naganarasimha
4b5bd73ac5
YARN-6517. Fix warnings from Spotbugs in hadoop-yarn-common. Contributed by Weiwei Yang
2017-05-01 16:31:16 +05:30
Daniel Templeton
2e52789edf
YARN-2962. ZKRMStateStore: Limit the number of znodes under a znode (Contributed by Varun Sexena via Daniel Templeton)
2017-04-28 13:30:28 -07:00
Junping Du
94607214ce
YARN-6534. ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled. Contributed by Rohith Sharma K S.
...
(cherry picked from commit 09e36ff59c05b8bd54d346d1103de0a7300875c6)
2017-04-27 13:11:32 -07:00
Haibo Chen
4f3ca0396a
YARN-6510. Fix profs stat file warning caused by process names that includes parenthesis. (Wilfred Spiegelenburg via Haibo Chen)
2017-04-26 11:46:55 -07:00
Daniel Templeton
dd43b895c2
YARN-6202. Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded
...
(Contributed by Yufei Gu via Daniel Templeton)
2017-04-19 11:44:55 -07:00
Daniel Templeton
15acdbdba2
YARN-3427. Remove deprecated methods from ResourceCalculatorProcessTree
...
(Contributed by Miklos Szegedi via Daniel Templeton)
2017-04-19 10:31:14 -07:00
Sunil G
9ff25408bc
YARN-6164. Expose Queue Configurations per Node Label through YARN client api. Contributed by Benson Qiu.
2017-04-19 20:39:09 +05:30
Junping Du
9d9087a67a
YARN-3760. FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close(). Contributed by Haibo Chen.
...
(cherry picked from commit c26ccf1adb3a72df3f68e1150b86b813c691203a)
2017-04-12 13:43:18 -07:00
Jason Lowe
1b081ca27e
YARN-6288. Exceptions during aggregated log writes are mishandled. Contributed by Akira Ajisaka
2017-04-06 16:24:36 -05:00
Jason Lowe
e8071aa249
YARN-6403. Invalid local resource request can raise NPE and make NM exit. Contributed by Tao Yang
2017-04-05 12:30:45 -05:00
Varun Saxena
7c2bc444b3
YARN-6342. Make TimelineV2Client's drain timeout after stop configurable (Haibo Chen via Varun Saxena)
2017-03-31 02:02:57 +05:30
Daniel Templeton
640ba1d23f
YARN-5685. RM configuration allows all failover methods to disabled when automatic failover is enabled
2017-03-29 12:38:11 -07:00
Robert Kanter
9bae6720cb
YARN-6050. AMs can't be scheduled on racks or nodes (rkanter)
2017-03-27 17:23:13 -07:00
Wangda Tan
cd014d57aa
YARN-6339. Improve performance for createAndGetApplicationReport. (Yunjiong Zhao via wangda)
2017-03-27 13:29:09 -07:00
Tsuyoshi Ozawa
84ddedc0b2
HADOOP-10101. Update guava dependency to the latest version. (ozawa)
2017-03-25 10:06:52 +09:00
Junping Du
221783b35b
YARN-6294. ATS client should better handle Socket closed case. Contributed by Li Lu.
2017-03-15 11:48:17 -07:00
Junping Du
871dc420f8
YARN-6313. YARN logs cli should provide logs for a completed container even when application is still running. Contributed by Xuan Gong.
...
(cherry picked from commit b88f5e0f7858d1d89b79dfd325b767c34416052d)
2017-03-14 12:58:12 -07:00
Varun Saxena
229c7c9f89
YARN-6069. CORS support in timeline v2 (Rohith Sharma K S via Varun Saxena)
2017-03-11 04:09:01 +05:30
Jason Lowe
9649c27864
YARN-6321. TestResources test timeouts are too aggressive. Contributed by Eric Badger
2017-03-10 13:06:54 -06:00
Jason Lowe
deb9f56946
YARN-6310. OutputStreams in AggregatedLogFormat.LogWriter can be left open upon exceptions. Contributed by Haibo Chen
2017-03-10 11:08:33 -06:00
Karthik Kambatla
a96afae125
YARN-6264. AM not launched when a single vcore is available on the cluster. (Yufei Gu via kasha)
2017-03-09 23:11:54 -08:00
Jian He
279d187f72
YARN-6270. WebUtils.getRMWebAppURLWithScheme() needs to honor RM HA setting. Contributed by Xuan Gong
2017-03-03 15:24:04 -08:00
Robert Kanter
6f6dfe0202
YARN-5280. Allow YARN containers to run with Java Security Manager (gphillips via rkanter)
2017-03-01 14:53:47 -08:00
Gera Shegalov
480b4dd574
YARN-1728. Regression test for guice-undecoded pathInfo in YARN WebApp. (Yuanbo Liu via gera)
2017-02-28 09:27:22 -08:00
Xuan
53d372a255
YARN-6228: EntityGroupFSTimelineStore should allow configurable cache
...
stores. Contributed by Li Lu
2017-02-24 10:59:35 -08:00
Karthik Kambatla
718ad9f6ee
YARN-6210. FairScheduler: Node reservations can interfere with preemption. (kasha)
2017-02-22 15:46:07 -08:00
Wangda Tan
1a6ca75f38
YARN-6143. Fix incompatible issue caused by YARN-3583. (Sunil G via wangda)
2017-02-22 11:17:09 -08:00
Daniel Templeton
c7a36e6130
YARN-6125. The application attempt's diagnostic message should have a maximum size
...
(Contributed by Andras Piros via Daniel Templeton)
2017-02-17 13:40:58 -08:00
Sangjin Lee
4fa1afdb88
YARN-4675. Reorganize TimelineClient and TimelineClientImpl into separate classes for ATSv1.x and ATSv2. Contributed by Naganarasimha G R.
2017-02-16 11:41:04 -08:00
Karthik Kambatla
6c25dbcdc0
YARN-6163. FS Preemption is a trickle for severely starved applications. (kasha)
2017-02-15 23:16:12 -08:00
Junping Du
0fc6f38379
Addendum patch for YARN-6174 - remove deleted file.
2017-02-15 09:07:49 -08:00
Junping Du
ce2d5bfa5f
YARN-6174. Log files pattern should be same for both running and finished container. Contributed by Xuan Gong.
2017-02-15 09:05:14 -08:00
Arun Suresh
aaf106fde3
YARN-5966. AMRMClient changes to support ExecutionType update. (asuresh)
2017-02-14 06:09:10 -08:00
Junping Du
464ff479ce
YARN-6113. Re-direct NM Web Service to get container logs for finished applications. Contributed by Xuan Gong.
2017-02-13 06:12:54 -08:00
Sunil G
3a0a0a485a
YARN-6118. Add javadoc for Resources.isNone. Contributed by Andres Perez.
2017-02-10 15:48:46 +05:30
Junping Du
eec52e158b
YARN-6145. Improve log message on fail over. Contributed by Jian He.
2017-02-08 02:11:19 -08:00
Junping Du
9dbfab1284
YARN-6108. Improve AHS webservice to accept NM address as a parameter to get container logs. Contributed by Xuan Gong.
2017-02-07 02:13:14 -08:00
Junping Du
cce35c3815
HADOOP-12097. Allow port range to be specified while starting webapp. Contributed by Varun Saxena.
2017-02-05 19:42:11 -08:00
Junping Du
327c9980aa
YARN-6100. Improve YARN webservice to output aggregated container logs. Contributed by Xuan Gong.
2017-02-02 00:41:18 -08:00
Junping Du
8528d85a68
YARN-6099. Improve webservice to list aggregated log files. Contributed by Xuan Gong.
2017-01-24 15:26:53 -08:00
Sangjin Lee
dc6ec97048
YARN-6117. SharedCacheManager does not start up. Contributed by Chris Trezzo.
2017-01-23 21:07:25 -08:00
Jason Lowe
69fa81679f
YARN-5910. Support for multi-cluster delegation tokens. Contributed by Jian He
2017-01-23 17:12:51 +00:00
Andrew Wang
5d8b80ea9b
Preparing for 3.0.0-alpha3 development
2017-01-19 15:50:07 -08:00
bibinchundatt
a9d946d4df
YARN-6057. yarn.scheduler.minimum-allocation-* descriptions are incorrect about behavior when a request is out of bounds. Contributed by Julia Sommer.
2017-01-17 14:16:00 +05:30
Daniel Templeton
e6f13fe5d1
YARN-5849. Automatically create YARN control group for pre-mounted cgroups (Contributed by Miklos Szegedi via Daniel Templeton)
2017-01-11 16:00:01 -08:00
Junping Du
4db119b7b5
YARN-6079. Fix simple spelling errors in yarn test code. Contributed by vijay.
2017-01-10 18:20:27 -08:00
Wangda Tan
287d3d6804
YARN-3955. Support for application priority ACLs in queues of CapacityScheduler. (Sunil G via wangda)
2017-01-09 08:40:39 -08:00
Naganarasimha
a59df15757
YARN-6015. AsyncDispatcher thread name can be set to improved debugging. Contributed by Ajith S.
2017-01-07 08:11:58 +05:30
Daniel Templeton
165d01a73e
YARN-5931. Document timeout interfaces CLI and REST APIs (Contributed by Rohith Sharma K S via Daniel Templeton)
2016-12-30 08:41:52 -08:00
Robert Kanter
9262797e86
YARN-5257. Fix unreleased resources and null dereferences (yufeigu via rkanter)
2016-12-27 14:14:08 -08:00
Daniel Templeton
e216e8e233
HADOOP-13932. Fix indefinite article in comments (Contributed by LiXin Ge via Daniel Templeton)
2016-12-27 13:03:16 -08:00
Arun Suresh
ac1e5d4f77
YARN-5938. Refactoring OpportunisticContainerAllocator to use SchedulerRequestKey instead of Priority and other misc fixes (asuresh)
2016-12-27 12:40:44 -08:00
Arun Suresh
2273a74c1f
YARN-5646. Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers. (Konstantinos Karanasos via asuresh)
2016-12-16 08:14:34 -08:00
Steve Loughran
f66f61892a
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran
2016-12-12 13:58:27 +00:00
Robert Kanter
4b149a1e77
YARN-4457. Cleanup unchecked types for EventHandler (templedf via rkanter)
2016-12-09 17:28:25 -08:00
Arun Suresh
b0aace21b1
YARN-5982. Simplify opportunistic container parameters and metrics. (Konstantinos Karanasos via asuresh)
2016-12-09 16:41:25 -08:00
Akira Ajisaka
7d8e440eee
Revert "HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran"
...
This reverts commit c265515725
.
2016-12-09 12:49:27 +09:00
Steve Loughran
c265515725
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran
2016-12-08 17:57:15 +00:00
Sunil G
74d0066d33
YARN-5970. Validate application update timeout request parameters. Contributed by Rohith Sharma K S.
2016-12-08 15:53:56 +05:30
Robert Kanter
72fe546841
YARN-5963. Spelling errors in logging and exceptions for node manager, client, web-proxy, common, and app history code (gsohn via rkanter)
2016-12-07 15:07:25 -08:00
Sunil
ab923a53fc
YARN-5965. Retrospect ApplicationReport#getApplicationTimeouts. Contributed by Rohith Sharma K S
2016-12-08 00:27:25 +05:30
Jian He
43ebff2e35
YARN-5559. Analyse 2.8.0/3.0.0 jdiff reports and fix any issues. Contributed by Akira Ajisaka & Wangda Tan
2016-12-05 11:39:34 -08:00
Jason Lowe
f304ccae3c
YARN-5915. ATS 1.5 FileSystemTimelineWriter causes flush() to be called after every event write. Contributed by Atul Sikaria
2016-12-02 16:54:15 +00:00
Robert Kanter
c87b3a448a
MAPREDUCE-6787. Allow job_conf.xml to be downloadable on the job overview page in JHS (haibochen via rkanter)
2016-12-01 17:29:38 -08:00
Daniel Templeton
b3befc021b
YARN-4997. Update fair scheduler to use pluggable auth provider (Contributed by Tao Jie via Daniel Templeton)
2016-11-30 09:50:33 -08:00
Daniel Templeton
25f9872be6
YARN-5774. MR Job stuck in ACCEPTED status without any progress in Fair Scheduler
...
if set yarn.scheduler.minimum-allocation-mb to 0. (Contributed by Yufei Gu via Daniel Templeton)
2016-11-29 09:40:49 -08:00
Akira Ajisaka
209e805430
HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki.
2016-11-28 14:34:57 +09:00
Sunil
eb0a483ed0
YARN-4206. Add Application timeouts in Application report and CLI. Contributed by Rohith Sharma K S.
2016-11-24 18:18:42 +05:30
Daniel Templeton
10468529a9
YARN-4752. Improved preemption in FairScheduler. (kasha)
...
Contains:
YARN-5605. Preempt containers (all on one node) to meet the requirement of starved applications
YARN-5821. Drop left-over preemption-related code and clean up method visibilities in the Schedulable hierarchy
YARN-5783. Verify identification of starved applications.
YARN-5819. Verify fairshare and minshare preemption
YARN-5885. Cleanup YARN-4752 branch for merge
Change-Id: Iee0962377d019dd64dc69a020725d2eaf360858c
2016-11-23 19:48:59 -10:00
Naganarasimha
3541ed8068
YARN-4330. MiniYARNCluster is showing multiple Failed to instantiate default resource calculator warning messages. Contributed by Varun Saxena
2016-11-23 14:12:23 +05:30
Naganarasimha
4667564162
YARN-5911. DrainDispatcher does not drain all events on stop even if setDrainEventsOnStop is true. Contributed by Varun Saxena.
2016-11-23 08:49:48 +05:30
Akira Ajisaka
6f8074298d
YARN-5713. Update jackson from 1.9.13 to 2.x in hadoop-yarn.
2016-11-22 10:20:31 +09:00
Rohith Sharma K S
d65603517e
YARN-5375. invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures. Contributed by sandflee.
2016-11-16 15:14:00 +05:30
Mingliang Liu
5af572b644
HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu
2016-11-15 10:57:00 -08:00