Haibo Chen
|
e60b797c88
|
YARN-8750. Refactor TestQueueMetrics. (Contributed by Szilard Nemeth)
|
2018-10-04 13:00:31 -07:00 |
|
Haibo Chen
|
b6d5d84e07
|
YARN-8732. Add unit tests of min/max allocation for custom resource types in FairScheduler. (Contributed by Szilard Nemeth)
|
2018-10-04 12:47:31 -07:00 |
|
Wangda Tan
|
2e9913caf2
|
YARN-8844. TestNMProxy unit test is failing. (Eric Yang via wangda)
Change-Id: I241fa8701b6f1dbcad87fd2e9a429e32e7aa40f5
(cherry picked from commit b3ac8869338faeabedbc27e95e3166c830a9a761)
|
2018-10-04 10:53:39 -07:00 |
|
Sunil G
|
58fa96b697
|
Changed version in trunk to 3.3.0-SNAPSHOT.
|
2018-10-02 22:41:41 +05:30 |
|
Shane Kumpf
|
5edb9d3b97
|
YARN-8785. Improve the error message when a bind mount is not whitelisted. Contributed by Simon Prewo
|
2018-10-02 07:16:29 -06:00 |
|
Haibo Chen
|
d0ee6fbe28
|
YARN-8621. Add test coverage of custom Resource Types for the apps/<appId> REST API endpoint. (Contributed by Szilard Nemeth)
|
2018-10-01 14:46:42 -07:00 |
|
Giovanni Matteo Fumarola
|
59d5af21b7
|
YARN-8760. [AMRMProxy] Fix concurrent re-register due to YarnRM failover in AMRMClientRelayer. Contributed by Botong Huang.
|
2018-10-01 13:12:38 -07:00 |
|
Weiwei Yang
|
fd6be5898a
|
YARN-8468. Enable the use of queue based maximum container allocation limit and implement it in FairScheduler. Contributed by Antal Bálint Steinbach.
|
2018-09-29 17:47:12 +08:00 |
|
Eric E Payne
|
8598b498bc
|
YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang.
|
2018-09-28 15:32:07 +00:00 |
|
bibinchundatt
|
7093afd874
|
YARN-8829. Cluster metrics can fail with IndexOutOfBoundsException. Contributed by Akshay Agarwal.
|
2018-09-28 12:35:33 +05:30 |
|
Vrushali C
|
90e2e493b3
|
YARN-8270 Adding JMX Metrics for Timeline Collector and Reader. Contributed by Sushil Ks.
|
2018-09-27 15:53:39 -07:00 |
|
Eric Yang
|
b237a0dd44
|
YARN-6456. Added config to set default container runtimes.
Contributed by Craig Condit
|
2018-09-27 15:31:18 -04:00 |
|
Jason Lowe
|
6b988d821e
|
YARN-8804. resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues. Contributed by Tao Yang
|
2018-09-26 14:43:00 -07:00 |
|
Eric Yang
|
913f87dada
|
YARN-8665. Added Yarn service cancel upgrade option.
Contributed by Chandni Singh
|
2018-09-26 14:51:35 -04:00 |
|
Rohith Sharma K S
|
e5287a4fe0
|
YARN-8824. App Nodelabel missed after RM restart for finished apps. Contributed by Bibin A Chundatt.
|
2018-09-26 12:30:26 +05:30 |
|
Akira Ajisaka
|
44edcdfd6a
|
YARN-8745. Misplaced the TestRMWebServicesFairScheduler.java file. Contributed by Y. SREENIVASULU REDDY.
|
2018-09-26 10:09:11 +09:00 |
|
Rohith Sharma K S
|
50bc7746d7
|
YARN-8815. RM fails to recover finished unmanaged AM. Contributed by Bibin A Chundatt.
|
2018-09-25 11:31:14 +05:30 |
|
Haibo Chen
|
29dad7d258
|
YARN-8616. systemClock should be used in RMAppImpl instead of System.currentTimeMills(), to be consistent. (Contributed by Szilard Nemeth)
|
2018-09-24 16:04:28 -07:00 |
|
Giovanni Matteo Fumarola
|
3090922805
|
YARN-8696. [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async. Contributed by Botong Huang.
|
2018-09-24 11:37:05 -07:00 |
|
Eric Yang
|
aa4bd493c3
|
YARN-8801. Fixed header comments for docker utility functions.
Contributed by Zian Chen
|
2018-09-20 13:08:59 -04:00 |
|
Jason Lowe
|
6b5838ed32
|
YARN-8784. DockerLinuxContainerRuntime prevents access to distributed cache entries on a full disk. Contributed by Eric Badger
|
2018-09-19 16:44:51 -05:00 |
|
Eric Yang
|
efdea85ad1
|
YARN-8791. Trim docker inspect output for line feed for STOPSIGNAL parsing.
Contributed by Chandni Singh
|
2018-09-19 13:16:11 -04:00 |
|
Weiwei Yang
|
0712537e79
|
YARN-8771. CapacityScheduler fails to unreserve when cluster resource contains empty resource type. Contributed by Tao Yang.
|
2018-09-19 19:31:07 +08:00 |
|
Jason Lowe
|
2df0a8dcb3
|
YARN-8648. Container cgroups are leaked when using docker. Contributed by Jim Brennan
|
2018-09-18 15:36:45 -05:00 |
|
Shane Kumpf
|
144a55f0e3
|
YARN-8045. Reduce log output from container status calls. Contributed by Craig Condit
|
2018-09-14 10:41:55 -06:00 |
|
Shane Kumpf
|
78902f0250
|
YARN-8748. Javadoc warnings within the nodemanager package. Contributed by Craig Condit
|
2018-09-14 10:28:36 -06:00 |
|
Eric Yang
|
99237607bf
|
YARN-8706. Allow additional flag in docker inspect call.
Contributed by Chandni Singh
|
2018-09-14 11:46:59 -04:00 |
|
Weiwei Yang
|
f1a893fdbc
|
YARN-8720. CapacityScheduler does not enforce max resource allocation check at queue level. Contributed by Tarun Parimi.
|
2018-09-14 16:33:51 +08:00 |
|
Jason Lowe
|
250b50018e
|
YARN-8680. YARN NM: Implement Iterable Abstraction for LocalResourceTracker state. Contributed by Pradeep Ambati
|
2018-09-13 13:28:54 -05:00 |
|
Weiwei Yang
|
39c1ea1ed4
|
YARN-8729. Node status updater thread could be lost after it is restarted. Contributed by Tao Yang.
|
2018-09-13 22:21:35 +08:00 |
|
Sunil G
|
f4bda5e8e9
|
YARN-8630. ATSv2 REST APIs should honor filter-entity-list-by-user in non-secure cluster when ACls are enabled. Contributed by Rohith Sharma K S.
|
2018-09-13 17:47:21 +05:30 |
|
Shane Kumpf
|
8e9afbfb66
|
YARN-8768. Javadoc error in node attributes. Contributed by Sunil Govindan.
|
2018-09-12 15:12:28 -06:00 |
|
Giovanni Matteo Fumarola
|
02b9bfdf9e
|
YARN-8658. [AMRMProxy] Metrics for AMRMClientRelayer inside FederationInterceptor. Contributed by Young Chen.
|
2018-09-12 11:46:35 -07:00 |
|
Sunil G
|
5e64e62dee
|
YARN-8740. Clear node attribute path after each test run. Contributed by Bibin A Chundatt.
|
2018-09-12 16:01:01 +05:30 |
|
bibinchundatt
|
c44088ac19
|
YARN-8739. Fix jenkins issues for Node Attributes branch. Contributed by Sunil Govindan.
|
2018-09-12 16:01:01 +05:30 |
|
Weiwei Yang
|
52194351e7
|
YARN-8721. Relax NE node-attribute check when attribute doesn't exist on a node. Contributed by Sunil Govindan.
|
2018-09-12 16:01:01 +05:30 |
|
Naganarasimha
|
67ae81f0e0
|
YARN-7863. Modify placement constraints to support node attributes. Contributed by Sunil Govindan.
|
2018-09-12 16:01:01 +05:30 |
|
Naganarasimha
|
eb08543c7a
|
YARN-8103. Add CLI interface to query node attributes. Contributed by Bibin A Chundatt.
|
2018-09-12 16:01:01 +05:30 |
|
Sunil G
|
76183428b7
|
YARN-8351. Node attribute manager logs are flooding RM logs. Contributed by Weiwei Yang.
|
2018-09-12 16:01:00 +05:30 |
|
bibinchundatt
|
8cf6a9a2bd
|
YARN-7892. Revisit NodeAttribute class structure. Contributed by Naganarasimha G R.
|
2018-09-12 16:01:00 +05:30 |
|
Naganarasimha
|
5dc7d6e0f3
|
YARN-8104. Add API to fetch node to attribute mapping. Contributed by Bibin A Chundatt.
|
2018-09-12 16:01:00 +05:30 |
|
Naganarasimha
|
0a01b1350d
|
YARN-8100. Support API interface to query cluster attributes and attribute to nodes. Contributed by Bibin A Chundatt.
|
2018-09-12 16:01:00 +05:30 |
|
Sunil G
|
b9890d1f66
|
YARN-7875. Node Attribute store for storing and recovering attributes. Contributed by Bibin A Chundatt.
|
2018-09-12 16:01:00 +05:30 |
|
bibinchundatt
|
a6590c1f1f
|
YARN-8117. Fix TestRMWebServicesNodes test failure. Contributed by Bibin A Chundatt.
|
2018-09-12 16:01:00 +05:30 |
|
bibinchundatt
|
901e85238d
|
YARN-8033. CLI Integration with NodeAttributesManagerImpl. Contributed by Naganarasimha G R.
|
2018-09-12 16:01:00 +05:30 |
|
Sunil G
|
89b3ebd11e
|
YARN-8092. Expose Node Attributes info via RM nodes REST API. Contributed by Weiwei Yang.
|
2018-09-12 16:01:00 +05:30 |
|
Sunil G
|
440ff7f563
|
YARN-8094. Support configuration based Node Attribute provider. Contributed by Weiwei Yang.
|
2018-09-12 16:01:00 +05:30 |
|
Sunil G
|
6f4bc49c6d
|
YARN-7988. Refactor FSNodeLabelStore code for Node Attributes store support. Contributed by Bibin A Chundatt.
|
2018-09-12 16:01:00 +05:30 |
|
Naganarasimha
|
3b3b6efe21
|
YARN-7871. Node attributes reporting from NM to RM. Contributed by Weiwei Yang.
|
2018-09-12 16:01:00 +05:30 |
|
Naganarasimha
|
86d024ef2a
|
YARN-7965. NodeAttributeManager add/get API is not working properly. Contributed by Weiwei Yang.
|
2018-09-12 16:01:00 +05:30 |
|
Sunil G
|
ffcabd24c3
|
YARN-7856. Validate Node Attributes from NM. Contributed by Weiwei Yang.
|
2018-09-12 16:01:00 +05:30 |
|
Sunil G
|
2f7712be09
|
YARN-6858. Attribute Manager to store and provide node attributes in RM. Contributed by Naganarasimha G R.
|
2018-09-12 16:01:00 +05:30 |
|
Naganarasimha
|
d312b5cf9f
|
YARN-7757. Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers. Contributed by Weiwei Yang.
|
2018-09-12 16:01:00 +05:30 |
|
Weiwei Yang
|
d9d93e3925
|
YARN-7842. PB changes to carry node-attributes in NM heartbeat. Contributed by Weiwei Yang.
|
2018-09-12 16:00:59 +05:30 |
|
Naganarasimha
|
1f42ce907a
|
YARN-6855. [YARN-3409] CLI Proto Modifications to support Node Attributes. Contributed by Naganarasimha G R.
|
2018-09-12 16:00:59 +05:30 |
|
Eric E Payne
|
987d8191ad
|
YARN-8709: CS preemption monitor always fails since one under-served queue was deleted. Contributed by Tao Yang.
|
2018-09-10 19:55:20 +00:00 |
|
Eric Yang
|
bf8a1750e9
|
YARN-8706. Updated docker container stop logic to avoid double kill.
Contributed by Chandni Singh
|
2018-09-07 20:18:09 -04:00 |
|
Eric Yang
|
7d62334387
|
YARN-8751. Reduce conditions that mark node manager as unhealthy.
Contributed by Craig Condit
|
2018-09-07 19:46:15 -04:00 |
|
Giovanni Matteo Fumarola
|
3dc2988a37
|
YARN-8699. Add Yarnclient#yarnclusterMetrics API implementation in router. Contributed by Bibin A Chundatt.
|
2018-09-07 11:32:03 -07:00 |
|
Giovanni Matteo Fumarola
|
9af96d4ed4
|
HADOOP-15707. Add IsActiveServlet to be used for Load Balancers. Contributed by Lukas Majercak.
|
2018-09-05 10:50:25 -07:00 |
|
Shane Kumpf
|
dffb7bfe6c
|
YARN-8638. Allow linux container runtimes to be pluggable. Contributed by Craig Condit
|
2018-09-05 06:47:54 -06:00 |
|
bibinchundatt
|
eed8415dc1
|
YARN-8535. Fix DistributedShell unit tests. Contributed by Abhishek Modi.
|
2018-09-02 13:35:52 +05:30 |
|
Shane Kumpf
|
73625168c0
|
YARN-8642. Add support for tmpfs mounts with the Docker runtime. Contributed by Craig Condit
|
2018-08-29 07:08:37 -06:00 |
|
Weiwei Yang
|
3fa4639421
|
YARN-8723. Fix a typo in CS init error message when resource calculator is not correctly set. Contributed by Abhishek Modi.
|
2018-08-29 11:13:44 +08:00 |
|
Giovanni Matteo Fumarola
|
7ed458b255
|
YARN-8697. LocalityMulticastAMRMProxyPolicy should fallback to random sub-cluster when cannot resolve resource. Contributed by Botong Huang.
|
2018-08-28 16:01:35 -07:00 |
|
Giovanni Matteo Fumarola
|
602d13844a
|
HADOOP-15699. Fix some of testContainerManager failures in Windows. Contributed by Botong Huang.
|
2018-08-27 12:25:46 -07:00 |
|
Billie Rinaldi
|
05b2bbeb35
|
YARN-8675. Remove default hostname for docker containers when net=host. Contributed by Suma Shivaprasad
|
2018-08-27 11:34:33 -07:00 |
|
Giovanni Matteo Fumarola
|
f152582562
|
YARN-8705. Refactor the UAM heartbeat thread in preparation for YARN-8696. Contributed by Botong Huang.
|
2018-08-27 10:32:22 -07:00 |
|
Jason Lowe
|
585ebd873a
|
YARN-8649. NPE in localizer hearbeat processing if a container is killed while localizing. Contributed by lujie
|
2018-08-23 09:29:46 -05:00 |
|
Sunil G
|
1ac01444a2
|
YARN-8015. Support all types of placement constraint support for Capacity Scheduler. Contributed by Weiwei Yang.
|
2018-08-23 10:05:43 +05:30 |
|
Weiwei Yang
|
9c3fc3ef28
|
YARN-7494. Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision. Contributed by Sunil Govindan.
|
2018-08-21 22:42:28 +08:00 |
|
Weiwei Yang
|
54d0bf8935
|
YARN-8683. Support to display pending scheduling requests in RM app attempt page. Contributed by Tao Yang.
|
2018-08-21 19:00:31 +08:00 |
|
Rohith Sharma K S
|
d3fef7a5c5
|
YARN-8129. Improve error message for invalid value in fields attribute. Contributed by Abhishek Modi.
|
2018-08-21 11:58:07 +05:30 |
|
Giovanni Matteo Fumarola
|
e0f6ffdbad
|
YARN-8581. [AMRMProxy] Add sub-cluster timeout in LocalityMulticastAMRMProxyPolicy. Contributed by Botong Huang.
|
2018-08-20 14:33:16 -07:00 |
|
Giovanni Matteo Fumarola
|
8736fc39ac
|
YARN-8673. [AMRMProxy] More robust responseId resync after an YarnRM master slave switch. Contributed by Botong Huang.
|
2018-08-20 12:22:36 -07:00 |
|
Jason Lowe
|
65e7469712
|
YARN-8242. YARN NM: OOM error while reading back the state store on recovery. Contributed by Pradeep Ambati and Kanwaljeet Sachdev
|
2018-08-20 10:14:40 -05:00 |
|
Rohith Sharma K S
|
4aacbfff60
|
YARN-8679. [ATSv2] If HBase cluster is down for long time, high chances that NM ContainerManager dispatcher get blocked. Contributed by Wangda Tan.
|
2018-08-18 10:26:55 +05:30 |
|
Eric Yang
|
d42806160e
|
YARN-8667. Cleanup symlinks when container restarted by NM.
Contributed by Chandni Singh
|
2018-08-16 18:41:58 -04:00 |
|
Jason Lowe
|
cb21eaa026
|
YARN-8656. container-executor should not write cgroup tasks files for docker containers. Contributed by Jim Brennan
|
2018-08-16 10:06:17 -05:00 |
|
Wei-Chiu Chuang
|
bdd0e01ed9
|
HADOOP-14212. Addendum patch: Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal.
|
2018-08-14 18:25:38 -07:00 |
|
Wei-Chiu Chuang
|
363bd16e31
|
HADOOP-14212. Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal.
|
2018-08-14 17:19:00 -07:00 |
|
Eric Yang
|
4cba0741d5
|
YARN-8160. Support upgrade of service that use docker containers.
Contributed by Chandni Singh
|
2018-08-14 11:36:26 -04:00 |
|
Jason Lowe
|
d1d129aa9d
|
YARN-8640. Restore previous state in container-executor after failure. Contributed by Jim Brennan
|
2018-08-14 10:21:03 -05:00 |
|
Weiwei Yang
|
0a71bf1452
|
YARN-8575. Avoid committing allocation proposal to unavailable nodes in async scheduling. Contributed by Tao Yang.
|
2018-08-10 14:37:45 +08:00 |
|
Weiwei Yang
|
08d5060605
|
YARN-8521. NPE in AllocationTagsManager when a container is removed more than once. Contributed by Weiwei Yang.
|
2018-08-10 08:32:02 +08:00 |
|
Robert Kanter
|
b2517dd66b
|
YARN-4946. RM should not consider an application as COMPLETED when log aggregation is not in a terminal state (snemeth via rkanter)
|
2018-08-09 14:58:04 -07:00 |
|
Wangda Tan
|
344c335a92
|
YARN-8588. Logging improvements for better debuggability. (Suma Shivaprasad via wangda)
Change-Id: I66aa4b0ec031ae5ce0fae558e2f8cbcbbfebc442
|
2018-08-09 11:04:02 -07:00 |
|
Weiwei Yang
|
d352f167eb
|
YARN-8559. Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint. Contributed by Weiwei Yang.
|
2018-08-09 23:46:53 +08:00 |
|
Jason Lowe
|
cd04e954d2
|
YARN-8331. Race condition in NM container launched after done. Contributed by Pradeep Ambati
|
2018-08-09 10:17:34 -05:00 |
|
Giovanni Matteo Fumarola
|
d838179d8d
|
YARN-8626. Create HomePolicyManager that sends all the requests to the home subcluster. Contributed by Inigo Goiri.
|
2018-08-07 15:33:16 -07:00 |
|
Wangda Tan
|
d4258fcad7
|
YARN-8629. Container cleanup fails while trying to delete Cgroups. (Suma Shivaprasad via wangda)
Change-Id: I392ef4f8baa84d5d7b1f2e438c560b5426b6d4f2
|
2018-08-07 12:36:55 -07:00 |
|
Haibo Chen
|
889df6f194
|
YARN-7948. Enable fair scheduler to refresh maximum allocation for multiple resource types. (Szilard Nemeth via Haibo Chen)
|
2018-08-02 10:10:12 -07:00 |
|
Sunil G
|
12a095a496
|
YARN-7159. Normalize unit of resource objects in RM to avoid unit conversion in critical path. Contributed by Manikandan R.
|
2018-08-02 22:29:21 +05:30 |
|
Jason Lowe
|
7526815e32
|
YARN-8263. DockerClient still touches hadoop.tmp.dir. Contributed by Craig Condit
|
2018-08-02 10:43:48 -05:00 |
|
Sunil G
|
735b492556
|
YARN-8593. Add RM web service endpoint to get user information. Contributed by Akhil PB.
|
2018-08-02 08:34:09 +05:30 |
|
Billie Rinaldi
|
67c65da261
|
YARN-8403. Change the log level for fail to download resource from INFO to ERROR. Contributed by Eric Yang
|
2018-08-01 08:51:40 -07:00 |
|
Sunil G
|
a48a0cc7fd
|
YARN-8606. Opportunistic scheduling does not work post RM failover. Contributed by Bibin A Chundatt.
|
2018-08-01 12:17:18 +05:30 |
|
Sunil G
|
6310c0d17d
|
YARN-8397. Potential thread leak in ActivitiesManager. Contributed by Rohith Sharma K S.
|
2018-08-01 08:33:30 +05:30 |
|
Eric Yang
|
c7ebcd76bf
|
YARN-8579. Recover NMToken of previous attempted component data.
Contributed by Gour Saha
|
2018-07-31 18:01:02 -04:00 |
|
Wangda Tan
|
4b540bbfcf
|
YARN-8418. App local logs could leaked if log aggregation fails to initialize for the app. (Bibin A Chundatt via wangda)
Change-Id: I29a23ca4b219b48c92e7975cd44cddb8b0e04104
|
2018-07-31 12:08:00 -07:00 |
|
Haibo Chen
|
8aa93a575e
|
YARN-8605. TestDominantResourceFairnessPolicy.testModWhileSorting is flaky. (Wilfred Spiegelenburg via Haibo Chen)
|
2018-07-31 11:32:40 -07:00 |
|
Jonathan Hung
|
3e06a5dcea
|
YARN-7974. Allow updating application tracking url after registration. Contributed by Jonathan Hung
|
2018-07-30 17:44:18 -07:00 |
|
bibinchundatt
|
2b39ad2698
|
YARN-8584. Several typos in Log Aggregation related classes. Contributed by Szilard Nemeth.
|
2018-07-30 23:25:19 +05:30 |
|
Sunil G
|
63e08ec071
|
YARN-8591. [ATSv2] NPE while checking for entity acl in non-secure cluster. Contributed by Rohith Sharma K S.
|
2018-07-30 14:48:04 +05:30 |
|
bibinchundatt
|
3d586841ab
|
YARN-8558. NM recovery level db not cleaned up properly on container finish. Contributed by Bibin A Chundatt.
|
2018-07-28 20:52:39 +05:30 |
|
Eric Yang
|
ed9d60e888
|
YARN-8508. Release GPU resource for killed container.
Contributed by Chandni Singh
|
2018-07-27 19:33:58 -04:00 |
|
Inigo Goiri
|
79091cf76f
|
YARN-8596. Allow SQLFederationStateStore to submit the same app in the same subcluster. Contributed by Giovanni Matteo Fumarola.
|
2018-07-27 15:23:57 -07:00 |
|
Robert Kanter
|
2cccf4061c
|
YARN-8517. getContainer and getContainers ResourceManager REST API methods are not documented (snemeth via rkanter)
|
2018-07-27 14:35:03 -07:00 |
|
Eric Yang
|
f93ecf5c1e
|
YARN-8330. Improved publishing ALLOCATED events to ATS.
Contributed by Suma Shivaprasad
|
2018-07-25 18:49:30 -04:00 |
|
Eric E Payne
|
9485c9aee6
|
YARN-4606. CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps. Contributed by Manikandan R
|
2018-07-25 16:22:04 +00:00 |
|
Weiwei Yang
|
5be9f4a5d0
|
YARN-8546. Resource leak caused by a reserved container being released more than once under async scheduling. Contributed by Tao Yang.
|
2018-07-25 17:35:27 +08:00 |
|
Haibo Chen
|
ea2c6c8c9a
|
YARN-7133. Clean up lock-try order in fair scheduler. (Szilard Nemeth via Haibo Chen)
|
2018-07-24 12:46:59 -07:00 |
|
bibinchundatt
|
e673dd1d4d
|
YARN-8541. RM startup failure on recovery after user deletion. Contributed by Bibin A Chundatt.
|
2018-07-24 23:26:59 +05:30 |
|
Sunil G
|
35ce6eb1f5
|
YARN-7748. TestContainerResizing.testIncreaseContainerUnreservedWhenApplicationCompleted fails due to multiple container fail events. Contributed by Weiwei Yang.
|
2018-07-24 22:20:17 +05:30 |
|
bibinchundatt
|
ff7c2eda34
|
YARN-8548. AllocationRespose proto setNMToken initBuilder not done. Contributed by Bilwa S T.
|
2018-07-24 16:17:20 +05:30 |
|
bibinchundatt
|
8461278833
|
YARN-8544. [DS] AM registration fails when hadoop authorization is enabled. Contributed by Bibin A Chundatt.
|
2018-07-24 13:09:17 +05:30 |
|
Eric Yang
|
8688a0c7f8
|
YARN-8380. Support bind propagation options for mounts in docker runtime.
Contributed by Billie Rinaldi
|
2018-07-23 20:12:04 -04:00 |
|
Haibo Chen
|
9d3c39e9dd
|
YARN-6966. NodeManager metrics may return wrong negative values when NM restart. (Szilard Nemeth via Haibo Chen)
|
2018-07-23 11:07:24 -07:00 |
|
Haibo Chen
|
8a6bb8409c
|
YARN-6964. Fair scheduler misuses Resources operations. (Daniel Templeton and Szilard Nemeth via Haibo Chen)
|
2018-07-20 10:46:28 -07:00 |
|
Weiwei Yang
|
cbf2026483
|
YARN-8528. Final states in ContainerAllocation might be modified externally causing unexpected allocation results. Contributed by Xintong Song.
|
2018-07-20 22:34:06 +08:00 |
|
Haibo Chen
|
e6873dfde0
|
YARN-7300. DiskValidator is not used in LocalDirAllocator. (Szilard Nemeth via Haibo Chen)
|
2018-07-19 16:27:11 -07:00 |
|
Haibo Chen
|
2564884757
|
YARN-8436. FSParentQueue: Comparison method violates its general contract. (Wilfred Spiegelenburg via Haibo Chen)
|
2018-07-19 13:22:31 -07:00 |
|
Eric Yang
|
5836e0a46b
|
YARN-8501. Reduce complexity of RMWebServices getApps method.
Contributed by Szilard Nemeth
|
2018-07-19 12:30:38 -04:00 |
|
Eric Yang
|
efb4e274e5
|
YARN-8538. Fixed memory leaks in container-executor and test cases.
Contributed by Billie Rinaldi
|
2018-07-16 17:38:49 -04:00 |
|
Wangda Tan
|
238ffff999
|
YARN-8524. Single parameter Resource / LightWeightResource constructor looks confusing. (Szilard Nemeth via wangda)
Change-Id: I4ae97548b5b8d76a6bcebb2d3d70bf8e0be3c125
|
2018-07-16 10:58:00 -07:00 |
|
Wangda Tan
|
a2e49f41a8
|
YARN-8361. Change App Name Placement Rule to use App Name instead of App Id for configuration. (Zian Chen via wangda)
Change-Id: I17e5021f8f611a9c5e3bd4b38f25e08585afc6b1
|
2018-07-16 10:57:37 -07:00 |
|
Wangda Tan
|
752dcce5f4
|
YARN-8511. When AM releases a container, RM removes allocation tags before it is released by NM. (Weiwei Yang via wangda)
Change-Id: I6f9f409f2ef685b405cbff547dea9623bf3322d9
|
2018-07-16 10:54:41 -07:00 |
|
Eric E Payne
|
937ef39b3f
|
YARN-8421: when moving app, activeUsers is increased, even though app does not have outstanding request. Contributed by Kyungwan Nam
|
2018-07-16 16:24:21 +00:00 |
|
Akira Ajisaka
|
88625f5cd9
|
HADOOP-15531. Use commons-text instead of commons-lang in some classes to fix deprecation warnings. Contributed by Takanobu Asanuma.
|
2018-07-13 11:42:12 -04:00 |
|
Jason Lowe
|
17118f446c
|
YARN-8515. container-executor can crash with SIGPIPE after nodemanager restart. Contributed by Jim Brennan
|
2018-07-13 10:05:25 -05:00 |
|
Robert Kanter
|
1bc106a738
|
YARN-8518. test-container-executor test_is_empty() is broken (Jim_Brennan via rkanter)
|
2018-07-12 16:38:46 -07:00 |
|
Sunil G
|
7f1d3d0e9d
|
YARN-8512. ATSv2 entities are not published to HBase from second attempt onwards. Contributed by Rohith Sharma K S.
|
2018-07-11 12:26:32 +05:30 |
|
Giovanni Matteo Fumarola
|
82ac3aa6d0
|
YARN-8502. Use path strings consistently for webservice endpoints in RMWebServices. Contributed by Szilard Nemeth.
|
2018-07-10 10:36:17 -07:00 |
|
Sunil G
|
705e2c1f7c
|
YARN-8473. Containers being launched as app tears down can leave containers in NEW state. Contributed by Jason Lowe.
|
2018-07-10 20:11:47 +05:30 |
|
Giovanni Matteo Fumarola
|
ea9b608237
|
YARN-7899. [AMRMProxy] Stateful FederationInterceptor for pending requests. Contributed by Botong Huang.
|
2018-07-09 12:27:36 -07:00 |
|
Robert Kanter
|
0838fe8337
|
Only mount non-empty directories for cgroups (miklos.szegedi@cloudera.com via rkanter)
|
2018-07-09 10:37:20 -07:00 |
|
Rohith Sharma K S
|
ba68320449
|
YARN-8302. ATS v2 should handle HBase connection issue properly. Contributed by Billie Rinaldi.
|
2018-07-06 15:19:01 -07:00 |
|
Sunil G
|
e4bf38cf50
|
YARN-8492. ATSv2 HBase tests are failing with ClassNotFoundException. Contributed by Rohith Sharma K S.
|
2018-07-06 12:05:32 -07:00 |
|
Robert Kanter
|
a129e3e74e
|
YARN-7451. Add missing tests to verify the presence of custom resources of RM apps and scheduler webservice endpoints (snemeth via rkanter)
|
2018-07-06 11:04:00 -07:00 |
|
Haibo Chen
|
9edc74f64a
|
YARN-7556. Fair scheduler configuration should allow resource types in the minResources and maxResources properties. (Daniel Templeton and Szilard Nemeth via Haibo Chen)
|
2018-07-06 11:03:48 -07:00 |
|
Anu Engineer
|
39ad98903a
|
Revert "Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into trunk"
This reverts commit c163d1797a , reversing
changes made to 0d9804dcef .
|
2018-07-05 12:22:18 -07:00 |
|
Giovanni Matteo Fumarola
|
c163d1797a
|
Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into trunk
|
2018-07-05 10:55:05 -07:00 |
|
Giovanni Matteo Fumarola
|
0d9804dcef
|
YARN-8435. Fix NPE when the same client simultaneously contact for the first time Yarn Router. Contributed by Rang Jiaheng.
|
2018-07-05 10:54:31 -07:00 |
|
Robert Kanter
|
99febe7fd5
|
YARN-7451. Add missing tests to verify the presence of custom resources of RM apps and scheduler webservice endpoints (snemeth via rkanter)
|
2018-07-05 10:54:19 -07:00 |
|
Haibo Chen
|
1726247024
|
YARN-7556. Fair scheduler configuration should allow resource types in the minResources and maxResources properties. (Daniel Templeton and Szilard Nemeth via Haibo Chen)
|
2018-07-05 10:42:39 -07:00 |
|
Sunil G
|
51654a3962
|
YARN-8459. Improve Capacity Scheduler logs to debug invalid states. Contributed by Wangda Tan.
|
2018-07-03 09:59:20 -07:00 |
|
Junping Du
|
d9ba6f3656
|
yarn.resourcemanager.fail-fast is used inconsistently. Contributed by Yuanbo Liu.
|
2018-07-03 14:46:44 +08:00 |
|
Sunil G
|
fa9ef15ecd
|
YARN-8415. TimelineWebServices.getEntity should throw ForbiddenException instead of 404 when ACL checks fail. Contributed by Suma Shivaprasad.
|
2018-07-02 15:34:47 -07:00 |
|
Shane Kumpf
|
53e267fa72
|
YARN-8485. Priviledged container app launch is failing intermittently. Contributed by Eric Yang
|
2018-07-02 16:18:32 -06:00 |
|
Eric Yang
|
5cc2541a16
|
YARN-8465. Fixed docker container status for node manager restart.
Contributed by Shane Kumpf
|
2018-07-02 13:37:51 -04:00 |
|
Giovanni Matteo Fumarola
|
cdb084426b
|
YARN-8481. AMRMProxyPolicies should accept heartbeat response from new/unknown subclusters. Contributed by Botong Huang.
|
2018-06-29 11:47:30 -07:00 |
|
Jason Lowe
|
100470140d
|
YARN-8451. Multiple NM heartbeat thread created when a slow NM resync with RM. Contributed by Botong Huang
|
2018-06-29 13:06:28 -05:00 |
|
Sunil G
|
469b29c081
|
YARN-8455. Add basic ACL check for all ATS v2 REST APIs. Contributed by Rohith Sharma K S.
|
2018-06-29 10:02:53 -07:00 |
|
Sunil G
|
291194302c
|
YARN-8379. Improve balancing resources in already satisfied queues by using Capacity Scheduler preemption. Contributed by Zian Chen.
|
2018-06-28 10:23:31 -07:00 |
|
Eric Yang
|
384764cdea
|
YARN-8409. Fixed NPE in ActiveStandbyElectorBasedElectorService.
Contributed by Chandni Singh
|
2018-06-28 12:39:49 -04:00 |
|
Wangda Tan
|
bedc4fe079
|
YARN-8464. Async scheduling thread could be interrupted when there are no NodeManagers in cluster. (Sunil G via wangda)
Change-Id: I4f5f856373378685713e77752ba6cf0988a66065
|
2018-06-26 19:27:17 -07:00 |
|
Wangda Tan
|
ada8f63d0b
|
YARN-8423. GPU does not get released even though the application gets killed. (Sunil G via wangda)
Change-Id: I570db7d60f8c6c21762dd618a9207d1107c486a0
|
2018-06-26 19:25:57 -07:00 |
|
Miklos Szegedi
|
62d83ca536
|
YARN-8461. Support strict memory control on individual container with elastic control memory mechanism. Contributed by Haibo Chen.
|
2018-06-26 15:21:35 -07:00 |
|
Eric Yang
|
b69ba0f330
|
YARN-8108. Added option to disable loading existing filters to prevent
security filter from initialize twice.
Contributed by Sunil Govindan
|
2018-06-26 17:34:57 -04:00 |
|
Miklos Szegedi
|
35ec9401e8
|
YARN-8438. TestContainer.testKillOnNew flaky on trunk. Contributed by Szilard Nemeth.
|
2018-06-25 15:47:54 -07:00 |
|
Weiwei Yang
|
440140cea6
|
YARN-8443. Total #VCores in cluster metrics is wrong when CapacityScheduler reserved some containers. Contributed by Tao Yang.
|
2018-06-25 09:15:31 +08:00 |
|
Eric Yang
|
8a32bc39eb
|
YARN-8326. Removed exit code file check for launched container.
Contributed by Shane Kumpf
|
2018-06-22 19:12:48 -04:00 |
|
Yufei Gu
|
1cdce86d33
|
YARN-8184. Too many metrics if containerLocalizer/ResourceLocalizationService uses ReadWriteDiskValidator. Contributed by Yufei Gu
|
2018-06-22 14:03:55 -07:00 |
|
Inigo Goiri
|
99948565cb
|
YARN-8412. Move ResourceRequest.clone logic everywhere into a proper API. Contributed by Botong Huang.
|
2018-06-21 18:24:10 -07:00 |
|
Miklos Szegedi
|
46f9058164
|
YARN-8441. Typo in CSQueueUtils local variable names: queueGuranteedResource. Contributed by Szilard Nemeth.
|
2018-06-20 11:58:18 -07:00 |
|
Miklos Szegedi
|
9a9e969570
|
YARN-8391. Investigate AllocationFileLoaderService.reloadListener locking issue. Contributed by Szilard Nemeth.
|
2018-06-20 10:59:33 -07:00 |
|
Haibo Chen
|
4939ffedb1
|
YARN-8437. Build oom-listener fails on older versions. (Miklos Szegedi via Haibo Chen)
|
2018-06-20 10:42:13 -07:00 |
|
Dedunu Dhananjaya
|
f386e78a4b
|
YARN-7668. Remove unused variables from ContainerLocalizer
This closes #364
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-06-18 16:45:50 -07:00 |
|
Inigo Goiri
|
b272b71095
|
HADOOP-15537. Clean up ContainerLaunch and ContainerExecutor pre-HADOOP-15528. Contributed by Giovanni Matteo Fumarola.
|
2018-06-15 09:40:45 -07:00 |
|
Rohith Sharma K S
|
9119b3cf8f
|
YARN-8155. Improve ATSv2 client logging in RM and NM publisher. Contributed by Abhishek Modi.
|
2018-06-14 12:38:10 +05:30 |
|
Eric Yang
|
22994889dc
|
YARN-8259. Improve privileged docker container liveliness checks.
Contributed by Shane Kumpf
|
2018-06-13 19:24:31 -04:00 |
|
Sunil G
|
6307962b93
|
YARN-8404. Timeline event publish need to be async to avoid Dispatcher thread leak in case ATS is down. Contributed by Rohith Sharma K S
|
2018-06-13 16:09:16 +05:30 |
|
Weiwei Yang
|
29024a6203
|
YARN-8394. Improve data locality documentation for Capacity Scheduler. Contributed by Weiwei Yang.
|
2018-06-13 09:28:05 +08:00 |
|
Inigo Goiri
|
6e756e8a62
|
HADOOP-15529. ContainerLaunch#testInvalidEnvVariableSubstitutionType is not supported in Windows. Contributed by Giovanni Matteo Fumarola.
|
2018-06-12 10:24:34 -07:00 |
|
Haibo Chen
|
10d0e4be6e
|
YARN-8325. Miscellaneous QueueManager code clean up. (Szilard Nemeth via Haibo Chen)
|
2018-06-12 10:11:30 -07:00 |
|
Haibo Chen
|
24a89825f0
|
YARN-6931. Make the aggregation interval in AppLevelTimelineCollector configurable. (Abhishek Modi via Haibo Chen)
|
2018-06-12 10:03:34 -07:00 |
|
Akira Ajisaka
|
652bcbb3e4
|
YARN-8363. Upgrade commons-lang version to 3.7 in hadoop-yarn-project. Contributed by Takanobu Asanuma.
|
2018-06-13 00:35:37 +09:00 |
|
Rohith Sharma K S
|
2df73dace0
|
YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri.
|
2018-06-12 17:13:09 +05:30 |
|
Inigo Goiri
|
2b2f672022
|
YARN-8370. Some Node Manager tests fail on Windows due to improper path/file separator. Contributed by Anbang Hu.
|
2018-06-11 19:25:56 -07:00 |
|
Haibo Chen
|
180b3c960b
|
YARN-8321. AllocationFileLoaderService.getAllocationFile() should be declared as VisibleForTest. (Szilard Nemeth via Haibo Chen)
|
2018-06-11 11:19:33 -07:00 |
|
Haibo Chen
|
676dcffff5
|
YARN-8322. Change log level when there is an IOException when the allocation file is loaded. (Szilard Nemeth via Haibo Chen)
|
2018-06-11 11:16:21 -07:00 |
|
Haibo Chen
|
c190ac2be8
|
YARN-8323. FairScheduler.allocConf should be declared as volatile. (Szilard Nemeth via Haibo Chen)
|
2018-06-11 11:12:44 -07:00 |
|
Inigo Goiri
|
3b88fe25ba
|
YARN-8359. Exclude containermanager.linux test classes on Windows. Contributed by Jason Lowe.
|
2018-06-07 17:13:03 -07:00 |
|
Robert Kanter
|
351cf87c92
|
Disable mounting cgroups by default (miklos.szegedi@cloudera.com via rkanter)
|
2018-06-07 17:09:34 -07:00 |
|
Miklos Szegedi
|
d5eca1a6a0
|
YARN-6677. Preempt opportunistic containers when root container cgroup goes over memory limit. Contributed by Haibo Chen.
|
2018-06-07 16:38:23 -07:00 |
|
Rohith Sharma K S
|
58bc34f1e3
|
YARN-8399. NodeManager is giving 403 GSS exception post upgrade to 3.1 in secure mode. Contributed by Sunil Govindan.
|
2018-06-07 10:25:56 +05:30 |
|
Robert Kanter
|
0cd145a443
|
YARN-4677. RMNodeResourceUpdateEvent update from scheduler can lead to race condition (wilfreds and gphillips via rkanter)
|
2018-06-04 15:32:03 -07:00 |
|
Haibo Chen
|
04cf699dd5
|
YARN-8388. TestCGroupElasticMemoryController.testNormalExit() hangs on Linux. (Miklos Szegedi via Haibo Chen)
|
2018-06-04 14:23:08 -07:00 |
|
Miklos Szegedi
|
e2c172dc9f
|
YARN-8382. cgroup file leak in NM. Contributed by Hu Ziqian.
|
2018-06-04 10:41:10 -07:00 |
|
Haibo Chen
|
ba12f87dcb
|
YARN-8390. Fix API incompatible changes in FairScheduler's AllocationFileLoaderService. (Gergo Repas via Haibo Chen)
|
2018-06-04 09:15:23 -07:00 |
|
Billie Rinaldi
|
31998643a5
|
YARN-8342. Enable untrusted docker image to run with launch command. Contributed by Eric Yang
|
2018-06-02 14:46:32 -07:00 |
|
Rohith Sharma K S
|
8261f9e571
|
More YARN pages need to honor yarn.resourcemanager.display.per-user-apps(addendum). Contributed by Sunil G.
|
2018-06-02 09:29:06 +05:30 |
|
Haibo Chen
|
4880d890ee
|
YARN-8375. TestCGroupElasticMemoryController fails surefire build. (Miklos Szegedi via Haibo Chen)
|
2018-06-01 16:29:13 -07:00 |
|
Wangda Tan
|
ff583d3fa3
|
YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda)
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
|
2018-06-01 14:49:18 -07:00 |
|
Wangda Tan
|
931f78718f
|
YARN-7962. Race Condition When Stopping DelegationTokenRenewer causes RM crash during failover. (BELUGA BEHR via wangda)
Change-Id: I617e2645f60a57080058ad5f06af860fb3f682c8
|
2018-06-01 14:49:18 -07:00 |
|
Wangda Tan
|
3a6bd77550
|
YARN-8384. stdout.txt, stderr.txt logs of a launched docker container is coming with primary group of submit user instead of hadoop. (Eric Yang via wangda)
Change-Id: Idbb2cd250f4f62dc32993e0d3ca3ec5684616baa
|
2018-06-01 14:49:17 -07:00 |
|
Yufei Gu
|
6b21a599fb
|
YARN-7340. Fix the missing time stamp in exception message in Class
NoOverCommitPolicy. Contributed by Dinesh Chitlangia.
|
2018-05-31 22:30:12 -07:00 |
|
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
6b74f5d7fc
|
YARN-8197. Fixed AM IP Filter and Webapp proxy to redirect app tracking-URLs correctly when UI is secure. Contributed by Sunil Govindan.
|
2018-05-31 16:48:33 -07:00 |
|
Weiwei Yang
|
6468071f13
|
YARN-8367. Fix NPE in SingleConstraintAppPlacementAllocator when placement constraint in SchedulingRequest is null. Contributed by Weiwei Yang.
|
2018-05-31 20:46:39 +08:00 |
|
Eric E Payne
|
e44c0849d7
|
YARN-8377: Javadoc build failed in hadoop-yarn-server-nodemanager. Contributed by Takanobu Asanuma
|
2018-05-30 16:50:19 +00:00 |
|
Eric Yang
|
135941e00d
|
YARN-8362. Bugfix logic in container retries in node manager.
Contributed by Chandni Singh
|
2018-05-29 16:56:58 -04:00 |
|
Jason Lowe
|
4827e9a908
|
YARN-8329. Docker client configuration can still be set incorrectly. Contributed by Shane Kumpf
|
2018-05-29 14:43:17 -05:00 |
|
Wangda Tan
|
17aa40f669
|
YARN-8369. Javadoc build failed due to 'bad use of >'. (Takanobu Asanuma via wangda)
Change-Id: I79a42154e8f86ab1c3cc939b3745024b8eebe5f4
|
2018-05-29 09:27:36 -07:00 |
|
Jason Lowe
|
31ab960f4f
|
YARN-8338. TimelineService V1.5 doesn't come up after HADOOP-15406. Contributed by Vinod Kumar Vavilapalli
|
2018-05-29 11:00:30 -05:00 |
|
Sunil G
|
7c343669ba
|
YARN-4781. Support intra-queue preemption for fairness ordering policy. Contributed by Eric Payne.
|
2018-05-28 16:32:53 +05:30 |
|
Wangda Tan
|
f24c842d52
|
YARN-8213. Add Capacity Scheduler performance metrics. (Weiwei Yang via wangda)
Change-Id: Ieea6f3eeb83c90cd74233fea896f0fcd0f325d5f
|
2018-05-25 21:53:20 -07:00 |
|
Eric E Payne
|
8d5509c681
|
YARN-8292: Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative. Contributed by Wangda Tan.
|
2018-05-25 16:06:09 +00:00 |
|
Haibo Chen
|
86bc6425d4
|
YARN-8191. Fair scheduler: queue deletion without RM restart. (Gergo Repas via Haibo Chen)
|
2018-05-24 17:12:34 -07:00 |
|
Shane Kumpf
|
1388de18ad
|
YARN-6919. Add default volume mount list. Contributed by Eric Badger
|
2018-05-24 09:30:39 -06:00 |
|
Rohith Sharma K S
|
c05b5d424b
|
YARN-8319. More YARN pages need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G.
|
2018-05-24 14:19:46 +05:30 |
|
Haibo Chen
|
d996479954
|
YARN-4599. Set OOM control for memory cgroups. (Miklos Szegedi via Haibo Chen)
|
2018-05-23 16:35:37 -07:00 |
|
Inigo Goiri
|
d72615611c
|
YARN-8348. Incorrect and missing AfterClass in HBase-tests to fix NPE failures. Contributed by Giovanni Matteo Fumarola.
|
2018-05-23 14:43:59 -07:00 |
|
Inigo Goiri
|
e99e5bf104
|
YARN-8344. Missing nm.stop() in TestNodeManagerResync to fix testKillContainersOnResync. Contributed by Giovanni Matteo Fumarola.
|
2018-05-23 14:15:26 -07:00 |
|
Shane Kumpf
|
9837ca9cc7
|
YARN-8285. Remove unused environment variables from the Docker runtime. Contributed by Eric Badger
|
2018-05-23 06:43:44 -06:00 |
|
Robert Kanter
|
b22f56c471
|
YARN-8273. Log aggregation does not warn if HDFS quota in target directory is exceeded (grepas via rkanter)
|
2018-05-22 14:24:38 -07:00 |
|
Wangda Tan
|
bd15d2396e
|
YARN-8290. SystemMetricsPublisher.appACLsUpdated should be invoked after application information is published to ATS to avoid "User is not set in the application report" Exception. (Eric Yang via wangda)
Change-Id: I0ac6ddd19740d1aa7dd07111cd11af71ddc2fcaf
|
2018-05-22 13:33:33 -07:00 |
|
Eric Yang
|
6176d2b35c
|
YARN-7960. Added security flag no-new-privileges for YARN Docker integration.
Contributed by Eric Badger
|
2018-05-22 13:44:58 -04:00 |
|
Jason Lowe
|
5f11288e41
|
YARN-8206. Sending a kill does not immediately kill docker containers. Contributed by Eric Badger
|
2018-05-22 09:27:08 -05:00 |
|
Eric E Payne
|
0b4c44bdee
|
YARN-8179: Preemption does not happen due to natural_termination_factor when DRF is used. Contributed by Kyungwan Nam.
|
2018-05-21 20:14:58 +00:00 |
|
Haibo Chen
|
f48fec83d0
|
YARN-8248. Job hangs when a job requests a resource that its queue does not have. (Szilard Nemeth via Haibo Chen)
|
2018-05-21 08:10:41 -07:00 |
|
Arun Suresh
|
3159bffce2
|
YARN-7900. [AMRMProxy] AMRMClientRelayer for stateful FederationInterceptor. (Botong Huang via asuresh)
|
2018-05-17 20:00:52 -07:00 |
|
Eric Yang
|
d45a0b7d73
|
YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag.
Contributed by Chandni Singh
|
2018-05-17 17:29:34 -04:00 |
|
Jason Lowe
|
be53969047
|
YARN-8071. Add ability to specify nodemanager environment variables individually. Contributed by Jim Brennan
|
2018-05-16 16:17:28 -05:00 |
|
Haibo Chen
|
e3b7d7ac16
|
YARN-7933. [atsv2 read acls] Add TimelineWriter#writeDomain. (Rohith Sharma K S via Haibo Chen)
|
2018-05-16 13:00:01 -07:00 |
|
Jason Lowe
|
d47c09dcb1
|
YARN-8284. get_docker_command refactoring. Contributed by Eric Badger
|
2018-05-16 09:23:49 -05:00 |
|
Weiwei Yang
|
2bb647bb91
|
YARN-8278. DistributedScheduling is not working in HA. Contributed by Bibin A Chundatt.
|
2018-05-15 17:28:19 +08:00 |
|
Haibo Chen
|
2d00a0c71b
|
YARN-8130 Race condition when container events are published for KILLED applications. (Rohith Sharma K S via Haibo Chen)
|
2018-05-14 11:08:42 -07:00 |
|
Eric Yang
|
0ff94563b9
|
YARN-8265. Improve DNS handling on docker IP changes.
Contributed by Billie Rinaldi
|
2018-05-11 22:37:43 -07:00 |
|
Jason Lowe
|
6c8e51ca7e
|
YARN-7654. Support ENTRY_POINT for docker container. Contributed by Eric Yang
|
2018-05-11 18:56:05 -05:00 |
|
Jason Lowe
|
dc912994a1
|
YARN-8244. TestContainerSchedulerQueuing.testStartMultipleContainers failed. Contributed by Jim Brennan
|
2018-05-11 14:07:32 -05:00 |
|
Haibo Chen
|
1f10a36021
|
YARN-8268. Fair scheduler: reservable queue is configured both as parent and leaf queue. (Gergo Repas via Haibo Chen)
|
2018-05-11 11:34:00 -07:00 |
|
Eric Yang
|
8f7912e0fe
|
YARN-8274. Fixed a bug on docker start command.
Contributed by Jason Lowe
|
2018-05-11 14:23:16 -04:00 |
|
Weiwei Yang
|
9db9cd95bd
|
YARN-7003. DRAINING state of queues is not recovered after RM restart. Contributed by Tao Yang.
|
2018-05-11 10:47:04 +08:00 |
|
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
d76fbbc9b8
|
YARN-8249. Fixed few REST APIs in RMWebServices to have static-user check. Contributed by Sunil Govindan.
|
2018-05-10 19:05:35 -07:00 |
|
Haibo Chen
|
6341c3a437
|
YARN-7715. Support NM promotion/demotion of running containers. (Miklos Szegedi via Haibo Chen)
|
2018-05-10 11:01:01 -07:00 |
|
Robert Kanter
|
c8b53c4364
|
YARN-8202. DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation (snemeth via rkanter)
|
2018-05-10 09:31:59 -07:00 |
|
Vrushali C
|
3c95ca4f21
|
YARN-8247 Incorrect HTTP status code returned by ATSv2 for non-whitelisted users. Contributed by Rohith Sharma K S
|
2018-05-09 22:17:48 -07:00 |
|
bibinchundatt
|
cc0310a526
|
YARN-8201. Skip stacktrace of few exception from ClientRMService. Contributed by Bilwa S T.
|
2018-05-10 09:15:46 +05:30 |
|
Eric Yang
|
af4fc2e628
|
YARN-8261. Fixed a bug in creation of localized container directory.
Contributed by Jason Lowe
|
2018-05-09 13:32:51 -04:00 |
|
Rohith Sharma K S
|
eb7b256cc2
|
YARN-8239. [UI2] Clicking on Node Manager UI under AM container info / App Attempt page goes to old RM UI. Contributed by Sunil G.
|
2018-05-09 12:00:43 +05:30 |
|
Jason Lowe
|
a2ea756420
|
YARN-8207. Docker container launch use popen have risk of shell expansion. Contributed by Eric Yang.
|
2018-05-08 15:30:36 -05:00 |
|
Wangda Tan
|
6b96a73bb0
|
YARN-8232. RMContainer lost queue name when RM HA happens. (Hu Ziqian via wangda)
Change-Id: Ia21e1da6871570c993bbedde76ce32929e95970f
|
2018-05-08 11:34:45 -07:00 |
|
Rohith Sharma K S
|
7450583721
|
YARN-8253. HTTPS Ats v2 api call fails with 'bad HTTP parsed'. Contributed by Charan Hebri.
|
2018-05-08 12:28:54 +05:30 |
|
Weiwei Yang
|
67f239c42f
|
YARN-8025. UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty. Contributed by Tao Yang.
|
2018-05-07 11:33:14 +08:00 |
|
Inigo Goiri
|
6a69239d86
|
YARN-8163. Add support for Node Labels in opportunistic scheduling. Contributed by Abhishek Modi.
|
2018-05-04 14:59:59 -07:00 |
|
Eric Yang
|
8cdb032aff
|
YARN-8223. Improved yarn auxiliary service to load jar file from HDFS.
Contributed by Zian Chen
|
2018-05-04 12:36:31 -04:00 |
|
Billie Rinaldi
|
502914ca32
|
YARN-7818. Remove privileged operation warnings during container launch for the ContainerRuntimes. Contributed by Shane Kumpf
|
2018-05-04 08:53:55 -07:00 |
|
Rohith Sharma K S
|
ee2ce923a9
|
YARN-8217. RmAuthenticationFilterInitializer and TimelineAuthenticationFilterInitializer should use Configuration.getPropsWithPrefix instead of iterator. Contributed by Suma Shivaprasad.
|
2018-05-03 14:43:40 +05:30 |
|
Inigo Goiri
|
e6a80e476d
|
YARN-8151. Yarn RM Epoch should wrap around. Contributed by Young Chen.
|
2018-05-02 17:23:17 -07:00 |
|
Eric Yang
|
f4d280f02b
|
YARN-8194. Fixed reinitialization error for LinuxContainerExecutor.
Contributed by Chandni Singh
|
2018-05-02 20:07:19 -04:00 |
|
Eric Yang
|
883f68222a
|
YARN-8209. Fixed NPE in Yarn Service deletion.
Contributed by Eric Badger
|
2018-05-02 14:33:31 -04:00 |
|
Weiwei Yang
|
251f528814
|
YARN-8222. Fix potential NPE when gets RMApp from RM context. Contributed by Tao Yang.
|
2018-05-02 17:54:46 +08:00 |
|
Yiqun Lin
|
3265b55119
|
YARN-6385. Fix checkstyle warnings in TestFileSystemApplicationHistoryStore
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-05-02 18:14:02 +09:00 |
|
Weiwei Yang
|
2d319e3793
|
YARN-8212. Pending backlog for async allocation threads should be configurable. Contributed by Tao Yang.
|
2018-05-01 09:47:10 +08:00 |
|
Eric Yang
|
a966ec6e23
|
YARN-8228. Added hostname length check for docker container.
Contributed by Shane Kumpf
|
2018-04-30 19:12:53 -04:00 |
|
Konstantinos Karanasos
|
9b09555451
|
YARN-8195. Fix constraint cardinality check in the presence of multiple target allocation tags. Contributed by Weiwei Yang.
|
2018-04-30 11:54:30 -07:00 |
|
Wangda Tan
|
92c5331423
|
YARN-8005. Add unit tests for queue priority with dominant resource calculator. (Zian Chen via wangda)
Change-Id: I17a645f20869a1e5d86fa7a325c93fec908b91dc
|
2018-04-27 13:08:43 -07:00 |
|
Rohith Sharma K S
|
ef3ecc308d
|
YARN-8221. RMWebServices also need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G.
|
2018-04-27 22:58:10 +05:30 |
|
Ewan Higgs
|
84ecfe3ceb
|
HADOOP-14188. Remove the usage of org.mockito.internal.util.reflection.Whitebox
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-04-27 19:21:37 +09:00 |
|
Sunil G
|
71220d218d
|
YARN-8004. Add unit tests for inter queue preemption for dominant resource calculator. Contributed by Zian Chen.
|
2018-04-27 10:42:30 +05:30 |
|
Sunil G
|
7fc09c4f72
|
YARN-8215. ATS v2 returns invalid YARN_CONTAINER_ALLOCATED_HOST_HTTP_ADDRESS from NM. Contributed by Rohith Sharma K S.
|
2018-04-27 10:33:42 +05:30 |
|
Sunil G
|
1634de0fc1
|
YARN-8205. Application State is not updated to ATS if AM launching is delayed. Contributed by Rohith Sharma K S.
|
2018-04-27 10:26:57 +05:30 |
|
Wangda Tan
|
2a0fa50f9d
|
YARN-8193. YARN RM hangs abruptly (stops allocating resources) when running successive applications. (Zian Chen via wangda)
Change-Id: Ia83dd2499ee9000b9e09ae5a932f21a13c0ddee6
|
2018-04-26 13:54:40 -07:00 |
|
Sunil G
|
7ac0abdc13
|
YARN-8188. RM Nodes UI data table index for sorting column need to be corrected post Application tags display. Contributed by Weiwei Yang.
|
2018-04-26 13:54:40 -07:00 |
|
Wangda Tan
|
ebedd69e25
|
YARN-8183. Fix ConcurrentModificationException inside RMAppAttemptMetrics#convertAtomicLongMaptoLongMap. (Suma Shivaprasad via wangda)
Change-Id: I347871d672001653a3afe2e99adefd74e0d798cd
|
2018-04-26 13:54:40 -07:00 |
|
Owen O'Malley
|
2adda92de1
|
HDFS-7240 git commit fixup
Signed-off-by: Owen O'Malley <omalley@apache.org>
|
2018-04-26 13:52:17 -07:00 |
|
Anu Engineer
|
4e61bc431e
|
HDFS-13258. Ozone: restructure Hdsl/Ozone code to separated maven subprojects.
Contributed by Elek Marton, Mukul Kumar Singh, Xiaoyu Yao, Ajay Kumar, Anu Engineer, Lokesh Jain, Nanda Kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Robert Kanter
|
7ab08a9c37
|
HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter)
|
2018-04-23 15:44:15 -07:00 |
|
Konstantinos Karanasos
|
28e2244390
|
YARN-8111. Simplify PlacementConstraints API by removing allocationTagToIntraApp. Contributed by Weiwei Yang.
|
2018-04-20 12:24:48 -07:00 |
|
Jason Lowe
|
766544c0b0
|
YARN-7786. NullPointerException while launching ApplicationMaster. Contributed by lujie
|
2018-04-20 13:22:20 -05:00 |
|
Eric Yang
|
85585f9eef
|
YARN-8064. Bugfix for clean up container-executor cmd helper file.
Contributed by Eric Badger
|
2018-04-20 13:49:33 -04:00 |
|
Haibo Chen
|
860cc28a5a
|
YARN-8185. Improve log in DirectoryCollection constructor. (Yufei Gu via Haibo Chen)
|
2018-04-20 07:41:24 -07:00 |
|
Inigo Goiri
|
da5bcf5f7d
|
YARN-8186. [Router] Federation: routing getAppState REST invocations transparently to multiple RMs. Contributed by Giovanni Matteo Fumarola.
|
2018-04-19 16:49:29 -07:00 |
|
Sunil G
|
7d06806dfd
|
YARN-6827. [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart. Contributed by Rohith Sharma K S.
|
2018-04-20 00:05:53 +05:30 |
|
Shashikant Banerjee
|
e4c39f3247
|
HADOOP-15396. Some java source files are executable
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-04-19 08:35:38 +09:00 |
|
Rohith Sharma K S
|
241d985467
|
YARN-8145. yarn rmadmin -getGroups doesn't return updated groups for user. Contributed by Sunil G.
|
2018-04-18 13:39:41 +05:30 |
|
Yufei
|
d426b980ac
|
YARN-7966. Remove method AllocationConfiguration#getQueueAcl and related unit tests. Contributed by Sen Zhao.
|
2018-04-17 22:53:32 -07:00 |
|
Inigo Goiri
|
db1bba857a
|
YARN-8096. Wrong condition in AmIpFilter#getProxyAddresses() to update the proxy IP list. Contributed by Oleksandr Shevchenko.
|
2018-04-17 13:08:01 -07:00 |
|
Haibo Chen
|
bb92bfb4ef
|
YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)
|
2018-04-17 11:15:20 -07:00 |
|
Haibo Chen
|
86dfb70875
|
Revert "YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)"
This reverts commit 0c14b6f0d8 .
|
2018-04-17 06:04:38 -07:00 |
|
Haibo Chen
|
0c14b6f0d8
|
YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)
|
2018-04-17 05:59:03 -07:00 |
|
Inigo Goiri
|
f1461b2487
|
YARN-8164. Fix a potential NPE in AbstractSchedulerPlanFollower. Contributed by lujie.
|
2018-04-16 17:32:19 -07:00 |
|
Inigo Goiri
|
dd5e18c4ae
|
YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan.
|
2018-04-16 16:52:17 -07:00 |
|
Haibo Chen
|
49f9acae40
|
YARN-8162. Remove Method DirectoryCollection#verifyDirUsingMkdir. (Yufei Gu via Haibo Chen)
|
2018-04-16 15:05:04 -07:00 |
|
Wangda Tan
|
896b473f1b
|
YARN-8138. Add unit test to validate queue priority preemption works under node partition. (Zian Chen via wangda)
Change-Id: Ibebfab98a714c12c2dc643b6d7b9754a7f813632
(cherry picked from commit 6ee62e6b1c9b4bc3447ce870446068e626b1a492)
|
2018-04-14 11:08:36 -07:00 |
|
Rohith Sharma K S
|
669eb7bdea
|
YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri.
|
2018-04-14 10:31:28 +05:30 |
|
Weiwei Yang
|
226bedc023
|
YARN-8153. Guaranteed containers always stay in SCHEDULED on NM after restart. Contributed by Yang Wang.
|
2018-04-13 13:17:37 +08:00 |
|
Eric E Payne
|
18844599ae
|
YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe
|
2018-04-12 17:53:57 +00:00 |
|
Eric E Payne
|
6bb128dfb8
|
YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe.
|
2018-04-12 16:04:23 +00:00 |
|
Haibo Chen
|
b8597858b1
|
YARN-7931. [atsv2 read acls] Include domain table creation as part of schema creator. (Vrushali C via Haibo Chen)
|
2018-04-12 06:38:30 -07:00 |
|
Billie Rinaldi
|
933477e9e0
|
YARN-7221. Add security check for privileged docker container. Contributed by Eric Yang
|
2018-04-11 11:24:23 -07:00 |
|
Weiwei Yang
|
7eb783e263
|
YARN-8127. Resource leak when async scheduling is enabled. Contributed by Tao Yang.
|
2018-04-11 17:15:25 +08:00 |
|
Wangda Tan
|
2bf9cc2c73
|
YARN-8116. Nodemanager fails with NumberFormatException: For input string: . (Chandni Singh via wangda)
Change-Id: Idd30cfca59982d3fc6e47aa1b88f844a78fae94d
|
2018-04-10 17:32:38 -07:00 |
|
Eric Yang
|
c467f311d0
|
YARN-7973. Added ContainerRelaunch feature for Docker containers.
Contributed by Shane Kumpf
|
2018-04-10 19:25:00 -04:00 |
|
Jason Lowe
|
907919d28c
|
YARN-7667. Docker Stop grace period should be configurable. Contributed by Eric Badger
|
2018-04-09 17:19:21 -05:00 |
|
Sunil G
|
821b0de4c5
|
YARN-7574. Add support for Node Labels on Auto Created Leaf Queue Template. Contributed by Suma Shivaprasad.
|
2018-04-09 21:17:22 +05:30 |
|
bibinchundatt
|
eb47c3de74
|
YARN-7905. Parent directory permission incorrect during public localization. Contributed by Bilwa S T.
|
2018-04-07 12:26:29 +05:30 |
|
Wangda Tan
|
00ebec89f1
|
YARN-1151. Ability to configure auxiliary services from HDFS-based JAR files. (Xuan Gong via wangda)
Change-Id: Ied37ff11e507fc86847753ba79486652c8fadfe9
|
2018-04-06 21:25:57 -07:00 |
|
Wangda Tan
|
d4e63ccca0
|
YARN-8048. Support auto-spawning of admin configured services during bootstrap of RM (Rohith Sharma K S via wangda)
Change-Id: I2d8d61ccad55e1118009294d7e17822df3cd0fd5
|
2018-04-06 21:24:58 -07:00 |
|
Subru Krishnan
|
00905efab2
|
YARN-8110. AMRMProxy recover should catch for all throwable to avoid premature exit. (Botong Huang via Subru).
|
2018-04-06 16:31:16 -07:00 |
|