Eric Yang
|
7f083ed869
|
YARN-8080. Add restart policy for YARN services.
Contributed by Suma Shivaprasad
|
2018-05-17 17:16:50 -04:00 |
|
Eric Yang
|
7802af6e9a
|
YARN-8293. Removed "User Name for service" for deploying secure YARN service.
Contributed by Sunil G
|
2018-05-17 17:06:58 -04:00 |
|
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
328f0847e3
|
YARN-8128. Documenting the per-node per-app file limit in YARN log aggregation. Contributed by Xuan Gong.
|
2018-05-17 12:47:10 -07:00 |
|
Rohith Sharma K S
|
c95795cd8f
|
YARN-8297. Incorrect ATS Url used for Wire encrypted cluster. Contributed by Sunil G.
|
2018-05-17 16:24:51 +05:30 |
|
Jason Lowe
|
be53969047
|
YARN-8071. Add ability to specify nodemanager environment variables individually. Contributed by Jim Brennan
|
2018-05-16 16:17:28 -05:00 |
|
Haibo Chen
|
e3b7d7ac16
|
YARN-7933. [atsv2 read acls] Add TimelineWriter#writeDomain. (Rohith Sharma K S via Haibo Chen)
|
2018-05-16 13:00:01 -07:00 |
|
Eric Yang
|
91357c22ef
|
YARN-8300. Fixed NPE in DefaultUpgradeComponentsFinder.
Contributed by Suma Shivaprasad
|
2018-05-16 12:38:26 -04:00 |
|
Jason Lowe
|
d47c09dcb1
|
YARN-8284. get_docker_command refactoring. Contributed by Eric Badger
|
2018-05-16 09:23:49 -05:00 |
|
Dinesh Chitlangia
|
0a22860336
|
YARN-8123. Skip compiling old hamlet package when the Java version is 10 or upper
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-05-16 17:25:31 +09:00 |
|
Eric Yang
|
8d3b39de89
|
YARN-8081. Add support to upgrade a component.
Contributed by Chandni Singh
|
2018-05-15 20:40:39 -04:00 |
|
Weiwei Yang
|
2bb647bb91
|
YARN-8278. DistributedScheduling is not working in HA. Contributed by Bibin A Chundatt.
|
2018-05-15 17:28:19 +08:00 |
|
Sunil G
|
58b97c79e3
|
YARN-8236. Invalid kerberos principal file name cause NPE in native service. Contributed by Gour Saha.
|
2018-05-15 12:17:35 +05:30 |
|
Sunil G
|
ffb9210ded
|
YARN-8166. [UI2] Service page header links are broken. Contributed by Yesha Vora.
|
2018-05-15 12:13:04 +05:30 |
|
Sunil G
|
796b2b0ee3
|
YARN-8266. [UI2] Clicking on application from cluster view should redirect to application attempt page. Contributed by Yesha Vora.
|
2018-05-15 12:01:28 +05:30 |
|
Haibo Chen
|
2d00a0c71b
|
YARN-8130 Race condition when container events are published for KILLED applications. (Rohith Sharma K S via Haibo Chen)
|
2018-05-14 11:08:42 -07:00 |
|
Naganarasimha
|
8a2b5914f3
|
YARN-8288. Fix wrong number of table columns in Resource Model doc. Contributed by Weiwei Yang.
|
2018-05-15 00:05:23 +08:00 |
|
Sunil G
|
89d0b87ad3
|
YARN-8271. [UI2] Improve labeling of certain tables. Contributed by Yesha Vora.
|
2018-05-14 20:59:31 +05:30 |
|
Eric Yang
|
0ff94563b9
|
YARN-8265. Improve DNS handling on docker IP changes.
Contributed by Billie Rinaldi
|
2018-05-11 22:37:43 -07:00 |
|
Jason Lowe
|
6c8e51ca7e
|
YARN-7654. Support ENTRY_POINT for docker container. Contributed by Eric Yang
|
2018-05-11 18:56:05 -05:00 |
|
Haibo Chen
|
50408cfc69
|
YARN-3610. FairScheduler: Add steady-fair-shares to the REST API documentation. (Ray Chiang via Haibo Chen)
|
2018-05-11 14:07:55 -07:00 |
|
Billie Rinaldi
|
ca612e353f
|
YARN-8243. Flex down should remove instance with largest component instance ID first. Contributed by Gour Saha
|
2018-05-11 12:49:05 -07:00 |
|
Jason Lowe
|
dc912994a1
|
YARN-8244. TestContainerSchedulerQueuing.testStartMultipleContainers failed. Contributed by Jim Brennan
|
2018-05-11 14:07:32 -05:00 |
|
Haibo Chen
|
1f10a36021
|
YARN-8268. Fair scheduler: reservable queue is configured both as parent and leaf queue. (Gergo Repas via Haibo Chen)
|
2018-05-11 11:34:00 -07:00 |
|
Eric Yang
|
8f7912e0fe
|
YARN-8274. Fixed a bug on docker start command.
Contributed by Jason Lowe
|
2018-05-11 14:23:16 -04:00 |
|
Weiwei Yang
|
9db9cd95bd
|
YARN-7003. DRAINING state of queues is not recovered after RM restart. Contributed by Tao Yang.
|
2018-05-11 10:47:04 +08:00 |
|
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
d76fbbc9b8
|
YARN-8249. Fixed few REST APIs in RMWebServices to have static-user check. Contributed by Sunil Govindan.
|
2018-05-10 19:05:35 -07:00 |
|
Haibo Chen
|
6341c3a437
|
YARN-7715. Support NM promotion/demotion of running containers. (Miklos Szegedi via Haibo Chen)
|
2018-05-10 11:01:01 -07:00 |
|
Robert Kanter
|
c8b53c4364
|
YARN-8202. DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation (snemeth via rkanter)
|
2018-05-10 09:31:59 -07:00 |
|
Vrushali C
|
3c95ca4f21
|
YARN-8247 Incorrect HTTP status code returned by ATSv2 for non-whitelisted users. Contributed by Rohith Sharma K S
|
2018-05-09 22:17:48 -07:00 |
|
bibinchundatt
|
cc0310a526
|
YARN-8201. Skip stacktrace of few exception from ClientRMService. Contributed by Bilwa S T.
|
2018-05-10 09:15:46 +05:30 |
|
Eric Yang
|
af4fc2e628
|
YARN-8261. Fixed a bug in creation of localized container directory.
Contributed by Jason Lowe
|
2018-05-09 13:32:51 -04:00 |
|
Rohith Sharma K S
|
cd68c7cc69
|
YARN-8260. [UI2] Per-application tracking URL is no longer available in YARN UI2. Contributed by Sunil G.
|
2018-05-09 12:17:04 +05:30 |
|
Rohith Sharma K S
|
9acfaee1f0
|
YARN-8264. [UI2] GPU Info tab disappears if we click any sub link under List of Applications or List of Containers. Contributed by Sunil G.
|
2018-05-09 12:04:31 +05:30 |
|
Rohith Sharma K S
|
eb7b256cc2
|
YARN-8239. [UI2] Clicking on Node Manager UI under AM container info / App Attempt page goes to old RM UI. Contributed by Sunil G.
|
2018-05-09 12:00:43 +05:30 |
|
Billie Rinaldi
|
1ef0a1db1d
|
YARN-7894. Improve ATS response for DShell DS_CONTAINER when container launch fails. Contributed by Chandni Singh
|
2018-05-08 13:49:41 -07:00 |
|
Jason Lowe
|
a2ea756420
|
YARN-8207. Docker container launch use popen have risk of shell expansion. Contributed by Eric Yang.
|
2018-05-08 15:30:36 -05:00 |
|
Wangda Tan
|
6b96a73bb0
|
YARN-8232. RMContainer lost queue name when RM HA happens. (Hu Ziqian via wangda)
Change-Id: Ia21e1da6871570c993bbedde76ce32929e95970f
|
2018-05-08 11:34:45 -07:00 |
|
Rohith Sharma K S
|
7450583721
|
YARN-8253. HTTPS Ats v2 api call fails with 'bad HTTP parsed'. Contributed by Charan Hebri.
|
2018-05-08 12:28:54 +05:30 |
|
Sunil G
|
2916c90500
|
YARN-8251. [UI2] Clicking on Application link at the header goes to Diagnostics Tab instead of AppAttempt Tab. Contributed by Yesha Vora.
|
2018-05-08 11:37:03 +05:30 |
|
Sunil G
|
9832265e1d
|
YARN-5151. [UI2] Support kill application from new YARN UI. Contributed by Gergely Novák.
|
2018-05-08 10:35:19 +05:30 |
|
Weiwei Yang
|
67f239c42f
|
YARN-8025. UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty. Contributed by Tao Yang.
|
2018-05-07 11:33:14 +08:00 |
|
Inigo Goiri
|
6a69239d86
|
YARN-8163. Add support for Node Labels in opportunistic scheduling. Contributed by Abhishek Modi.
|
2018-05-04 14:59:59 -07:00 |
|
Eric Yang
|
8cdb032aff
|
YARN-8223. Improved yarn auxiliary service to load jar file from HDFS.
Contributed by Zian Chen
|
2018-05-04 12:36:31 -04:00 |
|
Billie Rinaldi
|
6795f8072f
|
YARN-8079. Support static and archive unmodified local resources in service AM. Contributed by Suma Shivaprasad
|
2018-05-04 09:27:07 -07:00 |
|
Billie Rinaldi
|
502914ca32
|
YARN-7818. Remove privileged operation warnings during container launch for the ContainerRuntimes. Contributed by Shane Kumpf
|
2018-05-04 08:53:55 -07:00 |
|
Eric Yang
|
7698737207
|
YARN-8226. Improved anti-affinity description in YARN Service doc.
Contributed by Gour Saha
|
2018-05-03 13:35:40 -04:00 |
|
Eric Yang
|
7fe3214d4b
|
YARN-7961. Improve status message for YARN service.
Contributed by Gour Saha
|
2018-05-03 13:27:07 -04:00 |
|
Rohith Sharma K S
|
ee2ce923a9
|
YARN-8217. RmAuthenticationFilterInitializer and TimelineAuthenticationFilterInitializer should use Configuration.getPropsWithPrefix instead of iterator. Contributed by Suma Shivaprasad.
|
2018-05-03 14:43:40 +05:30 |
|
Inigo Goiri
|
e6a80e476d
|
YARN-8151. Yarn RM Epoch should wrap around. Contributed by Young Chen.
|
2018-05-02 17:23:17 -07:00 |
|
Eric Yang
|
f4d280f02b
|
YARN-8194. Fixed reinitialization error for LinuxContainerExecutor.
Contributed by Chandni Singh
|
2018-05-02 20:07:19 -04:00 |
|
Konstantinos Karanasos
|
3b34fca4b5
|
YARN-8113. Update placement constraints doc with application namespaces and inter-app constraints. Contributed by Weiwei Yang.
|
2018-05-02 11:49:56 -07:00 |
|
Eric Yang
|
883f68222a
|
YARN-8209. Fixed NPE in Yarn Service deletion.
Contributed by Eric Badger
|
2018-05-02 14:33:31 -04:00 |
|
Weiwei Yang
|
251f528814
|
YARN-8222. Fix potential NPE when gets RMApp from RM context. Contributed by Tao Yang.
|
2018-05-02 17:54:46 +08:00 |
|
Yiqun Lin
|
3265b55119
|
YARN-6385. Fix checkstyle warnings in TestFileSystemApplicationHistoryStore
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-05-02 18:14:02 +09:00 |
|
Eric Yang
|
24eeea8b18
|
YARN-7799. Improved YARN service jar file handling.
Contributed by Billie Rinaldi
|
2018-05-01 16:46:34 -04:00 |
|
Billie Rinaldi
|
4e1382aca4
|
YARN-2674. Fix distributed shell AM container relaunch during RM work preserving restart. Contributed by Shane Kumpf
|
2018-05-01 07:27:47 -07:00 |
|
Sunil G
|
d6139c5106
|
YARN-8187. [UI2] Individual Node page does not contain breadcrumb trail. Contributed by Zian Chen.
|
2018-05-01 14:01:34 +05:30 |
|
Weiwei Yang
|
2d319e3793
|
YARN-8212. Pending backlog for async allocation threads should be configurable. Contributed by Tao Yang.
|
2018-05-01 09:47:10 +08:00 |
|
Eric Yang
|
a966ec6e23
|
YARN-8228. Added hostname length check for docker container.
Contributed by Shane Kumpf
|
2018-04-30 19:12:53 -04:00 |
|
Konstantinos Karanasos
|
9b09555451
|
YARN-8195. Fix constraint cardinality check in the presence of multiple target allocation tags. Contributed by Weiwei Yang.
|
2018-04-30 11:54:30 -07:00 |
|
Weiwei Yang
|
2c95eb8111
|
YARN-8225. YARN precommit build failing in TestPlacementConstraintTransformations. Contributed by Shane Kumpf.
|
2018-04-28 17:37:37 +08:00 |
|
Wangda Tan
|
92c5331423
|
YARN-8005. Add unit tests for queue priority with dominant resource calculator. (Zian Chen via wangda)
Change-Id: I17a645f20869a1e5d86fa7a325c93fec908b91dc
|
2018-04-27 13:08:43 -07:00 |
|
Wangda Tan
|
b1833d9ba2
|
YARN-8210. AMRMClient logging on every heartbeat to track updation of AM RM token causes too many log lines to be generated in AM logs. (Suma Shivaprasad via wangda)
Change-Id: I70edd6e301fd5e78d479e1882aedc9332a0827aa
|
2018-04-27 13:07:38 -07:00 |
|
Rohith Sharma K S
|
ef3ecc308d
|
YARN-8221. RMWebServices also need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G.
|
2018-04-27 22:58:10 +05:30 |
|
Eric Yang
|
24a5ccbf4b
|
YARN-7781. Update YARN service documentation.
Contributed by Gour Saha
|
2018-04-27 12:38:30 -04:00 |
|
Eric Yang
|
14b47990af
|
YARN-8204. Added a flag to disable YARN service upgrade.
Contributed by Chandni Singh
|
2018-04-27 12:24:43 -04:00 |
|
Billie Rinaldi
|
9ab3f97089
|
YARN-8211. Yarn registry dns log finds BufferUnderflowException on port ping. Contributed by Eric Yang
|
2018-04-27 07:58:43 -07:00 |
|
Billie Rinaldi
|
914d6b5cb1
|
YARN-8208. Add log statement for Docker client configuration file at INFO level. Contributed by Yesha Vora
|
2018-04-27 06:10:32 -07:00 |
|
Ewan Higgs
|
84ecfe3ceb
|
HADOOP-14188. Remove the usage of org.mockito.internal.util.reflection.Whitebox
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-04-27 19:21:37 +09:00 |
|
Sunil G
|
71220d218d
|
YARN-8004. Add unit tests for inter queue preemption for dominant resource calculator. Contributed by Zian Chen.
|
2018-04-27 10:42:30 +05:30 |
|
Sunil G
|
7fc09c4f72
|
YARN-8215. ATS v2 returns invalid YARN_CONTAINER_ALLOCATED_HOST_HTTP_ADDRESS from NM. Contributed by Rohith Sharma K S.
|
2018-04-27 10:33:42 +05:30 |
|
Sunil G
|
1634de0fc1
|
YARN-8205. Application State is not updated to ATS if AM launching is delayed. Contributed by Rohith Sharma K S.
|
2018-04-27 10:26:57 +05:30 |
|
Eric Yang
|
93979db840
|
YARN-8122. Added component health monitoring for YARN service.
Contributed by Gour Saha
|
2018-04-26 19:17:32 -04:00 |
|
Billie Rinaldi
|
598483e496
|
YARN-8140. Improve log message when launch cmd is ran for stopped yarn service. Contributed by Eric Yang
|
2018-04-26 13:54:40 -07:00 |
|
Eric Yang
|
4a7369b095
|
YARN-7939. Added support to upgrade a component instance.
Contributed by Chandni Singh
|
2018-04-26 13:54:40 -07:00 |
|
Wangda Tan
|
2a0fa50f9d
|
YARN-8193. YARN RM hangs abruptly (stops allocating resources) when running successive applications. (Zian Chen via wangda)
Change-Id: Ia83dd2499ee9000b9e09ae5a932f21a13c0ddee6
|
2018-04-26 13:54:40 -07:00 |
|
Sunil G
|
7ac0abdc13
|
YARN-8188. RM Nodes UI data table index for sorting column need to be corrected post Application tags display. Contributed by Weiwei Yang.
|
2018-04-26 13:54:40 -07:00 |
|
Wangda Tan
|
ebedd69e25
|
YARN-8183. Fix ConcurrentModificationException inside RMAppAttemptMetrics#convertAtomicLongMaptoLongMap. (Suma Shivaprasad via wangda)
Change-Id: I347871d672001653a3afe2e99adefd74e0d798cd
|
2018-04-26 13:54:40 -07:00 |
|
Eric Yang
|
3b1dad9123
|
YARN-8196. Updated documentation for enabling YARN Service REST API.
Contributed by Billie Rinaldi
|
2018-04-26 13:54:40 -07:00 |
|
Owen O'Malley
|
2adda92de1
|
HDFS-7240 git commit fixup
Signed-off-by: Owen O'Malley <omalley@apache.org>
|
2018-04-26 13:52:17 -07:00 |
|
Anu Engineer
|
4e61bc431e
|
HDFS-13258. Ozone: restructure Hdsl/Ozone code to separated maven subprojects.
Contributed by Elek Marton, Mukul Kumar Singh, Xiaoyu Yao, Ajay Kumar, Anu Engineer, Lokesh Jain, Nanda Kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Junping Du
|
56788d759f
|
YARN-7598. Document how to use classpath isolation for aux-services in YARN. Contributed by Xuan Gong.
|
2018-04-24 18:29:14 +08:00 |
|
Robert Kanter
|
7ab08a9c37
|
HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter)
|
2018-04-23 15:44:15 -07:00 |
|
Sunil G
|
83e5f25d5e
|
YARN-8177. Documentation changes for auto creation of Leaf Queues with node label. Contributed by Suma Shivaprasad.
|
2018-04-23 13:36:27 +05:30 |
|
Sunil G
|
b6d94fad08
|
YARN-7956. [UI2] Avoid duplicating Components link under Services/<ServiceName>/Components. Contributed by Yesha Vora.
|
2018-04-23 13:32:09 +05:30 |
|
Konstantinos Karanasos
|
28e2244390
|
YARN-8111. Simplify PlacementConstraints API by removing allocationTagToIntraApp. Contributed by Weiwei Yang.
|
2018-04-20 12:24:48 -07:00 |
|
Jason Lowe
|
766544c0b0
|
YARN-7786. NullPointerException while launching ApplicationMaster. Contributed by lujie
|
2018-04-20 13:22:20 -05:00 |
|
Eric Yang
|
85585f9eef
|
YARN-8064. Bugfix for clean up container-executor cmd helper file.
Contributed by Eric Badger
|
2018-04-20 13:49:33 -04:00 |
|
Sunil G
|
7fd878813b
|
Revert "YARN-7956. [UI2] Avoid duplicating Components link under Services/<ServiceName>/Components. Contributed by Yesha Vora."
This reverts commit a11ce19f47 .
|
2018-04-20 22:33:54 +05:30 |
|
Sunil G
|
a11ce19f47
|
YARN-7956. [UI2] Avoid duplicating Components link under Services/<ServiceName>/Components. Contributed by Yesha Vora.
|
2018-04-20 22:28:36 +05:30 |
|
Haibo Chen
|
860cc28a5a
|
YARN-8185. Improve log in DirectoryCollection constructor. (Yufei Gu via Haibo Chen)
|
2018-04-20 07:41:24 -07:00 |
|
Sunil G
|
55e4252fc5
|
YARN-7830. [UI2] Post selecting grid view in Attempt page, attempt info page should also be opened with grid view. Contributed by Gergely Novák.
|
2018-04-20 20:05:05 +05:30 |
|
Rohith Sharma K S
|
b0753cc2c0
|
YARN-8189. [UI2] Nodes page column headers are half truncated. Contributed by Sunil G.
|
2018-04-20 19:36:26 +05:30 |
|
Rohith Sharma K S
|
87e09859f1
|
YARN-8182. [UI2] Proxy- Clicking on nodes under Nodes HeatMap gives 401 error. Contributed by Sunil G.
|
2018-04-20 19:35:17 +05:30 |
|
Inigo Goiri
|
da5bcf5f7d
|
YARN-8186. [Router] Federation: routing getAppState REST invocations transparently to multiple RMs. Contributed by Giovanni Matteo Fumarola.
|
2018-04-19 16:49:29 -07:00 |
|
Sunil G
|
7d06806dfd
|
YARN-6827. [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart. Contributed by Rohith Sharma K S.
|
2018-04-20 00:05:53 +05:30 |
|
Sunil G
|
c6d7d3eb05
|
YARN-5888. [UI2] Improve unit tests for new YARN UI. Contributed by Akhil PB.
|
2018-04-19 21:37:35 +05:30 |
|
BELUGA BEHR
|
351e509a47
|
YARN-8169. Cleanup RackResolver.java
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-04-19 16:07:14 +09:00 |
|
Shashikant Banerjee
|
e4c39f3247
|
HADOOP-15396. Some java source files are executable
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-04-19 08:35:38 +09:00 |
|
Rohith Sharma K S
|
034da8fc97
|
YARN-8171. [UI2] AM Node link from attempt page should not redirect to new tab. Contributed by Sunil G.
|
2018-04-18 13:39:41 +05:30 |
|
Rohith Sharma K S
|
241d985467
|
YARN-8145. yarn rmadmin -getGroups doesn't return updated groups for user. Contributed by Sunil G.
|
2018-04-18 13:39:41 +05:30 |
|
Yufei
|
d426b980ac
|
YARN-7966. Remove method AllocationConfiguration#getQueueAcl and related unit tests. Contributed by Sen Zhao.
|
2018-04-17 22:53:32 -07:00 |
|
Inigo Goiri
|
db1bba857a
|
YARN-8096. Wrong condition in AmIpFilter#getProxyAddresses() to update the proxy IP list. Contributed by Oleksandr Shevchenko.
|
2018-04-17 13:08:01 -07:00 |
|
Haibo Chen
|
bb92bfb4ef
|
YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)
|
2018-04-17 11:15:20 -07:00 |
|
Jason Lowe
|
1d6e43da51
|
YARN-7996. Allow user supplied Docker client configurations with YARN native services. Contributed by Shane Kumpf
|
2018-04-17 08:57:31 -05:00 |
|
Haibo Chen
|
86dfb70875
|
Revert "YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)"
This reverts commit 0c14b6f0d8 .
|
2018-04-17 06:04:38 -07:00 |
|
Haibo Chen
|
0c14b6f0d8
|
YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)
|
2018-04-17 05:59:03 -07:00 |
|
Sunil G
|
427ad7ecc4
|
YARN-8126. Support auto-spawning of admin configured services during bootstrap of RM. Contributed by Rohith Sharma K S.
|
2018-04-17 15:08:31 +05:30 |
|
Inigo Goiri
|
f1461b2487
|
YARN-8164. Fix a potential NPE in AbstractSchedulerPlanFollower. Contributed by lujie.
|
2018-04-16 17:32:19 -07:00 |
|
Inigo Goiri
|
dd5e18c4ae
|
YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan.
|
2018-04-16 16:52:17 -07:00 |
|
Inigo Goiri
|
60e5c1b516
|
YARN-7773. YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'. Contributed by Yiran Wu.
|
2018-04-16 16:26:54 -07:00 |
|
Haibo Chen
|
49f9acae40
|
YARN-8162. Remove Method DirectoryCollection#verifyDirUsingMkdir. (Yufei Gu via Haibo Chen)
|
2018-04-16 15:05:04 -07:00 |
|
Eric Yang
|
2d0662cfd5
|
YARN-8060. Added default readiness check for service components.
Contributed by Billie Rinaldi
|
2018-04-16 14:24:26 -04:00 |
|
Wangda Tan
|
896b473f1b
|
YARN-8138. Add unit test to validate queue priority preemption works under node partition. (Zian Chen via wangda)
Change-Id: Ibebfab98a714c12c2dc643b6d7b9754a7f813632
(cherry picked from commit 6ee62e6b1c9b4bc3447ce870446068e626b1a492)
|
2018-04-14 11:08:36 -07:00 |
|
Rohith Sharma K S
|
669eb7bdea
|
YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri.
|
2018-04-14 10:31:28 +05:30 |
|
Eric Yang
|
9031a76d44
|
YARN-8142. Improve SIGTERM handling for YARN Service Application Master.
Contributed by Billie Rinaldi
|
2018-04-13 15:34:33 -04:00 |
|
Weiwei Yang
|
226bedc023
|
YARN-8153. Guaranteed containers always stay in SCHEDULED on NM after restart. Contributed by Yang Wang.
|
2018-04-13 13:17:37 +08:00 |
|
Weiwei Yang
|
375654c36a
|
YARN-8154. Fix missing titles in PlacementConstraints document. Contributed by Weiwei Yang.
|
2018-04-13 13:06:47 +08:00 |
|
Billie Rinaldi
|
53b3e59473
|
YARN-7936. Add default service AM Xmx. Contributed by Jian He
|
2018-04-12 12:38:00 -07:00 |
|
Eric E Payne
|
18844599ae
|
YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe
|
2018-04-12 17:53:57 +00:00 |
|
Jason Lowe
|
4571351ccc
|
MAPREDUCE-7069. Add ability to specify user environment variables individually. Contributed by Jim Brennan
|
2018-04-12 11:12:46 -05:00 |
|
Eric E Payne
|
6bb128dfb8
|
YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe.
|
2018-04-12 16:04:23 +00:00 |
|
Haibo Chen
|
b8597858b1
|
YARN-7931. [atsv2 read acls] Include domain table creation as part of schema creator. (Vrushali C via Haibo Chen)
|
2018-04-12 06:38:30 -07:00 |
|
Billie Rinaldi
|
933477e9e0
|
YARN-7221. Add security check for privileged docker container. Contributed by Eric Yang
|
2018-04-11 11:24:23 -07:00 |
|
Weiwei Yang
|
7eb783e263
|
YARN-8127. Resource leak when async scheduling is enabled. Contributed by Tao Yang.
|
2018-04-11 17:15:25 +08:00 |
|
Rohith Sharma K S
|
c048711099
|
YARN-7941. Transitive dependencies for component are not resolved. Contributed by Billie Rinaldi.
|
2018-04-11 09:18:50 +05:30 |
|
Wangda Tan
|
d919eb6efa
|
YARN-8133. Doc link broken for yarn-service from overview page. (Rohith Sharma K S via wangda)
Change-Id: Iacf9a004585dd59e1c0cd8f8c618a38f047cc0fe
|
2018-04-10 17:33:15 -07:00 |
|
Wangda Tan
|
2bf9cc2c73
|
YARN-8116. Nodemanager fails with NumberFormatException: For input string: . (Chandni Singh via wangda)
Change-Id: Idd30cfca59982d3fc6e47aa1b88f844a78fae94d
|
2018-04-10 17:32:38 -07:00 |
|
Eric Yang
|
c467f311d0
|
YARN-7973. Added ContainerRelaunch feature for Docker containers.
Contributed by Shane Kumpf
|
2018-04-10 19:25:00 -04:00 |
|
Eric Yang
|
d553799030
|
YARN-7984. Improved YARN service stop/destroy and clean up.
Contributed by Billie Rinaldi
|
2018-04-10 17:40:49 -04:00 |
|
Sunil G
|
7c1e77dda4
|
YARN-7804. [UI2] Refresh action on Grid view page should not be redirected to graph view. Contributed by Gergely Novák.
|
2018-04-10 16:09:09 +05:30 |
|
Jason Lowe
|
907919d28c
|
YARN-7667. Docker Stop grace period should be configurable. Contributed by Eric Badger
|
2018-04-09 17:19:21 -05:00 |
|
Sunil G
|
821b0de4c5
|
YARN-7574. Add support for Node Labels on Auto Created Leaf Queue Template. Contributed by Suma Shivaprasad.
|
2018-04-09 21:17:22 +05:30 |
|
bibinchundatt
|
eb47c3de74
|
YARN-7905. Parent directory permission incorrect during public localization. Contributed by Bilwa S T.
|
2018-04-07 12:26:29 +05:30 |
|
Wangda Tan
|
00ebec89f1
|
YARN-1151. Ability to configure auxiliary services from HDFS-based JAR files. (Xuan Gong via wangda)
Change-Id: Ied37ff11e507fc86847753ba79486652c8fadfe9
|
2018-04-06 21:25:57 -07:00 |
|
Wangda Tan
|
d4e63ccca0
|
YARN-8048. Support auto-spawning of admin configured services during bootstrap of RM (Rohith Sharma K S via wangda)
Change-Id: I2d8d61ccad55e1118009294d7e17822df3cd0fd5
|
2018-04-06 21:24:58 -07:00 |
|
Subru Krishnan
|
00905efab2
|
YARN-8110. AMRMProxy recover should catch for all throwable to avoid premature exit. (Botong Huang via Subru).
|
2018-04-06 16:31:16 -07:00 |
|
Haibo Chen
|
024d7c0870
|
YARN-8107. Give an informative message when incorrect format is used in ATSv2 filter attributes. (Rohith Sharma K S via Haibo Chen)
|
2018-04-06 09:39:01 -07:00 |
|
Sunil G
|
b17dc9f5f5
|
YARN-8083. [UI2] All YARN related configurations are paged together in conf page. Contributed by Gergely Novák.
|
2018-04-06 21:53:14 +05:30 |
|
Wangda Tan
|
6cf023f9b7
|
Added CHANGES/RELEASES/Jdiff for 3.1.0 release
Change-Id: Ied5067a996151c04d15cad46c46ac98b60c37b39
(cherry picked from commit 2d96570452a72569befdf9cfe9b90c9fa2e0e261)
|
2018-04-05 15:52:39 -07:00 |
|
Rohith Sharma K S
|
f32d6275ba
|
YARN-8119. [UI2] Timeline Server address' url scheme should be removed while accessing via KNOX. Contributed by Sunil G.
|
2018-04-05 23:32:35 +05:30 |
|
Haibo Chen
|
f8b8bd53c4
|
YARN-6936. [Atsv2] Retrospect storing entities into sub application table from client perspective. (Rohith Sharma K S via Haibo Chen)
|
2018-04-05 10:23:42 -07:00 |
|
Vrushali C
|
345e7624d5
|
YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S
|
2018-04-04 15:08:03 -07:00 |
|
Haibo Chen
|
3087e89135
|
YARN-7946. Update TimelineServerV2 doc as per YARN-7919. (Haibo Chen)
|
2018-04-04 11:59:31 -07:00 |
|
Konstantinos Karanasos
|
7853ec8d2f
|
YARN-8013. Support application tags when defining application namespaces for placement constraints. Contributed by Weiwei Yang.
|
2018-04-04 10:51:58 -07:00 |
|
Sunil G
|
42cd367c93
|
YARN-8115. [UI2] URL data like nodeHTTPAddress must be encoded in UI before using to access NM. Contributed by Sreenath Somarajapuram.
|
2018-04-04 22:13:14 +05:30 |
|
Wangda Tan
|
b779f4f0f6
|
YARN-8106. Update LogAggregationIndexedFileController to use readFull instead read to avoid IOException while loading log meta. (Prabhu Joseph via wangda)
Change-Id: I63a65f73f8d1636e2c99ed9c8c2bbd05efcff80f
|
2018-04-03 21:06:24 -07:00 |
|
Sunil G
|
f7a17b029d
|
YARN-7764. Findbugs warning: Resource#getResources may expose internal representation. Contributed by Weiwei Yang.
|
2018-04-04 09:22:35 +05:30 |
|
Miklos Szegedi
|
2d06d885c8
|
YARN-8035. Uncaught exception in ContainersMonitorImpl during relaunch due to the process ID changing. Contributed by Shane Kumpf.
|
2018-04-03 10:01:00 -07:00 |
|
Haibo Chen
|
93d47a0ed5
|
YARN-8051. TestRMEmbeddedElector#testCallbackSynchronization is flaky. (Robert Kanter via Haibo Chen)
|
2018-04-03 07:59:20 -07:00 |
|
Wangda Tan
|
c78cb18c61
|
YARN-8091. Revisit checkUserAccessToQueue RM REST API. (wangda)
Change-Id: I5fab3fe229c34e967487b7327c7b3c8ddf7cb795
|
2018-04-02 15:22:05 -07:00 |
|
Jason Lowe
|
54a81211ea
|
YARN-8082. Include LocalizedResource size information in the NM download log for localization. Contributed by Kuhu Shukla
|
2018-04-02 10:38:13 -05:00 |
|
Wangda Tan
|
a0bde7d525
|
YARN-7142. Support placement policy in yarn native services. (Gour Saha via wangda)
Change-Id: I166c67a7a34430627c17365f60bac75b6da1b434
|
2018-04-02 07:26:01 -07:00 |
|
Weiwei Yang
|
1606dad133
|
YARN-7497. Add file system based scheduler configuration store. Contributed by Jiandan Yang.
|
2018-03-30 21:41:33 +08:00 |
|
Wangda Tan
|
e7e20190df
|
YARN-8086. ManagedParentQueue with no leaf queues cause JS error in new UI. (Suma Shivaprasad via wangda)
Change-Id: I6d82af91adec02698afddde6883b1fe1924e6041
|
2018-03-29 15:03:31 -07:00 |
|
Eric Yang
|
8fb00c3fce
|
YARN-6257. Fix CapacityScheduler REST API JSON output.
Contributed By Tao Yang
|
2018-03-29 17:36:34 -04:00 |
|
Sunil G
|
7a59d60e0c
|
YARN-8085. ResourceProfilesManager should be set in RMActiveServiceContext. Contributed by Tao Yang.
|
2018-03-29 21:41:16 +05:30 |
|
Sunil G
|
431076f637
|
YARN-8076. Support to specify application tags in distributed shell. Contributed by Weiwei Yang.
|
2018-03-29 15:55:39 +05:30 |
|
Eric Yang
|
3d185d62fc
|
YARN-8069. Clean up example hostnames for RegistryDNS.
Contributed by Billie Rinaldi
|
2018-03-28 20:17:37 -04:00 |
|
Zhe Zhang
|
0b1c2b5fe1
|
YARN-7623. Fix the CapacityScheduler Queue configuration documentation. Contributed by Jonathan Hung.
|
2018-03-28 11:41:20 -07:00 |
|
Subru Krishnan
|
09999d7e01
|
YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru).
|
2018-03-28 11:33:19 -07:00 |
|
Subru Krishnan
|
725b10e3ae
|
Revert "YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru)."
This reverts commit 2a2ef15caf as smart-apply-patch script didn't pick the latest patch.
|
2018-03-28 11:26:50 -07:00 |
|
Wangda Tan
|
47f711eebc
|
YARN-6629. NPE occurred when container allocation proposal is applied but its resource requests are removed before. (Tao Yang via wangda)
Change-Id: I805880f90b3f6798ec96ed8e8e75755f390a9ad5
|
2018-03-28 11:07:45 -07:00 |
|
Miklos Szegedi
|
cdee0a4f84
|
YARN-8077. The vmemLimit parameter in ContainersMonitorImpl#isProcessTreeOverLimit is confusing. Contributed by Sen Zhao.
|
2018-03-28 09:05:25 -07:00 |
|
Weiwei Yang
|
411993f6e5
|
YARN-7734. Fix UT failure TestContainerLogsPage#testContainerLogPageAccess. Contributed by Tao Yang.
|
2018-03-28 17:35:38 +08:00 |
|
Sunil G
|
d1e378d02b
|
YARN-8075. DShell does not fail when we ask more GPUs than available even though AM throws 'InvalidResourceRequestException'. Contributed by Wangda Tan.
|
2018-03-28 08:03:18 +05:30 |
|
Subru Krishnan
|
2a2ef15caf
|
YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru).
|
2018-03-27 17:39:46 -07:00 |
|
Eric Yang
|
27d60a1634
|
YARN-8018. Added support for initiating yarn service upgrade.
Contributed by Chandni Singh
|
2018-03-26 18:46:31 -04:00 |
|
Sean Mackrory
|
82665a7887
|
HADOOP-15299. Bump Jackson 2 version to Jackson 2.9.x.
|
2018-03-26 14:05:15 -06:00 |
|
Wangda Tan
|
24bc5e0e4d
|
YARN-8072. RM log is getting flooded with MemoryPlacementConstraintManager info logs. (Zian Chen via wangda)
Change-Id: I2567f4669ad868e13c4301fe44c4bde85bb92c37
|
2018-03-26 11:20:16 -07:00 |
|
Wangda Tan
|
9eef19b2ad
|
YARN-8068. Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+ (Sunil G via wangda)
Change-Id: I7910bd1064a1b4dbbe2084080c060822ea6f3b48
|
2018-03-26 11:19:15 -07:00 |
|
Wangda Tan
|
5d381570f8
|
YARN-8062. yarn rmadmin -getGroups returns group from which the user has been removed. (Sunil G via wangda)
Change-Id: I80ed63846502bf7751b890b6c6c6a7c0679e2b4a
|
2018-03-26 11:16:06 -07:00 |
|
Eric Yang
|
e6b74164e9
|
YARN-8043. Added the exception message for failed launches running under LCE.
Contributed by Shane Kumpf
|
2018-03-26 13:21:35 -04:00 |
|
Wangda Tan
|
24f75e097a
|
YARN-8070. Yarn Service API site doc broken due to unwanted character in YarnServiceAPI.md (Gour Saha via wangda)
Change-Id: I22428b2f128d16e79ebbdeaf32869566963d0c6f
|
2018-03-23 16:44:44 -07:00 |
|
Wangda Tan
|
a90471b3e6
|
YARN-8016. Refine PlacementRule interface and add a app-name queue mapping rule as an example. (Zian Chen via wangda)
Change-Id: I35caf1480e0f76f5f3a53528af09312e39414bbb
|
2018-03-23 16:43:40 -07:00 |
|
Eric Yang
|
647058efc0
|
YARN-8032. Added ability to configure failure validity interval for YARN service.
Contributed by Chandni Singh
|
2018-03-23 15:54:52 -04:00 |
|
Rohith Sharma K S
|
75fc05f369
|
YARN-7986. ATSv2 REST API queries do not return results for uppercase application tags. Contributed by Charan Hebri.
|
2018-03-23 12:16:30 +05:30 |
|
Sunil G
|
22c5ddb7c4
|
YARN-8063. DistributedShellTimelinePlugin wrongly check for entityId instead of entityType. Contributed by Rohith Sharma K S.
|
2018-03-23 10:54:00 +05:30 |
|
Jason Lowe
|
5aa7052e31
|
YARN-8054. Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread. Contributed by Jonathan Eagles
|
2018-03-21 17:19:20 -05:00 |
|
Rohith Sharma K S
|
29acea5000
|
YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen.
|
2018-03-21 08:11:19 +05:30 |
|
Haibo Chen
|
3ff6977d3e
|
YARN-8053. Add hadoop-distcp in exclusion in hbase-server dependencies for timelineservice-hbase packages. (Rohith Sharma K S via Haibo Chen)
|
2018-03-20 04:36:21 -07:00 |
|
Jason Lowe
|
f480367af6
|
YARN-8027. Setting hostname of docker container breaks for --net=host in docker 1.13. Contributed by Jim Brennan
|
2018-03-19 16:59:58 -05:00 |
|
Wangda Tan
|
a08921ca6c
|
YARN-8002. Support NOT_SELF and ALL namespace types for allocation tag. (Weiwei Yang via wangda)
Change-Id: I63b4e4192a95bf7ded98c54e46a2871c72869700
|
2018-03-19 11:04:27 -07:00 |
|
Sunil G
|
6bd130ea45
|
YARN-8028. Support authorizeUserAccessToQueue in RMWebServices. Contributed by Wangda Tan.
|
2018-03-18 11:00:30 +05:30 |
|
Sunil G
|
98356a3dde
|
YARN-8040. [UI2] New YARN UI webapp does not respect current pathname for REST api. Contributed by Sunil G.
|
2018-03-18 10:44:33 +05:30 |
|
Yufei Gu
|
49c747ab18
|
YARN-8039. Clean up log dir configuration in TestLinuxContainerExecutorWithMocks.testStartLocalizer. Contributed by Miklos Szegedi.
|
2018-03-16 16:25:33 -07:00 |
|
Weiwei Yang
|
154cfb2b62
|
YARN-7636. Re-reservation count may overflow when cluster resource exhausted for a long time. contributed by Tao Yang.
|
2018-03-16 18:57:31 +08:00 |
|
Wangda Tan
|
4bf622043f
|
YARN-7952. RM should be able to recover log aggregation status after restart/fail-over. (Xuan Gong via wangda)
Change-Id: I725c9afe64831eda0aa6b0bebdbc79d2dd165707
|
2018-03-15 13:26:45 -07:00 |
|
fang zhenyi
|
5e013d50d1
|
HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-03-15 16:12:07 +09:00 |
|
Eric Yang
|
a82be7754d
|
YARN-7999. Added file cache initializer for Linux container-executor.
Contributed by Jason Lowe
|
2018-03-14 12:21:57 -04:00 |
|
Rohith Sharma K S
|
e6de10d0a6
|
YARN-8022. ResourceManager UI cluster/app/<app-id> page fails to render. Contributed by Tarun Parimi.
|
2018-03-14 09:42:20 +05:30 |
|
Wangda Tan
|
b167d60763
|
YARN-7657. Queue Mapping could provide options to provide 'user' specific auto-created queues under a specified group parent queue. (Suma Shivaprasad via wangda)
Change-Id: I32d566e8727840e43c0d66e39a77edef017e3a83
|
2018-03-13 17:55:51 -07:00 |
|
Wangda Tan
|
a5b27b3c67
|
YARN-5015. Support sliding window retry capability for container restart. (Chandni Singh via wangda)
Change-Id: I07addd3e4ba8d98456ee2ff1d5c540a38fe61dea
|
2018-03-13 17:55:17 -07:00 |
|
Miklos Szegedi
|
a82d4a2e3a
|
YARN-5764. NUMA awareness support for launching containers. Contributed by Devaraj K.
|
2018-03-13 12:36:57 -07:00 |
|
Yufei Gu
|
ff31d8aefa
|
YARN-8024. LOG in class MaxRunningAppsEnforcer is initialized with a faulty class. Contributed by Sen Zhao.
|
2018-03-12 16:35:26 -07:00 |
|
Billie Rinaldi
|
e1f5251f3c
|
YARN-7523. Introduce description and version field in Service record. Contributed by Chandni Singh
|
2018-03-10 07:49:10 -08:00 |
|
Wangda Tan
|
ea18e70a74
|
Updated timeline reader to use AuthenticationFilter
Change-Id: I961771589180c1eb377d36c37a79aa23754effbf
(cherry picked from commit 837338788eb903d0e8bbb1230694782a707891be)
|
2018-03-09 22:51:08 -08:00 |
|
Owen O'Malley
|
3a8dade9b1
|
Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu."
This reverts commit 172b23af33 .
(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
|
2018-03-09 22:46:30 -08:00 |
|
Billie Rinaldi
|
4f395063bb
|
YARN-8000. Yarn Service component instance name shows up as component name in container record. Contributed by Chandni Singh
|
2018-03-09 08:50:28 -08:00 |
|
Sunil G
|
113f401f41
|
YARN-7944. [UI2] Remove master node link from headers of application pages. Contributed by Yesha Vora.
|
2018-03-08 23:53:36 +05:30 |
|
Weiwei Yang
|
b451889e8e
|
YARN-8011. TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails intermittently. Contributed by Tao Yang.
|
2018-03-08 18:13:36 +08:00 |
|
Wangda Tan
|
583f459431
|
YARN-7891. LogAggregationIndexedFileController should support read from HAR file. (Xuan Gong via wangda)
Change-Id: I16e081f21c5f80160564c49cc49d103bd8eb7e16
|
2018-03-07 15:46:47 -08:00 |
|
Wangda Tan
|
e718ac597f
|
Revert "YARN-7891. LogAggregationIndexedFileController should support read from HAR file. (Xuan Gong via wangda)"
This reverts commit 4d53ef7eef .
|
2018-03-07 15:46:47 -08:00 |
|
Wangda Tan
|
037d783483
|
YARN-7626. Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount. (Zian Chen via wangda)
Change-Id: If461277d4557922ab7e4dce9dd8dc5d0d5f22710
(cherry picked from commit 88f9138e12d2d5a1bd13f0915acef93037c1d086)
|
2018-03-07 11:30:15 -08:00 |
|
Wangda Tan
|
4d53ef7eef
|
YARN-7891. LogAggregationIndexedFileController should support read from HAR file. (Xuan Gong via wangda)
Change-Id: Ie16e34039d57df50128c73b37516ad0bc7c9590e
|
2018-03-07 11:30:06 -08:00 |
|
Jason Lowe
|
d69b31f7f7
|
YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan
|
2018-03-07 09:20:34 -06:00 |
|
Rohith Sharma K S
|
55ba49dd07
|
YARN-7346. Add a profile to allow optional compilation for ATSv2 with HBase-2.0. Contributed by Haibo Chen and Rohith.
|
2018-03-06 11:55:21 +05:30 |
|
Takanobu Asanuma
|
745190ecdc
|
HADOOP-15287. JDK9 JavaDoc build fails due to one-character underscore identifiers in hadoop-yarn-common
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-03-05 18:15:53 -08:00 |
|
Sen Zhao
|
245751ffdc
|
YARN-7736. Fix itemization in YARN federation document
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-03-05 11:54:24 -08:00 |
|
Arun Suresh
|
1054b48c27
|
YARN-7972. Support inter-app placement constraints for allocation tags by application ID. (Weiwei Yang via asuresh)
|
2018-03-05 11:24:17 -08:00 |
|
Billie Rinaldi
|
628be58a4c
|
YARN-7915. Trusted image log message repeated multiple times. Contributed by Shane Kumpf
|
2018-03-05 09:08:44 -08:00 |
|
Weiwei Yang
|
e8c5be63f0
|
YARN-7995. Remove unnecessary boxings and unboxings from PlacementConstraintParser.java. Contributed by Sen Zhao.
|
2018-03-05 11:49:43 +08:00 |
|
Jason Lowe
|
83798f15f8
|
YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang
|
2018-03-02 09:59:46 -06:00 |
|
Ray Chiang
|
923e1773e1
|
HADOOP-14652. Update metrics-core version to 3.2.4. (rchiang)
|
2018-03-01 15:36:10 -08:00 |
|
Sunil G
|
22928c0c60
|
YARN-7637. GPU volume creation command fails when work preserving is disabled at NM. Contributed by Zian Chen.
|
2018-03-01 22:39:32 +05:30 |
|
Yufei Gu
|
6ca4e3017b
|
YARN-5028. RMStateStore should trim down app state for completed applications(addendum). Contributed by Rohith Sharma K S.
|
2018-03-01 08:38:53 -08:00 |
|
Billie Rinaldi
|
5ed689e33a
|
YARN-7958. ServiceMaster should only wait for recovery of containers with id that match the current application id. Contributed by Chandni Singh
|
2018-03-01 08:00:13 -08:00 |
|
Haibo Chen
|
10663b78c8
|
Revert "yarn-7346.07.patch"
This reverts commit 5e37ca5bb4 .
|
2018-02-28 21:11:36 -08:00 |
|
Haibo Chen
|
d1274c3b71
|
YARN-7835. Race condition in NM while publishing events if second attempt is launched on the same node. (Rohith Sharma K S via Haibo Chen)
|
2018-02-28 21:10:42 -08:00 |
|
Haibo Chen
|
5e37ca5bb4
|
yarn-7346.07.patch
|
2018-02-28 21:04:54 -08:00 |
|
Eric Yang
|
17f387e3c2
|
YARN-7985. Removed duplicate service name validation in Yarn Service.
Contributed by Chandni Singh
|
2018-02-28 20:48:55 -05:00 |
|
Billie Rinaldi
|
315f48e791
|
YARN-7955. Improve result of calling stop on an already stopped service. Contributed by Gour Saha
|
2018-02-28 15:01:56 -08:00 |
|
Billie Rinaldi
|
31009034bd
|
YARN-7954. Set component status to STOPPED when YARN service is stopped. Contributed by Gour Saha
|
2018-02-28 11:57:24 -08:00 |
|
Billie Rinaldi
|
727c033997
|
YARN-7446. Remove --user flag when running privileged mode docker container. Contributed by Eric Yang
|
2018-02-27 14:33:57 -08:00 |
|
Wangda Tan
|
eea0b069e7
|
YARN-7959. Add .vm extension to PlacementConstraints.md to ensure proper filtering. (Weiwei Yang via wangda)
Change-Id: I34ec516994a5de7accaa5ef7044e443b340bd294
(cherry picked from commit 0d516b30769471d9114214b3a518e2146ff2f25e)
|
2018-02-27 13:19:24 -08:00 |
|
Wangda Tan
|
5bbbbb6a1e
|
YARN-7893. Document the FPGA isolation feature. (Zhankun Tang via wangda)
Change-Id: I8723320377a4bd0a7db168670d183ef5543caa67
(cherry picked from commit c2af2f16718bd1d38ceb05e354f34d7bef89127d)
|
2018-02-27 13:19:16 -08:00 |
|
Eric Yang
|
b4f1ba1413
|
YARN-7963. Updated MockServiceAM unit test to prevent test hang.
Contributed by Chandni Singh
|
2018-02-26 18:49:01 -05:00 |
|
Konstantinos Karanasos
|
e85188101c
|
YARN-7921. Transform a PlacementConstraint to a string expression. Contributed by Weiwei Yang.
|
2018-02-26 12:15:16 -08:00 |
|
Arpit Agarwal
|
2fa7963c3d
|
HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi.
|
2018-02-24 14:41:55 -08:00 |
|
Jason Lowe
|
8e728f39c9
|
YARN-5714. ContainerExecutor does not order environment map. Contributed by Remi Catherinot and Jim Brennan
|
2018-02-23 15:46:35 -06:00 |
|
Sunil G
|
d1cd573687
|
YARN-7949. [UI2] ArtifactsId should not be a compulsory field for new service. Contributed by Yesha Vora.
|
2018-02-23 16:50:02 +05:30 |
|
Sunil G
|
cc683952d2
|
YARN-7675. [UI2] Support loading pre-2.8 version /scheduler REST response for queue page. Contributed by Gergely Novák.
|
2018-02-23 16:10:29 +05:30 |
|
Gabor Bota
|
c36b4aa31c
|
HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-02-23 13:55:18 +09:00 |
|
Carlo Curino
|
514794e1a5
|
YARN-7934. [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos. (Contributed by curino)
|
2018-02-22 18:12:12 -08:00 |
|
Eric Yang
|
95904f6b3c
|
YARN-7942. Add check for JAAS configuration for Yarn Service.
Contributed by Billie Rinaldi
|
2018-02-22 16:12:40 -05:00 |
|
Eric Yang
|
190969006d
|
YARN-7836. Added error check for updating service components.
(Contributed by Gour Saha)
|
2018-02-22 16:08:30 -05:00 |
|
Jason Lowe
|
3132709b46
|
YARN-7916. Remove call to docker logs on failure in container-executor. Contributed by Shane Kumpf
|
2018-02-21 16:54:02 -06:00 |
|
Yufei Gu
|
92cbbfe79e
|
YARN-5028. RMStateStore should trim down app state for completed applications. Contributed by Gergo Repas.
|
2018-02-21 11:42:51 -08:00 |
|
Sunil G
|
bdd2a184d7
|
YARN-7947. Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps. Contributed by Eric Payne.
|
2018-02-21 14:35:57 +05:30 |
|
Sunil G
|
86b227a1fb
|
YARN-7223. Document GPU isolation feature. Contributed by Wangda Tan.
|
2018-02-21 14:16:45 +05:30 |
|
Eric Yang
|
7280c5af82
|
YARN-7940. Fixed a bug in ServiceAM ZooKeeper initialization.
(Contributed by Billie Rinaldi)
|
2018-02-20 14:12:58 -05:00 |
|
Jason Lowe
|
9497215084
|
YARN-7813. Capacity Scheduler Intra-queue Preemption should be configurable for each queue. Contributed by Eric Payne
|
2018-02-19 14:06:28 -06:00 |
|
Jason Lowe
|
b9a429bb28
|
Revert "YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan"
This reverts commit 8013475d44 .
|
2018-02-19 08:16:25 -06:00 |
|
fang zhenyi
|
4d4dde5112
|
HADOOP-15223. Replace Collections.EMPTY* with empty* when available
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-02-18 22:19:39 +09:00 |
|
Rohith Sharma K S
|
87bdde6943
|
YARN-7937. Fix http method name in Cluster Application Timeout Update API example request. Contributed by Charan Hebri.
|
2018-02-18 14:01:23 +05:30 |
|
Rohith Sharma K S
|
9af30d46c6
|
YARN-7919. Refactor timelineservice-hbase module into submodules. Contributed by Haibo Chen.
|
2018-02-17 20:30:28 +05:30 |
|
Arun Suresh
|
a1e56a6286
|
YARN-7918. Fix TestAMRMClientPlacementConstraints. (Gergely Novák via asuresh)
|
2018-02-17 03:24:55 -08:00 |
|
Wangda Tan
|
ca1043ab90
|
YARN-7328. ResourceUtils allows yarn.nodemanager.resource-types.memory-mb and .vcores to override yarn.nodemanager.resource.memory-mb and .cpu-vcores. (lovekesh bansal via wangda)
Change-Id: Ibb1faf0beefec079dae2208986976b2f64650672
|
2018-02-17 12:28:08 +08:00 |
|
Sunil G
|
aae629913c
|
YARN-7292. Retrospect Resource Profile Behavior for overriding capability. Contributed by Wangda Tan.
|
2018-02-16 12:37:40 +05:30 |
|
Jason Lowe
|
8013475d44
|
YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan
|
2018-02-15 17:09:00 -06:00 |
|
Konstantinos Karanasos
|
0b489e564c
|
YARN-7920. Simplify configuration for PlacementConstraints. Contributed by Wangda Tan.
|
2018-02-15 14:23:38 -08:00 |
|
Eric Payne
|
bddfe42e2c
|
Revert "YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue"
This reverts commit c5e6e3de1c .
|
2018-02-14 14:29:20 -06:00 |
|
Wangda Tan
|
042ef2fa7b
|
YARN-7789. Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator. (Zian Chen via wangda)
Change-Id: I1f6a451fe16758def6f47c046a9b8a67ad7255af
|
2018-02-14 23:11:10 +08:00 |
|
Eric Payne
|
c5e6e3de1c
|
YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue
|
2018-02-13 10:11:02 -06:00 |
|
Jason Lowe
|
5a1db60ab1
|
YARN-7914. Fix exit code handling for short lived Docker containers. Contributed by Shane Kumpf
|
2018-02-12 15:50:10 -06:00 |
|
Jason Lowe
|
3414fd1243
|
YARN-7917. Fix failing test TestDockerContainerRuntime#testLaunchContainerWithDockerTokens. Contributed by Shane Kumpf
|
2018-02-12 09:27:43 -06:00 |
|
Wangda Tan
|
d02e42cee4
|
YARN-7739. DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation. (wangda)
Change-Id: I10cc9341237d9a2fc0f8c855efb98a36b91389e2
|
2018-02-12 10:29:37 +08:00 |
|
Wangda Tan
|
d4c98579e3
|
YARN-7697. NM goes down with OOM due to leak in log-aggregation. (Xuan Gong via wangda)
Change-Id: Ie4fc7979d834e25f37a033c314f3efceeb8f4a9e
|
2018-02-12 10:28:35 +08:00 |
|
Wangda Tan
|
789a185c16
|
YARN-5848. Remove unnecessary public/crossdomain.xml from YARN UIv2 sub project. (Sunil G via wangda)
Change-Id: Ie295f88232192e6b520c335b0332383cc6a232c0
|
2018-02-12 10:27:15 +08:00 |
|
Wangda Tan
|
e795833d8c
|
YARN-7906. Fix mvn site fails with error: Multiple sources of package comments found for package o.a.h.y.client.api.impl. (Akira Ajisaka via wangda)
Change-Id: I20221d97446e97f208d587eacbc60448c11ffd48
|
2018-02-12 10:25:22 +08:00 |
|
Weiwei Yang
|
a08c048832
|
YARN-7838. Support AND/OR constraints in Distributed Shell. Contributed by Weiwei Yang.
|
2018-02-11 14:20:46 +08:00 |
|
Wangda Tan
|
60f9e60b3b
|
Preparing for 3.2.0 development
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
|
2018-02-11 11:17:38 +08:00 |
|
Eric Yang
|
c97d5bceb2
|
YARN-7909. Add charset to YARN Service REST API. (Contributed by Eric Yang)
|
2018-02-09 20:01:25 -05:00 |
|
Jian He
|
ddec08d7cc
|
YARN-7827. Stop and Delete Yarn Service from RM UI fails with HTTP ERROR 404. Contributed by Sunil G
|
2018-02-08 21:32:40 -08:00 |
|
Yufei Gu
|
1bc03ddf97
|
YARN-7655. Avoid AM preemption caused by RRs for specific nodes or racks. Contributed by Steven Rand.
|
2018-02-08 12:32:43 -08:00 |
|
Jian He
|
eb2449d539
|
YARN-5428. Allow for specifying the docker client configuration directory. Contributed by Shane Kumpf
|
2018-02-08 11:35:30 -08:00 |
|
Jason Lowe
|
456705a07c
|
YARN-7815. Make the YARN mounts added to Docker containers more restrictive. Contributed by Shane Kumpf
|
2018-02-07 13:09:08 -06:00 |
|
Billie Rinaldi
|
266da25c04
|
Revert "YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi."
This reverts commit e14f03dfbf .
|
2018-02-07 07:17:00 -08:00 |
|
Billie Rinaldi
|
aa461f9091
|
YARN-7516. Add security check for trusted docker images. Contributed by Eric Yang
|
2018-02-07 07:09:45 -08:00 |
|
Robert Kanter
|
814d701d46
|
YARN-7841. Cleanup AllocationFileLoaderService's reloadAllocations method (snemeth via rkanter)
|
2018-02-06 14:36:49 -08:00 |
|
Anu Engineer
|
4304fcd5bd
|
HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen.
|
2018-02-06 13:43:45 -08:00 |
|
Weiwei Yang
|
bff858e910
|
YARN-7860. Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning. Contributed by Sunil G.
|
2018-02-06 19:33:04 +08:00 |
|
Sunil G
|
72415c39cf
|
YARN-7866. [UI2] Error to be displayed correctly while accessing kerberized cluster without kinit. Contributed by Sunil G.
|
2018-02-06 16:00:34 +05:30 |
|
Sunil G
|
2c326088ae
|
YARN-7850. [UI2] Log Aggregation status to be displayed in Application Page. Contributed by Gergely Novák.
|
2018-02-06 15:32:09 +05:30 |
|
Jian He
|
87429affce
|
YARN-7889. Missing kerberos token when check for RM REST API availability. Contributed by Eric Yang
|
2018-02-05 22:56:25 -08:00 |
|
Billie Rinaldi
|
a196ee9362
|
YARN-7890. NPE during container relaunch. Contributed by Jason Lowe
|
2018-02-05 18:04:09 -08:00 |
|
Jason Lowe
|
60656bceca
|
YARN-7849. TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error. Contributed by Botong Huang
|
2018-02-05 17:16:04 -06:00 |
|
Miklos Szegedi
|
c7101fe21b
|
YARN-7879. NM user is unable to access the application filecache due to permissions. Contributed by Jason Lowe.
|
2018-02-02 16:48:57 -08:00 |
|
Konstantinos Karanasos
|
50723889cc
|
YARN-7778. Merging of placement constraints defined at different levels. Contributed by Weiwei Yang.
|
2018-02-02 14:46:20 -08:00 |
|
Jian He
|
b6e50fad53
|
YARN-7831. YARN Service CLI should use hadoop.http.authentication.type to determine authentication method. Contributed by Eric Yang
|
2018-02-02 14:38:33 -08:00 |
|
Jian He
|
f9a4d4cf23
|
YARN-7868. Provide improved error message when YARN service is disabled. Contributed by Eric Yang
|
2018-02-02 11:10:47 -08:00 |
|
Arun Suresh
|
6e5ba9366f
|
YARN-7839. Modify PlacementAlgorithm to Check node capacity before placing request on node. (Panagiotis Garefalakis via asuresh)
|
2018-02-02 10:28:22 -08:00 |
|
Jason Lowe
|
682ea21f2b
|
Revert "YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan"
This reverts commit 12eaae383a .
|
2018-02-01 12:14:09 -06:00 |
|
Eric Yang
|
0bee3849e3
|
YARN-7816. Allow same application name submitted by multiple users. (Contributed by Gour Saha)
|
2018-01-31 20:51:40 -05:00 |
|
Jason Lowe
|
12eaae383a
|
YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan
|
2018-01-31 11:37:54 -06:00 |
|
Arun Suresh
|
d481344783
|
YARN-7822. Constraint satisfaction checker support for composite OR and AND constraints. (Weiwei Yang via asuresh)
|
2018-01-31 01:51:08 -08:00 |
|
Arun Suresh
|
8d1e2c6409
|
Merge branch 'YARN-6592' into trunk
|
2018-01-31 01:42:42 -08:00 |
|
Jason Lowe
|
7288b08330
|
YARN-2185. Use pipes when localizing archives. Contributed by Miklos Szegedi
|
2018-01-31 09:39:43 -06:00 |
|
Wangda Tan
|
1453a04e92
|
YARN-7861. [UI2] Logs page shows duplicated containers with ATS. (Sunil G via wangda)
Change-Id: Id07d1ff8d519e0d9291ab037236641ceb901582c
|
2018-01-31 21:44:42 +08:00 |
|
Wangda Tan
|
5ca4bf22dd
|
YARN-7828. Clicking on yarn service should take to component tab. (Sunil G via wangda)
Change-Id: Ib52d6727c863bed65de30b02bf60080255af11b8
|
2018-01-31 21:43:08 +08:00 |
|
Sunil G
|
64344c345d
|
YARN-7802. [UI2] Application regex search did not work properly with app name. Contributed by Sreenath Somarajapuram.
|
2018-01-31 17:40:36 +05:30 |
|
Arun Suresh
|
8df7666fe1
|
YARN-7780. Documentation for Placement Constraints. (Konstantinos Karanasos via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
add993e26a
|
YARN-6597. Add RMContainer recovery test to verify tag population in the AllocationTagsManager. (Panagiotis Garefalakis via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
f8c5f5b237
|
YARN-7784. Fix Cluster metrics when placement processor is enabled. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
c23980c4f2
|
YARN-7795. Fix jenkins issues of YARN-6592 branch. (Sunil G via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
644afe5fd8
|
YARN-7807. Assume intra-app anti-affinity as default for scheduling request inside AppPlacementAllocator. (Wangda Tan via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
a4c539fcdb
|
YARN-7783. Add validation step to ensure constraints are not violated due to order in which a request is processed. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Sunil G
|
9b81cb0537
|
YARN-7779. Display allocation tags in RM web UI and expose same through REST API. Contributed by Weiwei Yang.
|
2018-01-31 01:30:17 -08:00 |
|
Konstantinos Karanasos
|
adbe87abf8
|
YARN-7788. Factor out management of temp tags from AllocationTagsManager. (Arun Suresh via kkaranasos)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
8bf7c44436
|
YARN-7763. Allow Constraints specified in the SchedulingRequest to override application level constraints. (Weiwei Yang via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
28fe7f3318
|
YARN-7774. Miscellaneous fixes to the PlacementProcessor. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Wangda Tan
|
e60f51299d
|
YARN-7745. Allow DistributedShell to take a placement specification for containers it wants to launch. (Arun Suresh via wangda)
Change-Id: Ided146d662e944a8a4692e5d6885f23fd9bbcad5
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
38af237969
|
YARN-6599. Support anti-affinity constraint via AppPlacementAllocator. (Wangda Tan via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
8779a35742
|
YARN-7709. Remove SELF from TargetExpression type. (Konstantinos Karanasos via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Wangda Tan
|
29d9e4d581
|
YARN-6619. AMRMClient Changes to use the PlacementConstraint and SchcedulingRequest objects. (Arun Suresh via wangda)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
a5c1fc881e
|
YARN-7696. Add container tags to ContainerTokenIdentifier, api.Container and NMContainerStatus to handle all recovery cases. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
4eda58c136
|
YARN-7681. Double-check placement constraints in scheduling phase before actual allocation is made. (Weiwei Yang via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
bdba01f73b
|
YARN-7682. Expose canSatisfyConstraints utility function to validate a placement against a constraint. (Panagiotis Garefalakis via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
a52d11fb8c
|
YARN-7613. Implement Basic algorithm for constraint based placement. (Panagiotis Garefalakis via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
f9af15d659
|
YARN-7612. Add Processor Framework for Rich Placement Constraints. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
1efb2b6f25
|
YARN-6596. Introduce Placement Constraint Manager module. (Konstantinos Karanasos via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
37f1a7b64f
|
YARN-7653. Node group support for AllocationTagsManager. (Panagiotis Garefalakis via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
06eb63e64b
|
YARN-7669. API and interface modifications for placement constraint processor. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
88d8d3f40b
|
YARN-7670. Modifications to the ResourceScheduler API to support SchedulingRequests. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
801c0988b5
|
YARN-7522. Introduce AllocationTagsManager to associate allocation tags to nodes. (Wangda Tan via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Arun Suresh
|
69de9a1ba9
|
YARN-7448. [API] Add SchedulingRequest to the AllocateRequest. (Panagiotis Garefalakis via asuresh)
|
2018-01-31 01:30:17 -08:00 |
|
Konstantinos Karanasos
|
db928556c8
|
YARN-6595. [API] Add Placement Constraints at the application level. (Arun Suresh via kkaranasos)
|
2018-01-31 01:30:17 -08:00 |
|
Wangda Tan
|
b57e8bc300
|
YARN-6594. [API] Introduce SchedulingRequest object. (Konstantinos Karanasos via wangda)
|
2018-01-31 01:30:17 -08:00 |
|
Wangda Tan
|
33a796d9b7
|
YARN-6593. [API] Introduce Placement Constraint object. (Konstantinos Karanasos via wangda)
Change-Id: Id00edb7185fdf01cce6e40f920cac3585f8cbe9c
|
2018-01-31 01:30:17 -08:00 |
|
Eric Yang
|
f9dd5b61f4
|
YARN-7811. Fixed a bug in user defined docker network settings. (Contributed by Billie Rinaldi)
|
2018-01-30 12:42:38 -05:00 |
|
Jason Lowe
|
901d15a30b
|
Revert "YARN-2185. Use pipes when localizing archives. Contributed by Miklos Szegedi"
This reverts commit 1b0f265db1 .
|
2018-01-30 08:34:39 -06:00 |
|
Sunil G
|
6463e10c72
|
YARN-7723. Avoid using docker volume --format option to run against to older docker releases. Contributed by Wangda Tan
|
2018-01-30 15:58:11 +05:30 |
|
Wangda Tan
|
f666e7c43d
|
YARN-5148. [UI2] Add page to new YARN UI to view server side configurations/logs/JVM-metrics. (Kai Sasaki/Sunil G via wangda)
Change-Id: I5de88ce9850c0bc337dcb2c7d25ee9ad52016925
|
2018-01-30 15:45:06 +08:00 |
|
Sunil G
|
e9c72d04be
|
YARN-7790. Improve Capacity Scheduler Async Scheduling to better handle node failures. Contributed by Wangda Tan.
|
2018-01-29 20:44:38 +05:30 |
|
Jinjiang Ling
|
3400d0c535
|
YARN-7698. A misleading variable's name in ApplicationAttemptEventDispatcher
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-01-30 00:00:57 +09:00 |
|
Jian He
|
443523f9c0
|
YARN-7765. Fixed an issue that kerberos tgt not found when NM posting timeline events. Contributed by Rohith Sharma K S
|
2018-01-27 22:18:51 -08:00 |
|
Haibo Chen
|
649ef7ac33
|
YARN-7064. Use cgroup to get container resource utilization. (Miklos Szegedi via Haibo Chen)
|
2018-01-26 16:27:31 -08:00 |
|
Jason Lowe
|
1b0f265db1
|
YARN-2185. Use pipes when localizing archives. Contributed by Miklos Szegedi
|
2018-01-26 13:25:20 -06:00 |
|
Billie Rinaldi
|
f2fa736f0a
|
YARN-7797. Docker host network can not obtain IP address for RegistryDNS. Contributed by Eric Yang
|
2018-01-26 09:32:23 -08:00 |
|
Wangda Tan
|
8b5b045bd2
|
YARN-7742. [UI2] Duplicated containers are rendered per attempt. (Vasudevan Skm / Sunil G via wangda)
Change-Id: Ib2bb3c64d7f09a7c3488f498d0079bcd2e6ac023
|
2018-01-26 15:46:06 +08:00 |
|
Wangda Tan
|
75618c0dec
|
YARN-7760. [UI2] Clicking 'Master Node' or link next to 'AM Node Web UI' under application's appAttempt page goes to OLD RM UI. (Vasudevan Skm / Sunil G via wangda)
Change-Id: Ia7e2b955d3551ca43c6852fe253fd01983b56565
|
2018-01-26 15:44:55 +08:00 |
|
Wangda Tan
|
e0cfb0a31a
|
YARN-7817. Add Resource reference to RM's NodeInfo object so REST API can get non memory/vcore resource usages. (Sunil G via wangda)
Change-Id: Ia7ceeabd82046645ddeaf487c763288f36cfbdee
|
2018-01-26 15:43:27 +08:00 |
|
Miklos Szegedi
|
2e5865606b
|
YARN-7814. Remove automatic mounting of the cgroups root directory into Docker containers. Contributed by Shane Kumpf.
|
2018-01-25 17:37:23 -08:00 |
|
Jason Lowe
|
ff8378eb1b
|
YARN-7102. NM heartbeat stuck when responseId overflows MAX_INT. Contributed by Botong Huang
|
2018-01-25 17:47:19 -06:00 |
|
Sunil G
|
82cc6f6968
|
YARN-7728. Expose container preemptions related information in Capacity Scheduler queue metrics. Contributed by Eric Payne.
|
2018-01-25 14:32:54 +05:30 |
|
Eric Yang
|
59828be197
|
YARN-7810. Update TestDockerContainerRuntime to test with current user credential.
(contributed by Shane Kumpf)
|
2018-01-24 21:24:19 -05:00 |
|
Wangda Tan
|
051ad9d63f
|
YARN-7628. [Documentation] Documenting the ability to disable elasticity at Capacity Scheduler's sub queues. (Zian Chen via wangda)
Change-Id: I5c37df1c5bee9e3a78379775ef307ef94506ebc4
|
2018-01-25 07:24:57 +08:00 |
|
Billie Rinaldi
|
0c559b2782
|
YARN-7777. Fix user name format in YARN Registry DNS name. Contributed by Jian He
|
2018-01-24 13:50:47 -08:00 |
|
Zhe Zhang
|
fa8cf4d1b4
|
YARN-7737. prelaunch.err file not found exception on container failure. Contributed by Keqiu Hu.
|
2018-01-24 12:54:54 -08:00 |
|
Jian He
|
55c32776b1
|
YARN-7801. AmFilterInitializer should addFilter after fill all parameters. Contributed by Wangda Tan
|
2018-01-24 11:17:12 -08:00 |
|
Sunil G
|
97607617ce
|
YARN-7806. Distributed Shell should use timeline async api's. Contributed by Rohith Sharma K S
|
2018-01-24 16:56:13 +05:30 |
|
Rohith Sharma K S
|
2014863470
|
YARN-7749. [UI2] GPU information tab in left hand side disappears when we click other tabs below. Contributed by Sunil G and Vasudevan Skm.
|
2018-01-24 15:56:59 +05:30 |
|
Rohith Sharma K S
|
f3e33aeb80
|
Revert "YARN-7537 [Atsv2] load hbase configuration from filesystem rather than URL. Contributed by Rohith Sharma"
This reverts commit ec8f47e7fa .
|
2018-01-24 15:04:15 +05:30 |
|
Miklos Szegedi
|
e7642a3e6f
|
YARN-7796. Container-executor fails with segfault on certain OS configurations. Contributed by Gergo Repas.
|
2018-01-23 21:07:05 -08:00 |
|
Billie Rinaldi
|
e307edcb47
|
YARN-7540 and YARN-7605. Convert yarn app cli to call yarn api services and implement doAs for Api Service REST API. Contributed by Eric Yang and Jian He
|
2018-01-23 17:54:39 -08:00 |
|
Jian He
|
39b999aba2
|
YARN-7782. Enable user re-mapping for Docker containers in yarn-default.xml. Contributed by Eric Yang
|
2018-01-23 14:03:53 -08:00 |
|
Jian He
|
a72cdcc47a
|
YARN-7766. Introduce a new config property for YARN Service dependency tarball location. Contributed by Gour Saha
|
2018-01-23 10:53:27 -08:00 |
|
Eric Yang
|
97fe3cc187
|
YARN-7729. Add support for setting Docker PID namespace mode. (Contributed by Billie Rinaldi)
|
2018-01-22 16:33:38 -05:00 |
|
Yufei Gu
|
22ee6f77e5
|
YARN-7755. Clean up deprecation messages for allocation increments in FS config. Contributed by Wilfred Spiegelenburg.
|
2018-01-22 10:30:01 -08:00 |
|
Vrushali C
|
ec8f47e7fa
|
YARN-7537 [Atsv2] load hbase configuration from filesystem rather than URL. Contributed by Rohith Sharma
|
2018-01-19 15:34:40 -08:00 |
|
Haibo Chen
|
4aca4ff759
|
YARN-5094. some YARN container events have timestamp of -1.
|
2018-01-19 10:27:46 -08:00 |
|
Rohith Sharma K S
|
c5bbd6418e
|
YARN-7753. [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2. Contributed by Sunil G.
|
2018-01-19 15:48:16 +05:30 |
|
Miklos Szegedi
|
bc93ac229e
|
YARN-7139. FairScheduler: finished applications are always restored to default queue. Contributed by Wilfred Spiegelenburg.
|
2018-01-18 17:43:47 -08:00 |
|
Billie Rinaldi
|
37f4696a9c
|
YARN-7740. Fix logging for destroy yarn service cli when app does not exist and some minor bugs. Contributed by Jian He
|
2018-01-18 12:11:19 -08:00 |
|
Sunil G
|
06cceba1cb
|
YARN-7738. CapacityScheduler: Support refresh maximum allocation for multiple resource types. Contributed by Wangda Tan.
|
2018-01-18 19:05:26 +05:30 |
|
Sunil G
|
8e5472b1e6
|
YARN-7750. [UI2] Render time related fields in all pages to the browser timezone. Contributed by Vasudevan Skm.
|
2018-01-18 18:54:41 +05:30 |
|
Miklos Szegedi
|
a68e445dc6
|
YARN-7717. Add configuration consistency for module.enabled and docker.privileged-containers.enabled. Contributed by Eric Badger.
|
2018-01-17 14:11:14 -08:00 |
|
Miklos Szegedi
|
41049ba5d1
|
YARN-7758. Add an additional check to the validity of container and application ids passed to container-executor. Contributed by Yufei Gu.
|
2018-01-16 15:40:43 -08:00 |
|
Yufei Gu
|
370f1c6283
|
YARN-6486. FairScheduler: Deprecate continuous scheduling. (Contributed by Wilfred Spiegelenburg)
|
2018-01-16 14:46:55 -08:00 |
|
Robert Kanter
|
5ac109909a
|
YARN-7479. TestContainerManagerSecurity.testContainerManager[Simple] flaky in trunk (ajisakaa via rkanter)
|
2018-01-16 10:16:42 -08:00 |
|
Rohith Sharma K S
|
d09058b2fd
|
YARN-6736. Consider writing to both ats v1 & v2 from RM for smoother upgrades. Contributed by Aaron Gresch.
|
2018-01-16 07:58:29 +05:30 |
|
Miklos Szegedi
|
2dcfc1876e
|
YARN-7705. Create the container log directory with correct sticky bit in C code. Contributed by Yufei Gu.
|
2018-01-12 17:00:01 -08:00 |
|
Wangda Tan
|
edcc3a95d5
|
YARN-7468. Provide means for container network policy control. (Xuan Gong via wangda)
Change-Id: I73678c343f663412917758feef35d8308c216e76
|
2018-01-12 16:14:10 -08:00 |
|
Billie Rinaldi
|
53f2768926
|
YARN-7724. yarn application status should support application name. Contributed by Jian He
|
2018-01-12 15:33:46 -08:00 |
|
Jian He
|
c05b84703b
|
YARN-7671. Improve Diagonstic message for stop yarn native service. Contributed by Chandni Singh
|
2018-01-12 14:04:15 -08:00 |
|
Eric Yang
|
3d65dbe032
|
YARN-5366. Improve signal handling and delete delay for Docker on Yarn.
(Contributed by Shane Kumpf)
|
2018-01-12 13:41:27 -05:00 |
|
Billie Rinaldi
|
4fb1f45f21
|
YARN-7731. RegistryDNS should handle upstream DNS returning CNAME. Contributed by Eric Yang
|
2018-01-12 09:21:17 -08:00 |
|
Sunil G
|
128d773a23
|
YARN-7727. Incorrect log levels in few logs with QueuePriorityContainerCandidateSelector. Contributed by Prabhu Joseph.
|
2018-01-12 15:41:19 +05:30 |
|
Miklos Szegedi
|
bc285da107
|
YARN-7590. Improve container-executor validation check. Contributed by Eric Yang.
|
2018-01-11 09:40:09 -08:00 |
|
Akira Ajisaka
|
fbbbf59c82
|
YARN-7735. Fix typo in YARN documentation. Contributed by Takanobu Asanuma.
|
2018-01-11 15:59:27 +09:00 |
|
Sunil G
|
afd8caba27
|
YARN-7722. Rename variables in MockNM, MockRM for better clarity. Contributed by Lovekesh bansal
|
2018-01-10 20:51:34 +05:30 |
|
Miklos Szegedi
|
55066cc53d
|
YARN-7689. TestRMContainerAllocator fails after YARN-6124. Contributed by Wilfred Spiegelenburg.
|
2018-01-09 16:59:39 -08:00 |
|
Haibo Chen
|
8ee7080e5d
|
YARN-7665. Allow FS scheduler state dump to be turned on/off separately from FS debug log. (Wilfred Spiegelenburg via Haibo Chen)
|
2018-01-09 16:45:35 -08:00 |
|
Haibo Chen
|
f725b9e267
|
YARN-7716. metricsTimeStart and metricsTimeEnd should be all lower case in the doc.
|
2018-01-09 08:56:59 -08:00 |
|
Jason Lowe
|
90c86d6e09
|
YARN-6948. Invalid event: ATTEMPT_ADDED at FINAL_SAVING. Contributed by lujie
|
2018-01-09 10:51:15 -06:00 |
|
Jason Lowe
|
ebff4decfe
|
YARN-7663. RMAppImpl:Invalid event: START at KILLED. Contributed by lujie
|
2018-01-09 09:52:59 -06:00 |
|
bibinchundatt
|
b26e30ab16
|
YARN-7508. NPE in FiCaSchedulerApp when debug log enabled in async-scheduling mode. Contributed by Tao Yang.
|
2018-01-09 17:57:01 +05:30 |
|
Sunil G
|
783a01eb4a
|
YARN-7718. DistributedShell failed to specify resource other than memory/vcores from container_resources. Contributed by Wangda Tan.
|
2018-01-09 16:39:33 +05:30 |
|
Ray Chiang
|
59ab5da0a0
|
YARN-4227. Ignore expired containers from removed nodes in FairScheduler. (Wilfred Spiegelenburg via rchiang)
|
2018-01-08 16:19:02 -08:00 |
|
Billie Rinaldi
|
dc54747d70
|
YARN-7704. Document improvement for registry dns. Contributed by Jian He
|
2018-01-08 13:20:17 -08:00 |
|
Sunil G
|
01f3f2167e
|
YARN-7242. Support to specify values of different resource types in DistributedShell for easier testing. Contributed by Gergely Novák.
|
2018-01-08 11:59:06 +05:30 |
|
Rohith Sharma K S
|
c2d6fa3656
|
YARN-7699. queueUsagePercentage is coming as INF for getApp REST api call. Contributed by Sunil G.
|
2018-01-08 10:39:31 +05:30 |
|
Jian He
|
836e3c45e8
|
Revert "YARN-7540. Route YARN service CLI function through YARN Service API. (Contributed by Eric Yang)"
This reverts commit 438c1d333e .
|
2018-01-05 18:25:00 -08:00 |
|
Wangda Tan
|
a81144daa0
|
YARN-7666. Introduce scheduler specific environment variable support in ApplicationSubmissionContext for better scheduling placement configurations. (Sunil G via wangda)
Change-Id: I0fd826490f5160d47d42af2a9ac0bd8ec4e959dc
|
2018-01-05 15:12:04 -08:00 |
|
Robert Kanter
|
2aa4f0a559
|
YARN-7645. TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers is flakey with FairScheduler (rkanter)
|
2018-01-05 13:55:09 -08:00 |
|
Robert Kanter
|
f8e7dd9b10
|
YARN-7557. It should be possible to specify resource types in the fair scheduler increment value (grepas via rkanter)
|
2018-01-05 11:15:06 -08:00 |
|
Sunil G
|
0c75d0634b
|
YARN-7619. Max AM Resource value in Capacity Scheduler UI has to be refreshed for every user. Contributed by Eric Payne.
|
2018-01-05 14:42:17 +05:30 |
|
Jason Lowe
|
d795661868
|
YARN-7678. Ability to enable logging of container memory stats. Contributed by Jim Brennan
|
2018-01-04 10:15:52 -06:00 |
|
Robert Kanter
|
7a55044803
|
YARN-7622. Allow fair-scheduler configuration on HDFS (gphillips via rkanter)
|
2018-01-03 15:31:50 -08:00 |
|
Arpit Agarwal
|
4379113bda
|
HADOOP-15093. Deprecation of yarn.resourcemanager.zk-address is undocumented. Contributed by Ajay Kumar.
|
2018-01-03 14:32:47 -08:00 |
|
Haibo Chen
|
2f6c038be6
|
YARN-7602. NM should reference the singleton JvmMetrics instance.
|
2018-01-03 09:41:26 -08:00 |
|
Rohith Sharma K S
|
c9bf813c9a
|
YARN-7692. Skip validating priority acls while recovering applications. Contributed by Sunil G.
|
2018-01-03 18:20:04 +05:30 |
|
Arun Suresh
|
c0c7cce81d
|
YARN-7691. Add Unit Tests for ContainersLauncher. (Sampada Dehankar via asuresh)
|
2018-01-02 22:03:00 -08:00 |
|
Miklos Szegedi
|
7f515f57ed
|
YARN-7585. NodeManager should go unhealthy when state store throws DBException. Contributed by Wilfred Spiegelenburg.
|
2018-01-02 18:03:04 -08:00 |
|
Miklos Szegedi
|
80440231d4
|
YARN-6894. RM Apps API returns only active apps when query parameter queue used. Contributed by Gergely Novák.
|
2018-01-02 17:59:10 -08:00 |
|
Miklos Szegedi
|
626b5103d4
|
YARN-7688. Miscellaneous Improvements To ProcfsBasedProcessTree. Contributed by BELUGA BEHR.
|
2018-01-02 17:39:50 -08:00 |
|
Miklos Szegedi
|
33ae2a4ae1
|
YARN-7687. ContainerLogAppender Improvements. Contributed by BELUGA BEHR.
|
2018-01-02 16:36:51 -08:00 |
|
Wangda Tan
|
7467e8fe5a
|
YARN-7555. Support multiple resource types in YARN native services. (wangda)
Change-Id: I330e6ee17a73962dcaadd766a3e72d2888681731
|
2017-12-29 15:34:08 -08:00 |
|
Miklos Szegedi
|
b82049b4f0
|
YARN-7580. ContainersMonitorImpl logged message lacks detail when exceeding memory limits. Contributed by Wilfred Spiegelenburg.
|
2017-12-29 12:49:37 -08:00 |
|
Arun Suresh
|
a55884c68e
|
YARN-7542. Fix issue that causes some Running Opportunistic Containers to be recovered as PAUSED. (Sampada Dehankar via asuresh)
|
2017-12-28 22:20:42 -08:00 |
|
Robert Kanter
|
382215c72b
|
YARN-7577. Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart (miklos.szegedi@cloudera.com via rkanter)
|
2017-12-20 13:39:00 -08:00 |
|
Rohith Sharma K S
|
13ad7479b0
|
YARN-7674. Update Timeline Reader web app address in UI2. Contributed by Sunil G.
|
2017-12-20 22:28:28 +05:30 |
|
Sunil G
|
d62932c3b2
|
YARN-7032. [ATSv2] NPE while starting hbase co-processor when HBase authorization is enabled. Contributed by Rohith Sharma K S.
|
2017-12-20 11:31:15 +05:30 |
|
Eric Yang
|
41b581012a
|
YARN-7616. Map YARN application status to Service Status more accurately. (Contributed by Gour Saha)
|
2017-12-19 19:14:45 -05:00 |
|
Eric Yang
|
94a2ac6b71
|
YARN-7466. addendum patch for failing unit test. (Contributed by Chandni Singh)
|
2017-12-19 18:42:27 -05:00 |
|
Eric Yang
|
989c75109a
|
YARN-7543. Add check for max cpu limit and missing file for YARN service.
(Contributed by Jian He)
|
2017-12-19 16:45:04 -05:00 |
|
Varun Saxena
|
c0aeb666a4
|
YARN-7662. [ATSv2] Define new set of configurations for reader and collectors to bind (Rohith Sharma K S via Varun Saxena)
|
2017-12-19 22:29:24 +05:30 |
|
Sunil G
|
fe5b057c81
|
YARN-7620. Allow node partition filters on Queues page of new YARN UI. Contributed by Vasudevan Skm.
|
2017-12-19 20:27:25 +05:30 |
|
Junping Du
|
a7f8caf58e
|
Add 2.8.3 release jdiff files.
(cherry picked from commit c89f99aade575ab1f6a9836df719cda272293d90)
|
2017-12-18 22:39:01 -08:00 |
|
Jason Lowe
|
811fabdebe
|
YARN-7661. NodeManager metrics return wrong value after update node resource. Contributed by Yang Wang
|
2017-12-18 15:20:06 -06:00 |
|
Akira Ajisaka
|
001008958d
|
YARN-7664. Several javadoc errors. Contributed by Sean Mackrory.
|
2017-12-18 22:24:51 +09:00 |
|
Weiwei Yang
|
9289641020
|
YARN-7617. Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started. Contributed by Weiwei Yang.
|
2017-12-18 10:07:16 +08:00 |
|
Wangda Tan
|
44825f0960
|
YARN-7629. TestContainerLaunch# fails after YARN-7381. (Jason Lowe via wangda)
Change-Id: Ia6a3f05c9a7e797d8190123d304ecc4e2b018e33
|
2017-12-15 15:40:56 -08:00 |
|
Wangda Tan
|
631b5c2db7
|
YARN-5418. When partial log aggregation is enabled, display the list of aggregated files on the container log page. (Xuan Gong via wangda)
Change-Id: I1befb0bbaeb89fb315bafe3e2f3379663f8cf1ec
|
2017-12-15 15:38:36 -08:00 |
|
Sunil G
|
6681dd1007
|
YARN-7633. Documentation for auto queue creation feature and related configurations. Contributed by Suma Shivaprasad.
|
2017-12-15 23:07:15 +05:30 |
|
Rohith Sharma K S
|
09d996fdd4
|
YARN-7190. Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath. Contributed by Varun Saxena.
|
2017-12-15 21:50:28 +05:30 |
|
Sunil G
|
890d3d0645
|
YARN-7638. Unit tests related to preemption for auto created leaf queues feature.Contributed by Suma Shivaprasad.
|
2017-12-15 13:00:57 +05:30 |
|
Weiwei Yang
|
89b6c482c1
|
YARN-7642. Add test case to verify context update after container promotion or demotion with or without auto update. Contributed by Weiwei Yang.
|
2017-12-15 11:58:52 +08:00 |
|
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
95d4ec7fc0
|
YARN-7565. Addendum to fix an incompatible change. Contributed by Wangda Tan.
|
2017-12-14 17:10:37 -08:00 |
|
Subru Krishnan
|
17ba74be29
|
YARN-7630. Fix AMRMToken rollover handling in AMRMProxy. Contributed by Botong Huang.
|
2017-12-14 14:03:55 -08:00 |
|
Sunil G
|
2564b4d07f
|
YARN-7119. Support multiple resource types in rmadmin updateNodeResource command. Contributed by Manikandan R.
|
2017-12-14 16:11:57 +05:30 |
|
Eric Yang
|
438c1d333e
|
YARN-7540. Route YARN service CLI function through YARN Service API. (Contributed by Eric Yang)
|
2017-12-13 19:29:04 -05:00 |
|
Chen Liang
|
46e18c8da7
|
HADOOP-14914. Change to a safely casting long to int. Contributed by Ajay Kumar.
|
2017-12-13 14:56:14 -08:00 |
|
Sunil G
|
cb87e4dc92
|
YARN-7643. Handle recovery of applications in case of auto-created leaf queue mapping. Contributed by Suma Shivaprasad.
|
2017-12-13 22:49:58 +05:30 |
|
Sunil G
|
10fc8d2a7d
|
YARN-7383. Node resource is not parsed correctly for resource names containing dot. Contributed by Gergely Novák.
|
2017-12-13 22:00:07 +05:30 |
|
Sunil G
|
880cd754a5
|
YARN-7536. em-table improvement for better filtering in new YARN UI. Contributed by Vasudevan Skm. This closes #313.
|
2017-12-13 16:46:12 +05:30 |
|
Sunil G
|
fa4ecd8b98
|
YARN-7641. Allow searchable filter for Application page log viewer in new YARN UI. Contributed by Vasudevan Skm. This closes #312.
|
2017-12-13 15:51:49 +05:30 |
|
Weiwei Yang
|
7efc4f7688
|
YARN-7647. NM print inappropriate error log when node-labels is enabled. Contributed by Yang Wang.
|
2017-12-13 13:11:41 +08:00 |
|
Jason Lowe
|
2abab1d7c5
|
YARN-7595. Container launching code suppresses close exceptions after writes. Contributed by Jim Brennan
|
2017-12-12 16:04:15 -06:00 |
|
Jian He
|
3ebe6a7819
|
YARN-7565. Yarn service pre-maturely releases the container after AM restart. Contributed by Chandni Singh
|
2017-12-12 13:35:56 -08:00 |
|
Jason Lowe
|
06f0eb2dce
|
YARN-7625. Expose NM node/containers resource utilization in JVM metrics. Contributed by Weiwei Yang
|
2017-12-12 12:56:26 -06:00 |
|
Sunil G
|
8bb83a8f62
|
Queue ACL validations should validate parent queue ACLs before auto-creating leaf queues. Contributed by Suma Shivaprasad.
|
2017-12-12 15:20:59 +05:30 |
|
Sunil G
|
5c87fb2f62
|
YARN-7635. TestRMWebServicesSchedulerActivities fails in trunk. Contributed by Sunil G.
|
2017-12-12 15:08:18 +05:30 |
|
Sunil G
|
312ceebde8
|
YARN-7632. Effective min and max resource need to be set for auto created leaf queues upon creation and capacity management. Contributed by Suma Shivaprasad.
|
2017-12-11 19:20:02 +05:30 |
|
Weiwei Yang
|
a2edc4cbf5
|
YARN-7608. Incorrect sTarget column causing DataTable warning on RM application and scheduler web page. Contributed by Gergely Novák.
|
2017-12-11 10:31:46 +08:00 |
|
Subru Krishnan
|
670e8d4ec7
|
YARN-6704. Add support for work preserving NM restart when FederationInterceptor is enabled in AMRMProxyService. (Botong Huang via Subru).
|
2017-12-08 15:39:18 -08:00 |
|
Wangda Tan
|
04b84da245
|
YARN-7443. Add native FPGA module support to do isolation with cgroups. (Zhankun Tang via wangda)
Change-Id: Ic4b7f9f3e032986b8f955139c9fe4d3a6c818a53
|
2017-12-08 15:18:22 -08:00 |
|
Wangda Tan
|
adca1a72e4
|
YARN-7591. NPE in async-scheduling mode of CapacityScheduler. (Tao Yang via wangda)
Change-Id: I46689e530550ee0a6ac7a29786aab2cc1bdf314f
|
2017-12-08 15:17:02 -08:00 |
|
Wangda Tan
|
a8316df8c0
|
YARN-7520. Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues. (Suma Shivaprasad via wangda)
Change-Id: I482f086945bd448d512cb5b3879d7371e37ee134
|
2017-12-08 15:11:28 -08:00 |
|
Wangda Tan
|
f548bfffbd
|
YARN-7420. YARN UI changes to depict auto created queues. (Suma Shivaprasad via wangda)
Change-Id: I8039d3772a191ddede132cd1f8b08a8ca2e275b7
|
2017-12-08 15:10:47 -08:00 |
|
Wangda Tan
|
b38643c9a8
|
YARN-7473. Implement Framework and policy for capacity management of auto created queues. (Suma Shivaprasad via wangda)
Change-Id: Icca7805fe12f6f7fb335effff4b121b6f7f6337b
|
2017-12-08 15:10:16 -08:00 |
|
Wangda Tan
|
74665e3a7d
|
YARN-7274. Ability to disable elasticity at leaf queue level. (Zian Chen via wangda)
Change-Id: Ic8d43e297f0f5de788b562f7eff8106c5c35e8d2
|
2017-12-08 15:07:56 -08:00 |
|
Sunil G
|
532bbf4602
|
YARN-7533. Documentation for absolute resource support in Capacity Scheduler. Contributed by Sunil G.
|
2017-12-07 18:56:54 -08:00 |
|
Sunil G
|
4db4a4a165
|
YARN-7575. NPE in scheduler UI when max-capacity is not configured. Contributed by Sunil G.
|
2017-12-07 18:56:54 -08:00 |
|
Sunil G
|
daa1cdd062
|
YARN-7564. Cleanup to fix checkstyle issues of YARN-5881 branch. Contributed by Sunil G.
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
1012b901c8
|
YARN-7544. Use queue-path.capacity/maximum-capacity to specify absolute min/max resources. (Sunil G via wangda)
Change-Id: I685341be213eee500f51e02f01c91def89391c17
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
b7b8cd5324
|
YARN-7538. Fix performance regression introduced by Capacity Scheduler absolute min/max resource refactoring. (Sunil G via wangda)
Change-Id: Ic9bd7e599c56970fe01cb0e1bba6df7d1f77eb29
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
7462c38277
|
YARN-7483. CapacityScheduler test cases cleanup post YARN-5881. (Sunil G via wangda)
Change-Id: I9741a6baf5cb7352d05636efb6c0b24790e7589a
|
2017-12-07 18:56:54 -08:00 |
|
Rohith Sharma K S
|
e65ca92fb6
|
YARN-7482. Max applications calculation per queue has to be retrospected with absolute resource support. Contributed by Sunil G.
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
034b312d9f
|
YARN-7411. Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee. (Sunil G via wangda)
Change-Id: I41b1d7558c20fc4eb2050d40134175a2ef6330cb
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
aa3f62740f
|
YARN-7332. Compute effectiveCapacity per each resource vector. (Sunil G via wangda)
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
d52627a7cb
|
YARN-7254. UI and metrics changes related to absolute resource configuration. (Sunil G via wangda)
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
5e798b1a0d
|
YARN-6471. Support to add min/max resource configuration for a queue. (Sunil G via wangda)
Change-Id: I9213f5297a6841fab5c573e85ee4c4e5f4a0b7ff
|
2017-12-07 18:56:54 -08:00 |
|
Weiwei Yang
|
e411dd6666
|
YARN-7607. Remove the trailing duplicated timestamp in container diagnostics message. Contributed by Weiwei Yang.
|
2017-12-07 17:29:40 +08:00 |
|
Weiwei Yang
|
40b0045ebe
|
YARN-7610. Extend Distributed Shell to support launching job with opportunistic containers. Contributed by Weiwei Yang.
|
2017-12-06 17:52:41 +08:00 |
|
Weiwei Yang
|
05c347fe51
|
YARN-7611. Node manager web UI should display container type in containers page. Contributed by Weiwei Yang.
|
2017-12-06 12:21:52 +08:00 |
|
Wangda Tan
|
0311cf0535
|
YARN-7381. Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml. (Xuan Gong via wangda)
Change-Id: I1ed58dafad5cc276eea5c0b0813cf04f57d73a87
|
2017-12-05 13:09:49 -08:00 |
|
Sunil G
|
a957f1c60e
|
YARN-7438. Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm. Contributed by Wangda Tan
|
2017-12-05 22:50:07 +05:30 |
|
Sunil G
|
99ccca341f
|
YARN-7092. Render application specific log under application tab in new YARN UI. Contributed by Akhil PB.
|
2017-12-05 19:41:07 +05:30 |
|
Sunil G
|
f9f317b702
|
YARN-7586. Application Placement should be done before ACL checks in ResourceManager. Contributed by Suma Shivaprasad.
|
2017-12-05 18:28:31 +05:30 |
|
Arpit Agarwal
|
e00c7f78c1
|
HADOOP-14976. Set HADOOP_SHELL_EXECNAME explicitly in scripts.
|
2017-12-04 21:02:04 -08:00 |
|
Robert Kanter
|
d8863fc16f
|
YARN-5594. Handle old RMDelegationToken format when recovering RM (rkanter)
|
2017-12-04 13:14:55 -08:00 |
|
Eric Yang
|
d30d57828f
|
YARN-6669. Implemented Kerberos security for YARN service framework. (Contributed by Jian He)
|
2017-12-04 15:11:00 -05:00 |
|
Arun Suresh
|
37ca416950
|
YARN-7587. Skip dispatching opportunistic containers to nodes whose queue is already full. (Weiwei Yang via asuresh)
|
2017-12-03 22:22:01 -08:00 |
|
Sunil G
|
81f6e46b2f
|
YARN-6907. Node information page in the old web UI should report resource types. Contributed by Gergely Novák.
|
2017-12-04 11:27:23 +05:30 |
|
Sunil G
|
30f2646b15
|
YARN-7594. TestNMWebServices#testGetNMResourceInfo fails on trunk. Contributed by Gergely Novák.
|
2017-12-04 10:45:07 +05:30 |
|
Jason Lowe
|
60f95fb719
|
YARN-7455. quote_and_append_arg can overflow buffer. Contributed by Jim Brennan
|
2017-12-01 15:47:01 -06:00 |
|
Jason Lowe
|
25df505421
|
YARN-7589. TestPBImplRecords fails with NullPointerException. Contributed by Daniel Templeton
|
2017-12-01 15:37:36 -06:00 |
|
Robert Kanter
|
c83fe44917
|
YARN-4813. TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently (grepas via rkanter)
|
2017-12-01 12:18:13 -08:00 |
|
Wangda Tan
|
7225ec0ceb
|
YARN-6507. Add support in NodeManager to isolate FPGA devices with CGroups. (Zhankun Tang via wangda)
Change-Id: Ic9afd841805f1035423915a0b0add5f3ba96cf9d
|
2017-12-01 10:50:49 -08:00 |
|
Sunil G
|
556aea3f36
|
YARN-7487. Ensure volume to include GPU base libraries after created by plugin. Contributed by Wangda Tan.
|
2017-12-01 13:36:28 +05:30 |
|
Sunil G
|
4653aa3eb3
|
YARN-7546. Layout changes in Queue UI to show queue details on right pane. Contributed by Vasudevan Skm.
|
2017-12-01 13:26:01 +05:30 |
|
Wangda Tan
|
a63d19d365
|
YARN-6124. Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues. (Zian Chen via wangda)
Change-Id: Id93656f3af7dcd78cafa94e33663c78d410d43c2
|
2017-11-30 15:57:22 -08:00 |
|
Junping Du
|
a409425986
|
YARN-7558. yarn logs command fails to get logs for running containers if UI authentication is enabled. Contributed by Xuan Gong.
|
2017-11-30 13:47:47 -08:00 |
|
Jason Lowe
|
5cfaee2e6d
|
YARN-7495. Improve robustness of the AggregatedLogDeletionService. Contributed by Jonathan Eagles
|
2017-11-30 12:39:18 -06:00 |
|
Wangda Tan
|
c9a54aab6b
|
YARN-7573. Gpu Information page could be empty for nodes without GPU. (Sunil G via wangda)
Change-Id: I7f614e5a589a09ce4e4286c84b706e05c29abd14
|
2017-11-29 17:46:16 -08:00 |
|
Wei Yan
|
333ef303ff
|
YARN-6851. Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat.
|
2017-11-29 14:38:07 -08:00 |
|
Daniel Templeton
|
8498d287cd
|
YARN-7541. Node updates don't update the maximum cluster capability for resources other than CPU and memory
|
2017-11-29 11:11:36 -08:00 |
|
Jason Lowe
|
a2c7a73e33
|
YARN-6647. RM can crash during transitionToStandby due to InterruptedException. Contributed by Bibin A Chundatt
|
2017-11-28 11:15:44 -06:00 |
|
Sunil G
|
6b76695f88
|
YARN-7480. Render tooltips on columns where text is clipped in new YARN UI. Contributed by Vasudevan Skm. This closes #293
|
2017-11-28 22:41:52 +05:30 |
|
Sunil G
|
641ba5c7a1
|
YARN-7499. Layout changes to Application details page in new YARN UI. Contributed by Vasudevan Skm.
|
2017-11-28 18:37:11 +05:30 |
|
Yufei Gu
|
d8923cdbf1
|
YARN-7363. ContainerLocalizer don't have a valid log4j config in case of Linux container executor. (Contributed by Yufei Gu)
|
2017-11-27 14:31:52 -08:00 |
|
Jian He
|
fedabcad42
|
YARN-6168. Restarted RM may not inform AM about all existing containers. Contributed by Chandni Singh
|
2017-11-27 10:19:58 -08:00 |
|
Yufei Gu
|
2bde3aedf1
|
YARN-7290. Method canContainerBePreempted can return true when it shouldn't. (Contributed by Steven Rand)
|
2017-11-24 23:32:46 -08:00 |
|
Wangda Tan
|
834e91ee91
|
YARN-7509. AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby. (Tao Yang via wangda)
Change-Id: I7477fe355419fd4a0a6e2bdda7319abad4c4c748
|
2017-11-23 19:59:03 -08:00 |
|
Arun Suresh
|
b46ca7e73b
|
YARN-6483. Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM. (Juan Rodriguez Hortala via asuresh)
|
2017-11-22 19:18:30 -08:00 |
|
Sunil G
|
aab439593b
|
YARN-7330. Add support to show GPU in UI including metrics. Contributed by Wangda Tan.
|
2017-11-23 07:54:20 +05:30 |
|
Yufei Gu
|
4cc9479dae
|
YARN-7524. Remove unused FairSchedulerEventLog. (Contributed by Wilfred Spiegelenburg)
|
2017-11-22 14:18:36 -08:00 |
|
Eric Yang
|
d42a336cfa
|
YARN-5534. Allow user provided Docker volume mount list. (Contributed by Shane Kumpf)
|
2017-11-22 13:05:34 -05:00 |
|
Steve Loughran
|
de8b6ca5ef
|
HADOOP-13786 Add S3A committer for zero-rename commits to S3 endpoints.
Contributed by Steve Loughran and Ryan Blue.
|
2017-11-22 15:28:12 +00:00 |
|
yufei
|
03c311eae3
|
YARN-7513. Remove the scheduler lock in FSAppAttempt.getWeight() (Contributed by Wilfred Spiegelenburg)
|
2017-11-21 10:33:34 -08:00 |
|
Haibo Chen
|
67bbbe1c0c
|
YARN-7531. ResourceRequest.equal does not check ExecutionTypeRequest.enforceExecutionType().
|
2017-11-21 09:09:16 -08:00 |
|
Wangda Tan
|
0d781dd03b
|
YARN-7527. Over-allocate node resource in async-scheduling mode of CapacityScheduler. (Tao Yang via wangda)
Change-Id: I51ae6c2ab7a3d1febdd7d8d0519b63a13295ac7d
|
2017-11-20 11:48:15 -08:00 |
|
Billie Rinaldi
|
6f9d7a146d
|
YARN-7529. TestYarnNativeServices#testRecoverComponentsAfterRMRestart() fails intermittently. Contributed by Chandni Singh
|
2017-11-20 07:37:04 -08:00 |
|
bibinchundatt
|
b5b81a4f08
|
YARN-7489. ConcurrentModificationException in RMAppImpl#getRMAppMetrics. Contributed by Tao Yang.
|
2017-11-18 19:25:29 +05:30 |
|
bibinchundatt
|
96e6a99360
|
YARN-7525. Incorrect query parameters in cluster nodes REST API document. Contributed by Tao Yang.
|
2017-11-18 19:02:11 +05:30 |
|
Subru Krishnan
|
d5f66888b8
|
YARN-6128. Add support for AMRMProxy HA. (Botong Huang via Subru).
|
2017-11-17 17:39:06 -08:00 |
|
Eric Yang
|
0940e4f692
|
YARN-7218. Decouple YARN Services REST API namespace from RM. (Contributed by Eric Yang)
|
2017-11-17 12:28:12 -05:00 |
|
Varun Vasudev
|
5f0b238a11
|
YARN-7430. Enable user re-mapping for Docker containers by default. Contributed by Eric Yang.
|
2017-11-17 12:04:47 +05:30 |
|
Wangda Tan
|
0987a7b8cb
|
YARN-7419. CapacityScheduler: Allow auto leaf queue creation after queue mapping. (Suma Shivaprasad via wangda)
Change-Id: Ia1704bb8cb5070e5b180b5a85787d7b9ca57ebc6
|
2017-11-16 11:25:52 -08:00 |
|
Jian He
|
6bf2c30192
|
YARN-7503. Configurable heap size / JVM opts in service AM. Contributed by Jonathan Hung
|
2017-11-16 10:53:55 -08:00 |
|
Haibo Chen
|
28d0fcbef4
|
YARN-7390. All reservation related test cases failed when TestYarnClient runs against Fair Scheduler. (Yufei Gu via Haibo Chen)
|
2017-11-16 10:48:24 -08:00 |
|
Sunil G
|
61ace174cd
|
YARN-7469. Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit. Contributed by Eric Payne.
|
2017-11-16 22:34:23 +05:30 |
|
Billie Rinaldi
|
f4d5d20286
|
YARN-7486. Race condition in service AM that can cause NPE. Contributed by Jian He
|
2017-11-16 07:58:06 -08:00 |
|
Sunil G
|
09a1342608
|
YARN-7492. Set up SASS for new YARN UI styling. Contributed by Vasudevan Skm.
|
2017-11-16 13:44:21 +05:30 |
|
Jason Lowe
|
fac72eef23
|
YARN-7361. Improve the docker container runtime documentation. Contributed by Shane Kumpf
|
2017-11-15 12:32:02 -06:00 |
|
Daniel Templeton
|
b246c54749
|
YARN-7414. FairScheduler#getAppWeight() should be moved into FSAppAttempt#getWeight()
(Contributed by Soumabrata Chakraborty via Daniel Templeton)
|
2017-11-15 10:03:29 -08:00 |
|
Daniel Templeton
|
e094eb74b9
|
YARN-6953. Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()
(Contributed by Manikandan R via Daniel Templeton)
|
2017-11-15 10:03:29 -08:00 |
|
Sunil G
|
2f379d412b
|
YARN-7464. Introduce filters in Nodes page of new YARN UI. Contributed by Vasudevan Skm.
|
2017-11-15 14:02:53 +05:30 |
|
Sunil G
|
c4c57b80e1
|
YARN-7462. Render outstanding resource requests on application page of new YARN UI. Contributed by Vasudevan Skm.
|
2017-11-15 12:01:29 +05:30 |
|
Jian He
|
4f40cd314a
|
YARN-7488. Make ServiceClient.getAppId method public to return ApplicationId for a service name. Contributed by Gour Saha
|
2017-11-13 18:57:56 -08:00 |
|
Jian He
|
5323b0048b
|
YARN-7466. ResourceRequest has a different default for allocationRequestId than Container. Contributed by Chandni Singh
|
2017-11-13 15:37:39 -08:00 |
|
Junping Du
|
e14f03dfbf
|
YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi.
|
2017-11-13 15:27:37 -08:00 |
|
Daniel Templeton
|
040a38dc49
|
YARN-7369. Improve the resource types docs
|
2017-11-13 11:05:07 -08:00 |
|
Daniel Templeton
|
2e512f016e
|
YARN-7442. [YARN-7069] Limit format of resource type name (Contributed by Wangda Tan via Daniel Templeton)
|
2017-11-13 11:03:30 -08:00 |
|
Eric Yang
|
fa4b5c669c
|
YARN-7447. Fixed bug in create YARN services via RM. (Contributed by Billie Rinaldi)
|
2017-11-13 13:59:58 -05:00 |
|
Sunil G
|
fb62bd625f
|
YARN-7445. Render Applications and Services page with filters in new YARN UI. Contributed by Vasudevan Skm.
|
2017-11-13 19:41:49 +05:30 |
|
Subru Krishnan
|
3e26077848
|
YARN-7475. Fix Container log link in new YARN UI. (Sunil G via Subru).
(cherry picked from commit 3c5b46c2edd69bb238d635ae61ff91656dec23df)
|
2017-11-12 09:53:39 -08:00 |
|
Sunil G
|
ff9f7fcf7f
|
YARN-7452. Decommissioning node default value to be zero in new YARN UI. Contributed by Vasudevan Skm.
|
2017-11-11 16:52:31 +05:30 |
|
bibinchundatt
|
2c2b7a3672
|
YARN-7406. Moving logging APIs over to slf4j in hadoop-yarn-api. Contributed by Yeliang Cang.
|
2017-11-11 10:36:27 +05:30 |
|
Wangda Tan
|
dd07038ffa
|
YARN-6909. Use LightWeightedResource when number of resource types more than two. (Sunil G via wangda)
Change-Id: I90e021c5dea7abd9ec6bd73b2287c8adebe14595
|
2017-11-09 14:51:15 -08:00 |
|
Sean Mackrory
|
1883a00249
|
YARN-7465. start-yarn.sh fails to start ResourceManagers unless running as root.
|
2017-11-09 14:47:43 -07:00 |
|
Konstantinos Karanasos
|
ac4d2b1081
|
YARN-7437. Rename PlacementSet and SchedulingPlacementSet. (Wangda Tan via kkaranasos)
|
2017-11-09 13:01:24 -08:00 |
|
Robert Kanter
|
a2c150a736
|
YARN-7386. Duplicate Strings in various places in Yarn memory (misha@cloudera.com via rkanter)
|
2017-11-09 12:12:52 -08:00 |
|
Daniel Templeton
|
462f6c490e
|
YARN-7143. FileNotFound handling in ResourceUtils is inconsistent
Change-Id: Ib1bb487e14a15edd2b5a42cf5078c5a2b295f069
|
2017-11-09 11:58:49 -08:00 |
|
Haibo Chen
|
a1382a18df
|
YARN-7388. TestAMRestart should be scheduler agnostic.
|
2017-11-09 10:49:50 -08:00 |
|
bibinchundatt
|
0a72c2f56c
|
YARN-7454. RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to double lookup. Contributed by Jason Lowe.
|
2017-11-09 21:01:19 +05:30 |
|
Daniel Templeton
|
49b4c0b334
|
YARN-7458. TestContainerManagerSecurity is still flakey
(Contributed by Robert Kanter via Daniel Templeton)
Change-Id: Ibb1975ad086c3a33f8af0b4f8b9a13c3cdca3f7d
|
2017-11-08 17:31:14 -08:00 |
|
Daniel Templeton
|
0de10680b7
|
YARN-7166. Container REST endpoints should report resource types
Change-Id: If9c2fe58d4cf758bb6b6cf363dc01f35f8720987
|
2017-11-08 16:43:49 -08:00 |
|
Arun Suresh
|
cb35a59589
|
YARN-7343. Add a junit test for ContainerScheduler recovery. (Sampada Dehankar via asuresh)
|
2017-11-08 08:14:02 -08:00 |
|
Arun Suresh
|
a9c70b0e84
|
YARN-7453. Fix issue where RM fails to switch to active after first successful start. (Rohith Sharma K S via asuresh)
|
2017-11-08 08:00:53 -08:00 |
|
Daniel Templeton
|
8db9d61ac2
|
YARN-7401. Reduce lock contention in ClusterNodeTracker#getClusterCapacity()
|
2017-11-07 14:53:48 -08:00 |
|
Wangda Tan
|
13fa2d4e3e
|
YARN-7394. Merge code paths for Reservation/Plan queues and Auto Created queues. (Suma Shivaprasad via wangda)
|
2017-11-06 21:38:24 -08:00 |
|
Haibo Chen
|
8f214dc4f8
|
YARN-7360. TestRM.testNMTokenSentForNormalContainer() should be scheduler agnostic.
|
2017-11-06 15:45:37 -08:00 |
|
Jian He
|
a55d0738f1
|
YARN-7371. Added allocateRequestId in NMContainerStatus for recovery. Contributed by Chandni Singh
|
2017-11-06 13:30:20 -08:00 |
|
Billie Rinaldi
|
a127f7b0fb
|
YARN-7423. Improve service client loggings. Contributed by Jian He
|
2017-11-06 13:30:20 -08:00 |
|
Billie Rinaldi
|
a6c4bd74b6
|
YARN-6394. Support specifying YARN related params in the service REST API. Contributed by Jian He
|
2017-11-06 13:30:20 -08:00 |
|
Jian He
|
a288b0accf
|
YARN-7331. Change in few metrics in new YARN UI related to native-services. Contributed by Sunil G
|
2017-11-06 13:30:20 -08:00 |
|
Jian He
|
ba7ed7b66a
|
YARN-7384. Remove apiserver cmd and merge service cmd into application cmd. Contributed by Billie Rinaldi
|
2017-11-06 13:30:19 -08:00 |
|
Billie Rinaldi
|
8ec9e72cc3
|
YARN-7393. RegistryDNS doesn't work in tcp channel. Contributed by Eric Yang
|
2017-11-06 13:30:19 -08:00 |
|
Billie Rinaldi
|
d2775fbcca
|
YARN-7351. Fix high CPU usage issue in RegistryDNS. Contributed by Jian He
|
2017-11-06 13:30:19 -08:00 |
|
Billie Rinaldi
|
501be9b4be
|
YARN-7326. Add recursion support and configure RegistryDNS to lookup upstream. Contributed by Eric Yang
|
2017-11-06 13:30:19 -08:00 |
|
Billie Rinaldi
|
68acd88dcb
|
YARN-7323. Data structure update in service REST API. Contributed by Jian He
|
2017-11-06 13:30:18 -08:00 |
|
Jian He
|
3c30b1a97d
|
Rebase to trunk
|
2017-11-06 13:30:18 -08:00 |
|
Jian He
|
9273480084
|
YARN-7198. Add jsvc support for RegistryDNS. Contributed by Billie Rinaldi
|
2017-11-06 13:30:18 -08:00 |
|
Jian He
|
b57144a172
|
YARN-7202. Add UT for api-server. Contributed by Eric Yang
|
2017-11-06 13:30:18 -08:00 |
|
Jian He
|
b8a7ef1b64
|
YARN-6744. Recover component information on YARN native services AM restart. Contributed by Billie Rinaldi
|
2017-11-06 13:30:18 -08:00 |
|
Jian He
|
c723021579
|
YARN-6626. Embed REST API service into RM. Contributed by Eric Yang
|
2017-11-06 13:30:17 -08:00 |
|
Jian He
|
673c0db43c
|
Revert "YARN-6626. Embed REST API service into RM. Contributed by Eric Yang"
This reverts commit 63d1084e9781e0fee876916190b69f6242dd00e4.
|
2017-11-06 13:30:17 -08:00 |
|
Jian He
|
9e677fa05c
|
YARN-6626. Embed REST API service into RM. Contributed by Eric Yang
|
2017-11-06 13:30:17 -08:00 |
|
Billie Rinaldi
|
8851209788
|
YARN-7191. Improve yarn-service documentation. Contributed by Jian He
|
2017-11-06 13:30:17 -08:00 |
|
Jian He
|
c70e5df100
|
YARN-7201. Added an apache httpd example YARN service. Contributed by Billie Rinaldi
|
2017-11-06 13:30:16 -08:00 |
|
Billie Rinaldi
|
ce74e64363
|
YARN-7210. Some NPE fixes in Registry DNS. Contributed by Jian He
|
2017-11-06 13:30:16 -08:00 |
|
Billie Rinaldi
|
37c9b7327d
|
YARN-7186. Add examples in yarn-service. Contributed by Jian He
|
2017-11-06 13:30:16 -08:00 |
|
Jian He
|
307d55b3e1
|
Rebased onto trunk - fix conflicts
|
2017-11-06 13:30:15 -08:00 |
|
Gour Saha
|
541b64c798
|
YARN-7165. Miscellaneous fixes in yarn-native-services. Contributed by Jian He
|
2017-11-06 13:30:15 -08:00 |
|
Jian He
|
b9ca13e34b
|
YARN-7161. Fix special chars in DNS documentation. Contributed by Gour Saha
|
2017-11-06 13:30:15 -08:00 |
|
Jian He
|
eed9e3e8f4
|
Rebase onto trunk - fix some issues. Contributed by Rohith Sharma K S
|
2017-11-06 13:30:14 -08:00 |
|
Jian He
|
e660e52a04
|
YARN-7126. Create introductory site documentation for YARN native services. Contributed by Gour Saha
|
2017-11-06 13:30:14 -08:00 |
|
Jian He
|
7dd4490a44
|
YARN-7073. Yarn native services rest API documentation. Contributed by Gour Saha
|
2017-11-06 13:30:14 -08:00 |
|
Jian He
|
bd96c4c235
|
Rebase onto latest trunk. minor conflicts
|
2017-11-06 13:30:13 -08:00 |
|
Jian He
|
59fe98cd50
|
YARN-7100. Added JsonIgnore annotation to Resource#getMemoryMB. Contributed by Eric Yang
|
2017-11-06 13:30:13 -08:00 |
|
Jian He
|
fecf22b2fd
|
YARN-7113. Clean up packaging and dependencies for yarn-native-services. Contributed by Billie Rinaldi
|
2017-11-06 13:30:13 -08:00 |
|
Billie Rinaldi
|
40ab068eab
|
YARN-7091. Rename application to service in yarn-native-services. Contributed by Jian He
|
2017-11-06 13:30:13 -08:00 |
|
Gour Saha
|
2ba38ce8ec
|
YARN-5244. Documentation required for DNS Server implementation. Contributed by Jon Maron
|
2017-11-06 13:30:12 -08:00 |
|
Billie Rinaldi
|
2191f5b533
|
YARN-7050. Post cleanup after YARN-6903, removal of org.apache.slider package. Contributed by Jian He
|
2017-11-06 13:30:12 -08:00 |
|
Billie Rinaldi
|
79bf5c084d
|
YARN-7029. Add more UTs in yarn-native-services. Contributed by Jian He
|
2017-11-06 13:30:11 -08:00 |
|
Billie Rinaldi
|
1888318c89
|
YARN-6903. Yarn-native-service framework core rewrite. Contributed by Jian He
|
2017-11-06 13:30:11 -08:00 |
|
Jian He
|
27dcc67959
|
Update pom version to 3.0.0-beta1-SNAPSHOT
|
2017-11-06 13:30:10 -08:00 |
|
Jian He
|
8d335e59cf
|
YARN-6804. [yarn-native-services changes] Allow custom hostname for docker containers in native services. Contributed by Billie Rinaldi
|
2017-11-06 13:30:10 -08:00 |
|
Billie Rinaldi
|
14f3f3b42e
|
YARN-6655. Fix compilation failure in TestServiceApiUtil due to changes in YARN-6716.
|
2017-11-06 13:30:10 -08:00 |
|
Jian He
|
59a9b4f438
|
YARN-6655. Validate yarn native services application submission side to ensure that the hostname should be less than 63 characters. Contributed by Billie Rinaldi
|
2017-11-06 13:30:09 -08:00 |
|
Jian He
|
e86d828548
|
YARN-6716. Native services support for specifying component start order. Contributed by Billie Rinaldi
|
2017-11-06 13:30:09 -08:00 |
|
Akira Ajisaka
|
b7e5d739ba
|
YARN-6722. Bumping up pom file hadoop version. Contributed by Panagiotis Garefalakis.
|
2017-11-06 13:30:09 -08:00 |
|
Billie Rinaldi
|
a0b9e8a630
|
YARN-6617. Services API delete call first attempt usually fails. Contributed by Jian He
|
2017-11-06 13:30:09 -08:00 |
|
Jian He
|
a0574e7f4f
|
YARN-6613. Update json validation for new native services providers. Contributed by Billie Rinaldi
|
2017-11-06 13:30:08 -08:00 |
|
Jian He
|
9085cd5c6e
|
YARN-6160. Create an agent-less docker-less provider in the native services framework. Contributed by Billie Rinaldi
|
2017-11-06 13:30:08 -08:00 |
|
Gour Saha
|
a22256bd40
|
YARN-6544. Add Null check RegistryDNS service while parsing registry records. Contributed by Karam Singh
|
2017-11-06 13:30:08 -08:00 |
|
Billie Rinaldi
|
02d68c4bcf
|
YARN-6588. Add native-service AM log4j properties in classpath. Contributed by Jian He
|
2017-11-06 13:30:08 -08:00 |
|
Jian He
|
a041373dd4
|
YARN-6533. Race condition in writing service record to registry in yarn native services. Contributed by Billie Rinaldi
|
2017-11-06 13:30:08 -08:00 |
|
Billie Rinaldi
|
ce05c6e981
|
YARN-6545. Followup fix for YARN-6405. Contributed by Jian He
|
2017-11-06 13:30:07 -08:00 |
|
Sunil G
|
399525c2e0
|
YARN-6398. Support to add native-service specific details in new YARN UI. Contributed by Akhil PB.
|
2017-11-06 13:30:07 -08:00 |
|
Sunil G
|
ba812bf67f
|
YARN-6446. addendum patch. Contributed by Rohith Sharma K S.
|
2017-11-06 13:30:07 -08:00 |
|
Jian He
|
a8a273b064
|
YARN-6446. Revisit ATSv2 integration to ensure all required information is published. Contributed by Rohith Sharma K S
|
2017-11-06 13:30:07 -08:00 |
|
Sunil G
|
08cdf231a0
|
YARN-6419. Support to launch new native-service from new YARN UI. Contributed by Akhil PB.
|
2017-11-06 13:30:06 -08:00 |
|
Billie Rinaldi
|
845764da14
|
YARN-6405. Improve configuring services through REST API. Contributed by Jian He
|
2017-11-06 13:28:42 -08:00 |
|
Jian He
|
384ee13eec
|
YARN-6335. Port slider's groovy unit tests to yarn native services. Contributed by Billie Rinaldi
|
2017-11-06 13:28:42 -08:00 |
|
Jian He
|
c3ac67e3e1
|
Rebase to latest trunk, fix conflicts and pom.xml
|
2017-11-06 13:28:41 -08:00 |
|
Jian He
|
fd9d0d4ead
|
YARN-6400. Remove some unneeded code after YARN-6255. Contributed by Jian He
|
2017-11-06 13:28:41 -08:00 |
|
Jian He
|
f4216b7bba
|
YARN-6395. Integrate service app master to write data into ATSv2. Contributed by Rohith Sharma K S
|
2017-11-06 13:28:41 -08:00 |
|
Jian He
|
c31cd981eb
|
YARN-6255. Refactor yarn-native-services framework. Contributed by Jian He
|
2017-11-06 13:28:41 -08:00 |
|
Billie Rinaldi
|
024e90a508
|
YARN-6192. Move yarn-native-service API records into hadoop-yarn-slider-core module. Contributed by Jian He
|
2017-11-06 13:28:41 -08:00 |
|
Gour Saha
|
0ed8d4ebe6
|
YARN-6205. Default lifetime for native services app is invalid. Contributed by Billie Rinaldi
|
2017-11-06 13:28:40 -08:00 |
|
Gour Saha
|
500695d726
|
YARN-6185. Apply SLIDER-1199 to yarn native services for blacklisting nodes. Contributed by Billie Rinaldi
|
2017-11-06 13:28:40 -08:00 |
|
Gour Saha
|
8967a1b812
|
YARN-6186 Handle InvalidResourceRequestException in native services AM onError
|
2017-11-06 13:28:40 -08:00 |
|
Billie Rinaldi
|
e34ca6b02d
|
YARN-6173. Add artifact info and privileged container details to the container info in API GET response. Contributed by Gour Saha
|
2017-11-06 13:28:40 -08:00 |
|
Jian He
|
68940ab8f6
|
Updated pom to point to 3.0.0-alpha3-SNAPSHOT
|
2017-11-06 13:28:40 -08:00 |
|
Billie Rinaldi
|
d943eb4c15
|
YARN-6132. SliderClient bondToCluster should call findInstance with live states filter. Contributed by Gour Saha
|
2017-11-06 13:28:40 -08:00 |
|
Billie Rinaldi
|
7edc154e0e
|
YARN-6115. Few additional paths in Slider client still uses get all Applications without tags/states filter. Contributed by Gour Saha
|
2017-11-06 13:28:40 -08:00 |
|
Gour Saha
|
a5e20f0fc1
|
YARN-5993. Allow native services quicklinks to be exported for each component. Contributed by Billie Rinaldi
|
2017-11-06 13:28:39 -08:00 |
|
Varun Vasudev
|
7d685f2fb3
|
YARN-4757. Add the ability to split reverse zone subnets. Contributed by Shane Kumpf.
(cherry picked from commit 9bff70f1316d889c3109c68dd308c8f456229bf8)
|
2017-11-06 13:28:39 -08:00 |
|
Jian He
|
f934f62fc7
|
YARN-5218. Initial core change for DNS for YARN. Contributed by Jonathan Maron
|
2017-11-06 13:28:39 -08:00 |
|
Billie Rinaldi
|
74fff4086e
|
YARN-6014. Followup fix for slider core module findbugs. Contributed by Jian He
|
2017-11-06 13:28:39 -08:00 |
|
Billie Rinaldi
|
1ea43c443e
|
YARN-6010. Fix findbugs, site warnings in yarn-services-api module. Contributed by Jian He
|
2017-11-06 13:28:38 -08:00 |
|
Jian He
|
0b00c8e56b
|
YARN-5968. Fix slider core module javadocs. Contributed by Billie Rinaldi
|
2017-11-06 13:28:38 -08:00 |
|
Billie Rinaldi
|
db96e8aa21
|
YARN-5967. Fix slider core module findbugs warnings. Contributed by Jian He
|
2017-11-06 13:28:38 -08:00 |
|
Gour Saha
|
c11f4b3c21
|
YARN-5996. Native services AM kills app on AMRMClientAsync onError call. Contributed by Billie Rinaldi
|
2017-11-06 13:28:38 -08:00 |
|
Gour Saha
|
2e1fa61253
|
YARN-5740. Add a new field in Slider status output - lifetime (remaining). Contributed by Jian He
|
2017-11-06 13:28:37 -08:00 |
|
Billie Rinaldi
|
2cea59dc54
|
YARN-5975. Remove the agent - slider AM ssl related code. Contributed by Jian He
|
2017-11-06 13:28:37 -08:00 |
|
Jian He
|
efe7d44ead
|
YARN-5961. Generate native services protobuf classes during build. Contributed by Billie Rinaldi
|
2017-11-06 13:28:37 -08:00 |
|
Gour Saha
|
e4f0263e51
|
YARN-5958. Fix ASF license warnings for slider core module. Contributed by Billie Rinaldi
|
2017-11-06 13:28:37 -08:00 |
|
Gour Saha
|
1f44e6a5f4
|
YARN-5944. Native services AM should remain up if RM is down. Contributed by Billie Rinaldi
|
2017-11-06 13:28:37 -08:00 |
|
Gour Saha
|
6143aa135b
|
YARN-5769. Integrate update app lifetime using feature implemented in YARN-5611. Contributed by Jian He
|
2017-11-06 13:28:37 -08:00 |
|
Gour Saha
|
bd0e9f91b6
|
YARN-5941. Slider handles "per.component" for multiple components incorrectly. Contributed by Billie Rinaldi
|
2017-11-06 13:28:37 -08:00 |
|
Gour Saha
|
4f43ebdb9f
|
YARN-5943. Write native services container stderr file to log directory. Contributed by Billie Rinaldi
|
2017-11-06 13:28:36 -08:00 |
|
Billie Rinaldi
|
7b8fd3abd6
|
YARN-5883 Avoid or eliminate expensive YARN get all applications call. Contributed by Gour Saha
|
2017-11-06 13:28:36 -08:00 |
|
Jian He
|
234dba84a1
|
YARN-5909. Remove agent related code in slider AM. Contributed by Jian He
|
2017-11-06 13:28:36 -08:00 |
|
Gour Saha
|
2c4e0f33e9
|
YARN-5808. Add gc log options to the yarn daemon script when starting services-api. Contributed by Billie Rinaldi
|
2017-11-06 13:28:35 -08:00 |
|
Gour Saha
|
d1ee95981e
|
YARN-5828. Native services client errors out when config formats are uppercase. Contributed by Billie Rinaldi
|
2017-11-06 13:28:35 -08:00 |
|
Jian He
|
7757f6fe4a
|
YARN-5812. Exception during GET call - "Failed to retrieve application: null". Contributed by Gour Saha
|
2017-11-06 13:28:35 -08:00 |
|
Gour Saha
|
25411a1742
|
YARN-5813. Slider should not try to set a negative lifetime timeout value. Contributed by Jian He
|
2017-11-06 13:28:35 -08:00 |
|
Jian He
|
3741e5518f
|
YARN-5796. Convert enums values in service code to upper case and special handling of an error. Contributed by Gour Saha
|
2017-11-06 13:28:34 -08:00 |
|
Gour Saha
|
09e4b9e897
|
YARN-5690. Integrate native services modules into maven build. Contributed by Billie Rinaldi
|
2017-11-06 13:28:34 -08:00 |
|
Billie Rinaldi
|
ef5a3628c2
|
YARN-5770. Performance improvement of native-services REST API service. Contributed by Gour Saha
|
2017-11-06 13:28:34 -08:00 |
|
Gour Saha
|
1d7a42e795
|
YARN-5680. Add 2 new fields in Slider status output - image-name and is-privileged-container. Contributed by Billie Rinaldi
|
2017-11-06 13:28:34 -08:00 |
|
Billie Rinaldi
|
773c565ac5
|
YARN-5775. Convert enums in swagger definition to uppercase. Contributed by Gour Saha
|
2017-11-06 13:28:34 -08:00 |
|
Gour Saha
|
6bdfce3ac7
|
YARN-5778. Add .keep file for yarn native services AM web app. Contributed by Billie Rinaldi
|
2017-11-06 13:28:34 -08:00 |
|
Jian He
|
f206a43954
|
YARN-5701. Fix issues in yarn native services apps-of-apps. Contributed by Billie Rinaldi
|
2017-11-06 13:28:33 -08:00 |
|
Gour Saha
|
4ec1cbe86d
|
YARN-5735. Make the service REST API use the app timeout feature YARN-4205. Contributed by Jian He
|
2017-11-06 13:28:33 -08:00 |
|
Jian He
|
7da243ebe0
|
YARN-5729. Bug fixes for the service Rest API. Contributed by Gour Saha
|
2017-11-06 13:28:33 -08:00 |
|
Jian He
|
c0120e51b9
|
YARN-5689. Update native services REST API to use agentless docker provider. Contributed by Billie Rinaldi & Gour Saha
|
2017-11-06 13:28:33 -08:00 |
|
Jian He
|
f66ecfecf6
|
Addendum patch for YARN-5610. Contributed by Gour Saha
|
2017-11-06 13:28:33 -08:00 |
|
Jian He
|
295b87d0fb
|
YARN-5675. Swagger definition for YARN service API. Contributed by Gour Saha
|
2017-11-06 13:28:33 -08:00 |
|
Jian He
|
18bf0dce28
|
YARN-5610. Initial code for native services REST API. Contributed by Gour Saha
|
2017-11-06 13:28:33 -08:00 |
|
Jian He
|
9dc46aa379
|
YARN-5623. Apply SLIDER-1166 to yarn-native-services branch. Contributed by Gour Saha
|
2017-11-06 13:28:32 -08:00 |
|
Jian He
|
bce06ed1af
|
YARN-5505. Create an agent-less docker provider in the native-services framework. Contributed by Billie Rinaldi
|
2017-11-06 13:28:32 -08:00 |
|
Jian He
|
3279baecb9
|
YARN-5538. Apply SLIDER-875 to yarn-native-services. Contributed by Billie Rinaldi
|
2017-11-06 13:28:32 -08:00 |
|
Jian He
|
02e2740bdf
|
YARN-5513. Move Java only tests from slider develop to yarn-native-services. Contributed by Gour Saha
|
2017-11-06 13:28:32 -08:00 |
|
Jian He
|
54ec9e2440
|
Modify pom file for slider
|
2017-11-06 13:28:32 -08:00 |
|
Jian He
|
804bb82d1b
|
Rename org.apache.slider.core.build to org.apache.slider.core.buildutils
|
2017-11-06 13:28:32 -08:00 |
|
Jian He
|
f47df51791
|
YARN-5461. Initial code ported from slider-core module. (jianhe)
|
2017-11-06 13:28:31 -08:00 |
|
bibinchundatt
|
dcd99c4b9a
|
Add containerId to Localizer failed logs. Contributed by Prabhu Joseph
|
2017-11-06 22:39:10 +05:30 |
|
Sunil G
|
c41728486b
|
YARN-7392. Render cluster information on new YARN web ui. Contributed by Vasudevan Skm.
|
2017-11-03 11:45:50 +05:30 |
|
Inigo Goiri
|
6fc09beac4
|
YARN-7434. Router getApps REST invocation fails with multiple RMs. Contributed by Inigo Goiri.
|
2017-11-02 21:29:53 -07:00 |
|
Sunil G
|
1700adc6f7
|
YARN-7410. Cleanup FixedValueResource to avoid dependency to ResourceUtils. Contributed by Wangda Tan.
|
2017-11-03 07:25:29 +05:30 |
|
Subru Krishnan
|
ad0fff2b41
|
YARN-7432. Fix DominantResourceFairnessPolicy serializable findbugs issues. (Daniel Templeton via Subru).
|
2017-11-02 17:39:23 -07:00 |
|
Eric Payne
|
e6ec02001f
|
YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák.
|
2017-11-02 12:37:33 -05:00 |
|
Wangda Tan
|
04c604cf1d
|
YARN-7364. Queue dash board in new YARN UI has incorrect values. (Sunil G via wangda)
Change-Id: Ia5336f407147d2985a61b5f9f1e69b5b35f398a4
(cherry picked from commit 752f000e0f521ca7be173d6ca338da4585284fd0)
|
2017-11-02 09:51:28 -07:00 |
|
Jason Lowe
|
d00b6f7c1f
|
YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger
|
2017-11-02 09:37:17 -05:00 |
|
Rohith Sharma K S
|
940ffe3f9c
|
addendum patch for YARN-7289.
|
2017-11-02 13:55:19 +05:30 |
|