Zoltan Siegl
|
ce5eb9cb2e
|
YARN-9358. Add javadoc to new methods introduced in FSQueueMetrics with YARN-9322
(Contributed by Zoltan Siegl via Daniel Templeton)
Change-Id: I92d52c0ca630e71afb26b2b7587cbdbe79254a05
|
2019-03-22 12:28:34 +01:00 |
|
Giovanni Matteo Fumarola
|
548997d6c9
|
YARN-9402. Opportunistic containers should not be scheduled on Decommissioning nodes. Contributed by Abhishek Modi.
|
2019-03-21 12:04:05 -07:00 |
|
Devaraj K
|
a99eb80659
|
YARN-9267. General improvements in FpgaResourceHandlerImpl. Contributed by Peter Bacsko.
|
2019-03-21 11:15:56 -07:00 |
|
Eric Yang
|
506502bb83
|
YARN-9370. Added logging for recovering assigned GPU devices.
Contributed by Yesha Vora
|
2019-03-20 19:12:19 -04:00 |
|
Eric Yang
|
f2b862cac6
|
YARN-9398. Fixed javadoc errors for FPGA related java files.
Contributed by Peter Bacsko
|
2019-03-20 15:45:37 -04:00 |
|
Rohith Sharma K S
|
b3b0e332e6
|
YARN-9299. TestTimelineReaderWhitelistAuthorizationFilter ignores Http Errors. Contributed by Prabhu Joseph.
|
2019-03-20 21:24:31 +05:30 |
|
Rohith Sharma K S
|
0d24684eee
|
YARN-9357. Modify HBase Liveness monitor log to debug. Contributed by Prabhu Joseph.
|
2019-03-20 21:22:54 +05:30 |
|
Rohith Sharma K S
|
c1a4eeb7c8
|
YARN-9389. FlowActivity and FlowRun table prefix is wrong. Contributed by Prabhu Joseph.
|
2019-03-20 21:18:19 +05:30 |
|
Giovanni Matteo Fumarola
|
5d8bd0e5cb
|
YARN-9392. Handle missing scheduler events in Opportunistic Scheduler. Contributed by Abhishek Modi.
|
2019-03-19 11:00:21 -07:00 |
|
Eric Yang
|
09eabda314
|
YARN-9364. Remove commons-logging dependency from YARN.
Contributed by Prabhu Joseph
|
2019-03-18 19:58:42 -04:00 |
|
Eric Yang
|
5f6e225166
|
YARN-9363. Replaced debug logging with SLF4J parameterized log message.
Contributed by Prabhu Joseph
|
2019-03-18 13:57:18 -04:00 |
|
Shweta Yakkali
|
0e7e9013d4
|
YARN-9340. [Clean-up] Remove NULL check before instanceof in ResourceRequestSetKey
(Contributed by Shweta Yakkali via Daniel Templeton)
Change-Id: I932e29b36f086f7b7c76a250e33b473617ddbda1
|
2019-03-18 15:08:37 +01:00 |
|
Eric Yang
|
2064ca015d
|
YARN-9349. Changed logging to use slf4j api.
Contributed by Prabhu Joseph
|
2019-03-15 19:20:59 -04:00 |
|
Eric Yang
|
03f3c8aed2
|
YARN-4404. Corrected typo in javadoc.
Contributed by Yesha Vora
|
2019-03-15 18:04:04 -04:00 |
|
Eric Badger
|
688b177fc6
|
YARN-8376. Separate white list for docker.trusted.registries and docker.privileged-container.registries. Contributed by Eric Yang
|
2019-03-14 19:39:00 +00:00 |
|
Vrushali C
|
f235a942d5
|
YARN-9016 DocumentStore as a backend for ATSv2. Contributed by Sushil Ks.
|
2019-03-13 16:45:23 -07:00 |
|
Vrushali C
|
17a3e14d25
|
YARN-9338 Timeline related testcases are failing. Contributed by Abhishek Modi.
|
2019-03-12 21:33:17 -07:00 |
|
Sunil G
|
8e1539eca8
|
YARN-9266. General improvements in IntelFpgaOpenclPlugin. Contributed by Peter Bacsko.
|
2019-03-13 02:45:17 +05:30 |
|
Sunil G
|
de15a66d78
|
YARN-9265. FPGA plugin fails to recognize Intel Processing Accelerator Card. Contributed by Peter Bacsko.
|
2019-03-08 17:39:22 +05:30 |
|
Eric Yang
|
39b4a37e02
|
YARN-9341. Fixed enentrant lock usage in YARN project.
Contributed by Prabhu Joseph
|
2019-03-07 16:47:45 -05:00 |
|
Vrushali C
|
491313ab84
|
YARN-8218 Add application launch time to ATSV1. Contributed by Abhishek Modi
|
2019-03-06 21:47:29 -08:00 |
|
Sunil G
|
46045c5cb3
|
YARN-9138. Improve test coverage for nvidia-smi binary execution of GpuDiscoverer. Contributed by Szilard Nemeth.
|
2019-03-06 16:01:08 +05:30 |
|
Eric Yang
|
7b42e0e32a
|
YARN-7266. Fixed deadlock in Timeline Server thread initialization.
Contributed by Prabhu Joseph
|
2019-03-05 12:17:01 -05:00 |
|
Yufei Gu
|
0aefe2846f
|
YARN-9298. Implement FS placement rules using PlacementRule interface. Contributed by Wilfred Spiegelenburg.
|
2019-03-04 23:49:07 -08:00 |
|
Prabhu Joseph
|
e40e2d6ad5
|
YARN-7243. Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2019-03-05 14:10:08 +09:00 |
|
bibinchundatt
|
15098df744
|
Revert "YARN-8132. Final Status of applications shown as UNDEFINED in ATS app queries. Contributed by Prabhu Joseph."
This reverts commit a63c358b78 .
|
2019-03-04 16:57:31 +05:30 |
|
Suma Shivaprasad
|
cab8529ecb
|
YARN-7904. Privileged, trusted containers should be supported only in ENTRYPOINT mode. Contributed by Eric Yang.
|
2019-03-01 11:06:09 -08:00 |
|
Sunil G
|
dcaca19871
|
YARN-9139. Simplify initializer code of GpuDiscoverer. Contributed by Szilard Nemeth.
|
2019-03-01 19:24:35 +05:30 |
|
Szilard Nemeth
|
538bb4880d
|
YARN-9323. FSLeafQueue#computeMaxAMResource does not override zero values for custom resources
(Contributed by Szilard Nemeth via Daniel Templeton)
Change-Id: Id844ccf09488f367c0c7de0a3b2d4aca1bba31cc
|
2019-02-27 19:59:48 -08:00 |
|
Szilard Nemeth
|
7b928f19a4
|
YARN-9322. Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo
(Contributed by Szilard Nemeth via Daniel Templeton)
Change-Id: I14c12f1265999d62102f2ec5506d90015efeefe8
|
2019-02-27 19:43:50 -08:00 |
|
Weiwei Yang
|
1779fc57a1
|
YARN-9324. TestSchedulingRequestContainerAllocation(Async) fails with junit-4.11. Contributed by Prabhu Joseph.
|
2019-02-28 09:56:29 +08:00 |
|
Vrushali C
|
ea3cdc60b3
|
YARN-3841 [atsv2 Storage implementation] Adding retry semantics to HDFS backing storage. Contributed by Abhishek Modi.
|
2019-02-27 14:55:35 -08:00 |
|
Vrushali C
|
0ec962ac8f
|
YARN-5336 Limit the flow name size & consider cleanup for hex chars. Contributed by Sushil Ks
|
2019-02-27 14:43:39 -08:00 |
|
Eric Yang
|
fbc7bb315f
|
YARN-9245. Added query docker image command ability to node manager.
Contributed by Chandni Singh
|
2019-02-27 14:57:24 -05:00 |
|
Weiwei Yang
|
8c30114b00
|
YARN-9248. RMContainerImpl:Invalid event: ACQUIRED at KILLED. Contributed by lujie.
|
2019-02-27 17:29:02 +08:00 |
|
Rohith Sharma K S
|
6c96f5e4b6
|
YARN-8378. ApplicationHistoryManagerImpl#getApplications doesn't honor filters. Contributed by Lantao Jin.
|
2019-02-27 10:32:58 +05:30 |
|
Rohith Sharma K S
|
8eae260af5
|
YARN-9311. Fix TestRMRestart hangs. Contributed by Prabhu Joseph.
|
2019-02-27 10:28:16 +05:30 |
|
Weiwei Yang
|
c6ea28c480
|
YARN-9331. [YARN-8851] Fix a bug that lacking cgroup initialization when bootstrap DeviceResourceHandlerImpl. Contributed by Zhankun Tang.
|
2019-02-26 10:05:31 +08:00 |
|
Giovanni Matteo Fumarola
|
95372657fc
|
YARN-9287. Consecutive StringBuilder append should be reuse. Contributed by Ayush Saxena.
|
2019-02-25 11:45:37 -08:00 |
|
Weiwei Yang
|
3e1739d589
|
YARN-9329. updatePriority is blocked when using FairScheduler. Contributed by Jiandan Yang.
|
2019-02-26 00:08:13 +08:00 |
|
Sunil G
|
5e91ebd91a
|
YARN-9121. Replace GpuDiscoverer.getInstance() to a readable object for easy access control. Contributed by Szilard Nemeth.
|
2019-02-25 11:30:46 +05:30 |
|
Weiwei Yang
|
9cd5c5447f
|
YARN-9316. TestPlacementConstraintsUtil#testInterAppConstraintsByAppID fails intermittently. Contributed by Prabhu Joseph.
|
2019-02-24 22:42:27 +08:00 |
|
Weiwei Yang
|
50094d7fef
|
YARN-9300. Lazy preemption should trigger an update on queue preemption metrics for CapacityScheduler. Contributed by Tao Yang.
|
2019-02-24 22:17:29 +08:00 |
|
Sunil G
|
dddcfa4d9f
|
YARN-8821. [YARN-8851] GPU hierarchy/topology scheduling support based on pluggable device framework. Contributed by Zhankun Tang.
|
2019-02-24 14:37:06 +05:30 |
|
bibinchundatt
|
ed13cf8406
|
YARN-9317. Avoid repeated YarnConfiguration#timelineServiceV2Enabled check. Contributed by Prabhu Joseph
|
2019-02-22 21:01:34 +05:30 |
|
Sunil G
|
95fbbfed75
|
YARN-9118. Handle exceptions with parsing user defined GPU devices in GpuDiscoverer. Contributed by Szilard Nemeth.
|
2019-02-22 20:22:17 +05:30 |
|
Weiwei Yang
|
9c88695bcd
|
YARN-9238. Avoid allocating opportunistic containers to previous/removed/non-exist application attempt. Contributed by lujie.
|
2019-02-22 20:58:33 +08:00 |
|
Weiwei Yang
|
632d5e8a98
|
YARN-9156. Improve debug message in device plugin method compatibility check of ResourcePluginManager. Contributed by Zhankun Tang.
|
2019-02-22 11:27:30 +08:00 |
|
Wangda Tan
|
b17a2602d1
|
YARN-9319. Fix compilation issue of handling typedef an existing name by gcc compiler. (Zhankun Tang via wangda)
Change-Id: Ie8293cc5b710ff355fb6a1ea7201be53ed0385bf
|
2019-02-21 11:17:32 -08:00 |
|
Weiwei Yang
|
eedcc8e26e
|
YARN-9315. TestCapacitySchedulerMetrics fails intermittently. Contributed by Prabhu Joseph.
|
2019-02-21 17:21:21 +08:00 |
|
bibinchundatt
|
a63c358b78
|
YARN-8132. Final Status of applications shown as UNDEFINED in ATS app queries. Contributed by Prabhu Joseph.
|
2019-02-21 13:29:01 +05:30 |
|
bibinchundatt
|
b8de78c570
|
YARN-9286. [Timeline Server] Sorting based on FinalStatus shows pop-up message. Contributed by Bilwa S T.
|
2019-02-20 01:19:20 +05:30 |
|
Sunil G
|
db4d1a1e2f
|
YARN-9060. [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example. Contributed by Zhankun Tang.
|
2019-02-18 15:58:04 +05:30 |
|
Akira Ajisaka
|
0f2b65c3da
|
HADOOP-16116. Fix Spelling Mistakes - DECOMISSIONED. Contributed by BELUGA BEHR.
|
2019-02-18 15:21:46 +09:00 |
|
Sunil G
|
ba56bc24f5
|
YARN-9213. RM Web UI v1 does not show custom resource allocations for containers page. Contributed by Szilard Nemeth.
|
2019-02-17 20:08:20 +05:30 |
|
Eric Yang
|
7c1b561e33
|
YARN-8927. Added support for top level Dockerhub images to trusted registry using library keyword.
Contributed by Zhankun Tang
|
2019-02-15 11:18:07 -05:00 |
|
Adam Antal
|
9385ec45d7
|
YARN-9283. Javadoc of LinuxContainerExecutor#addSchedPriorityCommand has a wrong property name as reference
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2019-02-15 18:47:10 +09:00 |
|
Eric Yang
|
3dc2523266
|
YARN-9184. Add a system flag to allow update to latest docker images.
Contributed by Zhaohui Xin
|
2019-02-12 16:16:35 -05:00 |
|
Giovanni Matteo Fumarola
|
7536488bbd
|
YARN-996. REST API support for node resource configuration. Contributed by Inigo Goiri.
|
2019-02-11 15:27:43 -08:00 |
|
Weiwei Yang
|
0a1637c750
|
YARN-8555. Parameterize TestSchedulingRequestContainerAllocation(Async) to cover both PC handler options. Contributed by Prabhu Joseph.
|
2019-02-11 15:53:50 +08:00 |
|
Masatake Iwasaki
|
e0ab1bdece
|
YARN-9282. Typo in javadoc of class LinuxContainerExecutor: hadoop.security.authetication should be 'authentication'. Contributed by Charan Hebri.
|
2019-02-09 00:26:50 +09:00 |
|
Eric E Payne
|
d1ca9432dd
|
YARN-7171: RM UI should sort memory / cores numerically. Contributed by Ahmed Hussein
|
2019-02-07 16:38:11 +00:00 |
|
Vinayakumar B
|
3c96a03dea
|
YARN-8498. Yarn NodeManager OOM Listener Fails Compilation on Ubuntu 18.04. Contributed by Ayush Saxena.
|
2019-02-07 13:02:35 +05:30 |
|
Rohith Sharma K S
|
7fa62e150c
|
YARN-8219. Add application launch time to ATSV2. Contributed by Abhishek Modi.
|
2019-02-07 09:58:53 +05:30 |
|
Rohith Sharma K S
|
1e5e08d83b
|
YARN-7627. [ATSv2] When passing a non-number as metricslimit, the error message is wrong. Contributed by Charan Hebri.
|
2019-02-07 09:58:53 +05:30 |
|
Rohith Sharma K S
|
e3ec18b0c4
|
YARN-6735. Have a way to turn off container metrics from NMs. Contributed by Abhishek Modi.
|
2019-02-05 13:48:04 +05:30 |
|
Sunil G
|
604b2489a9
|
YARN-9206. RMServerUtils does not count SHUTDOWN as an accepted state. Contributed by Kuhu Shukla.
|
2019-02-04 12:48:28 +05:30 |
|
Weiwei Yang
|
f20b043a02
|
YARN-9263. TestConfigurationNodeAttributesProvider fails after Mockito updated. Contributed by Weiwei Yang.
|
2019-02-02 23:04:34 +08:00 |
|
Weiwei Yang
|
28ad20a711
|
YARN-9262. TestRMAppAttemptTransitions is failing with an NPE. Contributed by lujie.
|
2019-02-02 23:02:45 +08:00 |
|
Vrushali C
|
2c13513040
|
YARN-8549 Adding a NoOp timeline writer and reader plugin classes for ATSv2. Contributed by Prabha Manepalli.
|
2019-02-01 14:26:50 -08:00 |
|
Sunil G
|
71c49fa60f
|
YARN-9099. GpuResourceAllocator#getReleasingGpus calculates number of GPUs in a wrong way. Contributed by Szilard Nemeth.
|
2019-01-31 09:25:29 +05:30 |
|
Akira Ajisaka
|
a3a9ae3cea
|
YARN-9251. Build failure for -Dhbase.profile=2.0. Contributed by Rohith Sharma K S.
|
2019-01-30 05:17:04 -08:00 |
|
Akira Ajisaka
|
1129288cf5
|
HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki.
|
2019-01-29 18:29:56 -08:00 |
|
Eric E Payne
|
04105bbfdb
|
YARN-6616: YARN AHS shows submitTime for jobs same as startTime. Contributed by Prabhu Joseph
|
2019-01-29 17:22:24 +00:00 |
|
Weiwei Yang
|
4f63ffe444
|
YARN-9237. NM should ignore sending finished apps to RM during RM fail-over. Contributed by Jiandan Yang.
|
2019-01-29 10:34:26 +08:00 |
|
Eric Yang
|
2e636dd3c4
|
YARN-9074. Consolidate docker removal logic in ContainerCleanup.
Contributed by Zhaohui Xin
|
2019-01-28 18:05:53 -05:00 |
|
Eric Yang
|
1ab69a9543
|
YARN-9221. Added flag to disable dynamic auxiliary service feature.
Contributed by Billie Rinaldi
|
2019-01-25 19:05:36 -05:00 |
|
Jonathan Hung
|
6cace58e21
|
YARN-9222. Print launchTime in ApplicationSummary
|
2019-01-25 13:17:00 -08:00 |
|
Eric Yang
|
a33ef4fd31
|
YARN-8867. Added resource localization status to YARN service status call.
Contributed by Chandni Singh
|
2019-01-24 18:43:21 -05:00 |
|
Weiwei Yang
|
a4bd64e724
|
YARN-9116. Capacity Scheduler: implements queue level maximum-allocation inheritance. Contributed by Aihua Xu.
|
2019-01-24 17:53:43 +08:00 |
|
Weiwei Yang
|
721d5c2a5f
|
YARN-8101. Add UT to verify node-attributes in RM nodes rest API. Contributed by Prabhu Joseph.
|
2019-01-23 17:59:36 +08:00 |
|
Weiwei Yang
|
e3e076dc78
|
YARN-9205. When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION). Contributed by Zhankun Tang.
|
2019-01-23 14:14:49 +08:00 |
|
Eric Yang
|
2fa9389c2e
|
YARN-9146. Added REST API to configure auxiliary service.
Contributed by Billie Rinaldi
|
2019-01-22 18:24:43 -05:00 |
|
Weiwei Yang
|
d43df31751
|
YARN-9210. RM nodes web page can not display node info. Contributed by Jiandan Yang.
|
2019-01-22 10:23:32 +08:00 |
|
Weiwei Yang
|
abde1e1f58
|
YARN-9204. RM fails to start if absolute resource is specified for partition capacity in CS queues. Contributed by Jiandan Yang.
|
2019-01-21 16:54:14 +08:00 |
|
Wangda Tan
|
6d7eedfd28
|
YARN-9194. Invalid event: REGISTERED and LAUNCH_FAILED at FAILED, and NullPointerException happens in RM while shutdown a NM. (lujie via wangda)
Change-Id: I4359f59a73a278a941f4bb9d106dd38c9cb471fe
|
2019-01-17 14:20:10 -08:00 |
|
Vrushali C
|
713ded6b15
|
YARN-9150 Making TimelineSchemaCreator support different backends for Timeline Schema Creation in ATSv2. Contributed by Sushil Ks
|
2019-01-15 21:28:10 -08:00 |
|
Vrushali C
|
6be39230a6
|
YARN-9150 Making TimelineSchemaCreator support different backends for Timeline Schema Creation in ATSv2. Contributed by Sushil Ks
|
2019-01-15 21:25:37 -08:00 |
|
Akira Ajisaka
|
614af50625
|
YARN-9179. Fix NPE in AbstractYarnScheduler#updateNewContainerInfo.
|
2019-01-15 12:59:59 +09:00 |
|
Jason Lowe
|
6a923464af
|
YARN-6523. Optimize system credentials sent in node heartbeat responses. Contributed by Manikandan R
|
2019-01-08 16:54:05 -06:00 |
|
Weiwei Yang
|
0921b706f7
|
YARN-9037. [CSI] Ignore volume resource in resource calculators based on tags. Contributed by Sunil Govindan.
|
2019-01-08 14:30:53 +08:00 |
|
Giovanni Matteo Fumarola
|
489411579c
|
YARN-9169. Add metrics for queued opportunistic and guaranteed containers. Contributed by Abhishek Modi.
|
2019-01-07 15:16:55 -08:00 |
|
Wangda Tan
|
0a01d49917
|
YARN-8822. Nvidia-docker v2 support for YARN GPU feature. (Charo Zhang via wangda)
Change-Id: Id8af27134d3286a7a10d85eda9be25df9689d0e7
|
2019-01-07 12:07:26 -08:00 |
|
Weiwei Yang
|
944cf87223
|
YARN-9173. FairShare calculation broken for large values after YARN-8833. Contributed by Wilfred Spiegelenburg.
|
2019-01-07 15:57:31 +08:00 |
|
Giovanni Matteo Fumarola
|
6e35f7130f
|
YARN-9166. Fix logging for preemption of Opportunistic containers for Guaranteed containers. Contributed by Abhishek Modi.
|
2019-01-04 11:16:41 -08:00 |
|
Rohith Sharma K S
|
8c6978c3ba
|
YARN-6149. Allow port range to be specified while starting NM Timeline collector manager. Contributed by Abhishek Modi.
|
2019-01-04 14:07:02 +05:30 |
|
Sunil G
|
f4906ac019
|
YARN-9038. [CSI] Add ability to publish/unpublish volumes on node managers. Contributed by Weiwei Yang.
|
2019-01-04 12:10:00 +05:30 |
|
Eric Yang
|
dfceffa70d
|
YARN-9147. Rmove auxiliary services when manifest file is removed.
Contributed by Billie Rinaldi
|
2019-01-03 12:57:21 -05:00 |
|
Weiwei Yang
|
cfe89e6f96
|
YARN-9164. Shutdown NM may cause NPE when opportunistic container scheduling is enabled. Contributed by lujie.
|
2019-01-03 23:56:28 +08:00 |
|
Akira Ajisaka
|
128f340f4f
|
YARN-8894. Improve InMemoryPlan#toString. Contributed by BELUGA BEHR.
|
2018-12-28 17:43:47 +09:00 |
|