Karthik Kambatla
|
abedb8a9d8
|
YARN-5830. FairScheduler: Avoid preempting AM containers. (Yufei Gu via kasha)
|
2017-01-25 12:17:28 -08:00 |
|
Junping Du
|
8528d85a68
|
YARN-6099. Improve webservice to list aggregated log files. Contributed by Xuan Gong.
|
2017-01-24 15:26:53 -08:00 |
|
Jason Lowe
|
a33ce45e35
|
YARN-5547. NMLeveldbStateStore should be more tolerant of unknown keys. Contributed by Ajith S
|
2017-01-24 16:17:36 +00:00 |
|
Rohith Sharma K S
|
0101267d9d
|
YARN-6082. Invalid REST api response for getApps since queueUsagePercentage is coming as INF. Contributed by Sunil G.
|
2017-01-24 10:59:55 +05:30 |
|
Sangjin Lee
|
dc6ec97048
|
YARN-6117. SharedCacheManager does not start up. Contributed by Chris Trezzo.
|
2017-01-23 21:07:25 -08:00 |
|
Daniel Templeton
|
a2c50127d1
|
YARN-6012. Remove node label (removeFromClusterNodeLabels) document is missing (Contributed by Ying Zhang via Daniel Templeton)
|
2017-01-23 17:42:54 -08:00 |
|
Wangda Tan
|
ce832059db
|
YARN-5864. Capacity Scheduler - Queue Priorities. (wangda)
|
2017-01-23 10:52:14 -08:00 |
|
Jason Lowe
|
69fa81679f
|
YARN-5910. Support for multi-cluster delegation tokens. Contributed by Jian He
|
2017-01-23 17:12:51 +00:00 |
|
Sunil G
|
3fa0d540df
|
YARN-6031. Application recovery has failed when node label feature is turned off during RM recovery. Contributed by Ying Zhang.
|
2017-01-23 12:19:35 +05:30 |
|
Ray Chiang
|
9bab85cadf
|
YARN-6106. Document FairScheduler 'allowPreemptionFrom' queue property. (Yufei Gu via rchiang)
|
2017-01-20 14:08:25 -08:00 |
|
Sangjin Lee
|
b01514f65b
|
YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen.
|
2017-01-19 20:52:55 -08:00 |
|
Andrew Wang
|
5d8b80ea9b
|
Preparing for 3.0.0-alpha3 development
|
2017-01-19 15:50:07 -08:00 |
|
Jian He
|
efc8faa1ba
|
YARN-6104. RegistrySecurity overrides zookeeper sasl system properties. Contributed by Billie Rinaldi
|
2017-01-19 10:18:59 -08:00 |
|
Arun Suresh
|
7e8d32147c
|
YARN-6110. Fix opportunistic containers documentation. (Akira Ajisaka via asuresh)
|
2017-01-19 06:14:28 -08:00 |
|
Allen Wittenauer
|
0eb4b513b7
|
HADOOP-13673. Update scripts to be smarter when running with privilege
Signed-off-by: Andrew Wang <wang@apache.org>
Signed-off-by: Ravi Prakash <raviprak@apache.org>
|
2017-01-18 14:39:05 -08:00 |
|
Wangda Tan
|
72054a817d
|
YARN-5556. CapacityScheduler: Support deleting queues without requiring a RM restart. (Naganarasimha G R via wangda)
|
2017-01-18 13:31:33 -08:00 |
|
Karthik Kambatla
|
e224c96234
|
YARN-5831. FairScheduler: Propagate allowPreemptionFrom flag all the way down to the app. (Yufei Gu via kasha)
|
2017-01-17 17:01:31 -08:00 |
|
Subru Krishnan
|
4d1f3d9020
|
YARN-6016. Fix minor bugs in handling of local AMRMToken in AMRMProxy. (Botong Huang via Subru).
|
2017-01-17 14:48:03 -08:00 |
|
Daniel Templeton
|
695f110f93
|
YARN-6071. Fix incompatible API change on AM-RM protocol due to YARN-3866 (trunk only)
(Contributed by Wangda Tan via Daniel Templeton)
|
2017-01-17 12:55:47 -08:00 |
|
bibinchundatt
|
a9d946d4df
|
YARN-6057. yarn.scheduler.minimum-allocation-* descriptions are incorrect about behavior when a request is out of bounds. Contributed by Julia Sommer.
|
2017-01-17 14:16:00 +05:30 |
|
Akira Ajisaka
|
e407449ddb
|
HADOOP-13933. Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers. Contributed by Surendra Singh Lilhore.
|
2017-01-17 10:10:23 +09:00 |
|
Junping Du
|
cf695577aa
|
YARN-6011. Add a new web service to list the files on a container in AHSWebService. Contributed by Xuan Gong.
|
2017-01-16 16:20:24 -08:00 |
|
Sunil G
|
d3170f9eba
|
YARN-6081. LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container. Contributed by Wangda Tan.
|
2017-01-13 18:22:29 +05:30 |
|
Naganarasimha
|
a6b06f7179
|
YARN-6072. RM unable to start in secure mode. Contributed by Ajith S.
|
2017-01-12 06:40:41 +05:30 |
|
Daniel Templeton
|
e6f13fe5d1
|
YARN-5849. Automatically create YARN control group for pre-mounted cgroups (Contributed by Miklos Szegedi via Daniel Templeton)
|
2017-01-11 16:00:01 -08:00 |
|
Daniel Templeton
|
7979939428
|
YARN-5554. MoveApplicationAcrossQueues does not check user permission on the target queue
(Contributed by Wilfred Spiegelenburg via Daniel Templeton)
|
2017-01-11 14:34:10 -08:00 |
|
Jason Lowe
|
357eab9566
|
YARN-5416. TestRMRestart#testRMRestartWaitForPreviousAMToFinish failed intermittently due to not wait SchedulerApplicationAttempt to be stopped. Contributed by Junping Du
|
2017-01-11 17:13:37 +00:00 |
|
Junping Du
|
4db119b7b5
|
YARN-6079. Fix simple spelling errors in yarn test code. Contributed by vijay.
|
2017-01-10 18:20:27 -08:00 |
|
Naganarasimha
|
4c431a6940
|
YARN-6054. TimelineServer fails to start when some LevelDb state files are missing. Contributed by Ravi Prakash.
|
2017-01-10 15:54:16 +05:30 |
|
Naganarasimha
|
41db07d532
|
YARN-5937. stop-yarn.sh is not able to gracefully stop node managers. Contributed by Weiwei Yang.
|
2017-01-10 15:35:01 +05:30 |
|
Sunil G
|
9594c35dcb
|
YARN-5899. Debug log in AbstractCSQueue#canAssignToThisQueue needs improvement. Contributed by Ying Zhang.
|
2017-01-10 14:08:01 +05:30 |
|
Daniel Templeton
|
6332a318bc
|
YARN-6073. Misuse of format specifier in Preconditions.checkArgument (Contributed by Yuanbo Liu via Daniel Templeton)
|
2017-01-09 22:12:58 -08:00 |
|
Junping Du
|
945db55f2e
|
YARN-4148. When killing app, RM releases app's resource before they are released by NM. Contributed by Jason Lowe.
|
2017-01-09 18:14:46 -08:00 |
|
Wangda Tan
|
287d3d6804
|
YARN-3955. Support for application priority ACLs in queues of CapacityScheduler. (Sunil G via wangda)
|
2017-01-09 08:40:39 -08:00 |
|
Varun Saxena
|
db490eccce
|
YARN-6074. FlowRunEntity does not deserialize long values correctly (Rohith Sharma K S via Varun Saxena)
|
2017-01-09 18:54:22 +05:30 |
|
Varun Saxena
|
f59e36b4ce
|
YARN-6068. Log aggregation get failed when NM restart even with recovery (Junping Du via Varun Saxena)
|
2017-01-09 11:17:19 +05:30 |
|
Arun Suresh
|
85826f6ca5
|
YARN-6066. Opportunistic containers Minor fixes : API annotations, parameter name changes, checkstyles. (asuresh)
(cherry picked from commit 4985217de453a04ddffd7b52644bdc8d153f753c)
|
2017-01-08 09:04:20 -08:00 |
|
Daniel Templeton
|
ac16400e1f
|
YARN-6022. Revert changes of AbstractResourceRequest (Contributed by Wangda Tan via Daniel Templeton)
|
2017-01-07 08:24:30 -08:00 |
|
Naganarasimha
|
a59df15757
|
YARN-6015. AsyncDispatcher thread name can be set to improved debugging. Contributed by Ajith S.
|
2017-01-07 08:11:58 +05:30 |
|
Jian He
|
020316458d
|
YARN-6009. Skip validating app timeout value on recovery. Contributed by Rohith Sharma K S
|
2017-01-06 18:19:09 -08:00 |
|
Daniel Templeton
|
71a4acf74b
|
YARN-5991. Yarn Distributed Shell does not print throwable t to App Master When failed to start container
(Contributed by Jim Frankola via Daniel Templeton)
|
2017-01-06 14:26:08 -08:00 |
|
Arun Suresh
|
2977bc6a14
|
YARN-6040. Introduce api independent PendingAsk to replace usage of ResourceRequest within Scheduler classes. (Wangda Tan via asuresh)
|
2017-01-06 09:59:57 -08:00 |
|
Wangda Tan
|
0a55bd841e
|
YARN-5959. RM changes to support change of container ExecutionType. (Arun Suresh via wangda)
|
2017-01-05 10:31:05 -08:00 |
|
Rohith Sharma K S
|
e49e0a6e37
|
YARN-5988. RM unable to start in secure setup. Contributed by Ajith S.
|
2017-01-04 12:09:29 +05:30 |
|
Junping Du
|
8fadd69047
|
YARN-5923. Unable to access logs for a running application if YARN_ACL_ENABLE is enabled. Contributed by Xuan Gong.
|
2017-01-03 15:03:38 -08:00 |
|
Wangda Tan
|
f69a107aec
|
YARN-6025. Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementations. (Naganarasimha G R via wangda)
(cherry picked from commit e0f2379312 )
|
2017-01-03 14:53:36 -08:00 |
|
Wangda Tan
|
ab1faa4ba8
|
Revert "Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementations. (Naganarasimha G R via wangda)" to add correct JIRA number
This reverts commit e0f2379312 .
|
2017-01-03 14:53:13 -08:00 |
|
Wangda Tan
|
e0f2379312
|
Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementations. (Naganarasimha G R via wangda)
|
2017-01-03 14:46:41 -08:00 |
|
Daniel Templeton
|
165d01a73e
|
YARN-5931. Document timeout interfaces CLI and REST APIs (Contributed by Rohith Sharma K S via Daniel Templeton)
|
2016-12-30 08:41:52 -08:00 |
|
Robert Kanter
|
f216276d21
|
YARN-4882. Change the log level to DEBUG for recovering completed applications (templedf via rkanter)
|
2016-12-28 15:21:52 -08:00 |
|
Sunil G
|
9ca54f4810
|
YARN-5906. Update AppSchedulingInfo to use SchedulingPlacementSet. Contributed by Wangda Tan.
|
2016-12-28 22:48:19 +05:30 |
|
Varun Vasudev
|
972da46cb4
|
YARN-5719. Enforce a C standard for native container-executor. Contributed by Chris Douglas.
|
2016-12-28 14:59:57 +05:30 |
|
Sunil G
|
f6715b26b6
|
YARN-6024. Capacity Scheduler 'continuous reservation looking' doesn't work when sum of queue's used and reserved resources is equal to max. Contributed by Wangda Tan.
|
2016-12-28 12:33:02 +05:30 |
|
Rohith Sharma K S
|
e297be74ed
|
YARN-6001. Improve moveApplicationQueues command line. Contributed by Sunil G.
|
2016-12-28 12:16:11 +05:30 |
|
Wangda Tan
|
0840b4329b
|
YARN-5756. Add state-machine implementation for scheduler queues. (Xuan Gong via wangda)
|
2016-12-27 21:18:33 -08:00 |
|
Robert Kanter
|
9262797e86
|
YARN-5257. Fix unreleased resources and null dereferences (yufeigu via rkanter)
|
2016-12-27 14:14:08 -08:00 |
|
Robert Kanter
|
1bbd023275
|
YARN-5962. Spelling errors in logging and exceptions for resource manager code (gsohn via rkanter)
|
2016-12-27 13:35:34 -08:00 |
|
Daniel Templeton
|
e216e8e233
|
HADOOP-13932. Fix indefinite article in comments (Contributed by LiXin Ge via Daniel Templeton)
|
2016-12-27 13:03:16 -08:00 |
|
Arun Suresh
|
ac1e5d4f77
|
YARN-5938. Refactoring OpportunisticContainerAllocator to use SchedulerRequestKey instead of Priority and other misc fixes (asuresh)
|
2016-12-27 12:40:44 -08:00 |
|
Karthik Kambatla
|
c3973e7080
|
YARN-5969. FairShareComparator: Cache value of getResourceUsage for better performance. (zhangshilong via kasha)
|
2016-12-27 12:30:35 -08:00 |
|
Daniel Templeton
|
ded2d08f33
|
HADOOP-13940. Document the missing envvars commands (Contributed by Yiqun Lin via Daniel Templeton)
|
2016-12-27 07:18:08 -08:00 |
|
Naganarasimha
|
c721f78a3c
|
YARN-6026. A couple of spelling errors in the docs. Contributed by Grant Sohn.
|
2016-12-24 05:38:09 +05:30 |
|
Karthik Kambatla
|
4d3f73acc0
|
YARN-6000. Make AllocationFileLoaderService.Listener public. (Tao Jie via kasha)
|
2016-12-23 11:40:56 -08:00 |
|
Varun Saxena
|
38e66d4d64
|
YARN-5903. Fix race condition in TestResourceManagerAdministrationProtocolPBClientImpl beforeclass setup method (Haibo Chen via Varun Saxena)
|
2016-12-22 23:08:33 +05:30 |
|
Akira Ajisaka
|
ae401539ea
|
YARN-4994. Use MiniYARNCluster with try-with-resources in tests. Contributed by Andras Bokor.
|
2016-12-22 14:32:24 +09:00 |
|
Junping Du
|
736f54b727
|
YARN-4990. Re-direction of a particular log file within in a container in NM UI does not redirect properly. Contributed by Xuan Gong.
|
2016-12-21 14:14:42 -08:00 |
|
Sangjin Lee
|
8b042bc1e6
|
YARN-5976. Update hbase version to 1.2. Contributed by Vrushali C.
|
2016-12-21 09:43:17 -08:00 |
|
Sunil G
|
575773a357
|
YARN-5877. Allow all env's from yarn.nodemanager.env-whitelist to get overridden during launch. Contributed by Bibin A Chundatt.
|
2016-12-20 11:39:06 +05:30 |
|
Naganarasimha
|
358341398a
|
YARN-5524. Yarn live log aggregation does not throw if command line arg is wrong. Contributed by Xuan Gong.
|
2016-12-20 06:36:25 +05:30 |
|
Sunil G
|
ef2dd7b78c
|
YARN-5650. Render Application Timeout value in web UI. Contributed by Akhil PB.
|
2016-12-19 11:44:03 +05:30 |
|
Arun Suresh
|
2273a74c1f
|
YARN-5646. Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers. (Konstantinos Karanasos via asuresh)
|
2016-12-16 08:14:34 -08:00 |
|
Xuan
|
64a2d5be91
|
YARN-5999. AMRMClientAsync will stop if any exceptions thrown on allocate call. Contributed by Jian He
|
2016-12-14 14:33:23 -08:00 |
|
Jian He
|
ada876cd1d
|
Revert YARN-4126. RM should not issue delegation tokens in unsecure mode.
|
2016-12-13 20:49:54 -08:00 |
|
Steve Loughran
|
f66f61892a
|
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran
|
2016-12-12 13:58:27 +00:00 |
|
Robert Kanter
|
4b149a1e77
|
YARN-4457. Cleanup unchecked types for EventHandler (templedf via rkanter)
|
2016-12-09 17:28:25 -08:00 |
|
Jian He
|
a6410a542e
|
YARN-5709. Cleanup leader election configs and pluggability. Contribtued by Karthik Kambatla
|
2016-12-09 17:00:37 -08:00 |
|
Arun Suresh
|
b0aace21b1
|
YARN-5982. Simplify opportunistic container parameters and metrics. (Konstantinos Karanasos via asuresh)
|
2016-12-09 16:41:25 -08:00 |
|
Sangjin Lee
|
55f5886ea2
|
YARN-5925. Extract hbase-backend-exclusive utility methods from TimelineStorageUtil. Contributed by Haibo Chen.
|
2016-12-09 16:17:24 -08:00 |
|
Akira Ajisaka
|
7d8e440eee
|
Revert "HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran"
This reverts commit c265515725 .
|
2016-12-09 12:49:27 +09:00 |
|
Sangjin Lee
|
a5a55a54ab
|
YARN-5922. Remove direct references of HBaseTimelineWriter/Reader in core ATS classes. Contributed by Haibo Chen.
|
2016-12-08 12:31:12 -08:00 |
|
Steve Loughran
|
c265515725
|
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran
|
2016-12-08 17:57:15 +00:00 |
|
Sunil G
|
74d0066d33
|
YARN-5970. Validate application update timeout request parameters. Contributed by Rohith Sharma K S.
|
2016-12-08 15:53:56 +05:30 |
|
Robert Kanter
|
72fe546841
|
YARN-5963. Spelling errors in logging and exceptions for node manager, client, web-proxy, common, and app history code (gsohn via rkanter)
|
2016-12-07 15:07:25 -08:00 |
|
Daniel Templeton
|
9f5d2c4fff
|
YARN-5136. Error in handling event type APP_ATTEMPT_REMOVED to the scheduler
(Contributed by Wilfred Spiegelenburg via Daniel Templeton)
|
2016-12-07 11:12:14 -08:00 |
|
Sunil
|
ab923a53fc
|
YARN-5965. Retrospect ApplicationReport#getApplicationTimeouts. Contributed by Rohith Sharma K S
|
2016-12-08 00:27:25 +05:30 |
|
Rohith Sharma K S
|
563480dccd
|
YARN-5932. Retrospect moveApplicationToQueue in align with YARN-5611. Contributed by Sunil G.
|
2016-12-07 10:39:14 +05:30 |
|
Junping Du
|
a7288da595
|
YARN-5184. Fix up incompatible changes introduced on ContainerStatus and NodeReport. Contributed by Sangjin Lee.
|
2016-12-06 14:36:41 -08:00 |
|
Karthik Kambatla
|
c8d0a049b0
|
HADOOP-13859. TestConfigurationFieldsBase fails for fields that are DEFAULT values of skipped properties. (Haibo Chen via kasha)
|
2016-12-06 14:10:58 -08:00 |
|
Naganarasimha
|
f3b8ff54ab
|
YARN-5921. Incorrect synchronization in RMContextImpl#setHAServiceState/getHAServiceState. Contributed by Varun Saxena
|
2016-12-06 06:53:38 +05:30 |
|
Jian He
|
43ebff2e35
|
YARN-5559. Analyse 2.8.0/3.0.0 jdiff reports and fix any issues. Contributed by Akira Ajisaka & Wangda Tan
|
2016-12-05 11:39:34 -08:00 |
|
Jian He
|
f885160f4a
|
YARN-5746. The state of the parentQueue and its childQueues should be synchronized. Contributed by Xuan Gong
|
2016-12-02 16:17:31 -08:00 |
|
Daniel Templeton
|
5bd18c49bd
|
YARN-5929. Missing scheduling policy in the FS queue metric. (Contributed by Yufei Gu via Daniel Templeton)
|
2016-12-02 13:55:42 -08:00 |
|
Jason Lowe
|
f304ccae3c
|
YARN-5915. ATS 1.5 FileSystemTimelineWriter causes flush() to be called after every event write. Contributed by Atul Sikaria
|
2016-12-02 16:54:15 +00:00 |
|
Robert Kanter
|
c87b3a448a
|
MAPREDUCE-6787. Allow job_conf.xml to be downloadable on the job overview page in JHS (haibochen via rkanter)
|
2016-12-01 17:29:38 -08:00 |
|
Daniel Templeton
|
2d77dc727d
|
YARN-5901. Fix race condition in TestGetGroups beforeclass setup() (Contributed by Haibo Chen via Daniel Templeton)
|
2016-12-01 15:57:39 -08:00 |
|
Li Lu
|
69fb70c31a
|
YARN-5761. Separate QueueManager from Scheduler. (Xuan Gong via gtcarrera9)
|
2016-11-30 13:38:42 -08:00 |
|
Daniel Templeton
|
4fca94fbda
|
YARN-5942. "Overridden" is misspelled as "overriden" in FairScheduler.md
(Contributed by Heather Sutherland via Daniel Templeton)
|
2016-11-30 11:23:51 -08:00 |
|
Daniel Templeton
|
b3befc021b
|
YARN-4997. Update fair scheduler to use pluggable auth provider (Contributed by Tao Jie via Daniel Templeton)
|
2016-11-30 09:50:33 -08:00 |
|
Kai Zheng
|
cfd8076f81
|
Revert due to an error "HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen"
This reverts commit 5614f847b2ef2a5b70bd9a06edc4eba06174c6.
|
2016-11-30 15:44:52 +08:00 |
|
Daniel Templeton
|
dd9a96cb17
|
YARN-5851. TestContainerManagerSecurity testContainerManager[1] failed (Contributed by Haibo Chen via Daniel Templeton)
|
2016-11-29 14:22:19 -08:00 |
|