Jason Lowe
|
7558dbbb48
|
YARN-5540. Scheduler spends too much time looking at empty priorities. Contributed by Jason Lowe
|
2016-09-19 20:31:35 +00:00 |
|
Jian He
|
b8a30f2f17
|
YARN-3141. Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp. Contributed by Wangda Tan
|
2016-09-19 17:08:01 +08:00 |
|
Arun Suresh
|
3552c2b99d
|
YARN-5637. Changes in NodeManager to support Container rollback and commit. (asuresh)
|
2016-09-18 10:55:18 -07:00 |
|
Arun Suresh
|
f67237cbe7
|
YARN-5657. Fix TestDefaultContainerExecutor. (asuresh)
|
2016-09-17 09:32:05 -07:00 |
|
Naganarasimha
|
4174b9756c
|
YARN-5642. Typos in 9 log messages. Contributed by Mehran Hassani
|
2016-09-17 10:35:39 +05:30 |
|
Kai Zheng
|
58bae35447
|
YARN-5163. Migrate TestClientToAMTokens and TestClientRMTokens tests from the old RPC engine. Contributed by Wei Zhou and Kai Zheng
|
2016-09-18 08:43:36 +08:00 |
|
Arun Suresh
|
40b5a59b72
|
YARN-5620. Core changes in NodeManager to support re-initialization of Containers with new launchContext. (asuresh)
|
2016-09-15 07:15:11 -07:00 |
|
Jason Lowe
|
e793309735
|
YARN-5630. NM fails to start after downgrade from 2.8 to 2.7. Contributed by Jason Lowe
|
2016-09-13 14:41:27 +00:00 |
|
Karthik Kambatla
|
c0e492e50f
|
YARN-5616. Clean up WeightAdjuster. (Yufei Gu via kasha)
|
2016-09-06 22:40:20 -07:00 |
|
Varun Vasudev
|
e6fcfe28e3
|
YARN-5576. Allow resource localization while container is running. Contributed by Jian He.
|
2016-09-06 20:01:45 +05:30 |
|
Karthik Kambatla
|
f6ea9be547
|
YARN-5264. Store all queue-specific information in FSQueue. (Yufei Gu via kasha)
|
2016-09-02 14:56:29 -07:00 |
|
Ray Chiang
|
378f624a39
|
YARN-5549. AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately. (Daniel Templeton via rchiang)
|
2016-09-02 11:14:35 -07:00 |
|
Varun Vasudev
|
05f5c0f631
|
YARN-5555. Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested. Contributed by Eric Payne.
|
2016-09-02 16:02:01 +05:30 |
|
Karthik Kambatla
|
74f4bae455
|
YARN-5566. Client-side NM graceful decom is not triggered when jobs finish. (Robert Kanter via kasha)
|
2016-09-01 14:44:01 -07:00 |
|
Varun Vasudev
|
08f55ccbb0
|
YARN-5596. Fix failing unit test in TestDockerContainerRuntime. Contributed by Sidharta Seethana.
|
2016-09-01 14:08:51 +05:30 |
|
Arun Suresh
|
d6d9cff21b
|
YARN-5221. Expose UpdateResourceRequest API to allow AM to request for change in container properties. (asuresh)
|
2016-08-30 15:52:29 -07:00 |
|
Subru Krishnan
|
b930dc3ec0
|
YARN-5327. API changes required to support recurring reservations in the YARN ReservationSystem. (Sangeetha Abdu Jyothi via Subru).
|
2016-08-26 16:58:47 -07:00 |
|
Karthik Kambatla
|
cde3a00526
|
YARN-5373. NPE listing wildcard directory in containerLaunch. (Daniel Templeton via kasha)
|
2016-08-26 11:04:33 -07:00 |
|
Junping Du
|
9ef632f3b0
|
YARN-5557. Add localize API to the ContainerManagementProtocol. Contributed by Jian He.
|
2016-08-26 09:04:44 -07:00 |
|
Naganarasimha
|
46e02ab719
|
YARN-3940. Application moveToQueue should check NodeLabel permission. Contributed by Bibin A Chundatt
|
2016-08-26 20:19:11 +05:30 |
|
Varun Vasudev
|
bfb4d95059
|
YARN-5430. Return container's ip and host from NM ContainerStatus call. Contributed by Jian He.
|
2016-08-26 16:30:18 +05:30 |
|
Naganarasimha
|
27c3b86252
|
YARN-5564. Fix typo in RM_SCHEDULER_RESERVATION_THRESHOLD_INCREMENT_MULTIPLE. Contributed by Ray Chiang
|
2016-08-26 08:47:21 +05:30 |
|
Varun Vasudev
|
525d52bf7c
|
YARN-5042. Mount /sys/fs/cgroup into Docker containers as read only mount. Contributed by luhuichun.
|
2016-08-25 14:18:26 +05:30 |
|
Rohith Sharma K S
|
0d5997d2b9
|
YARN-5544. TestNodeBlacklistingOnAMFailures fails on trunk. Contributed by Sunil G.
|
2016-08-23 14:37:39 +05:30 |
|
Wangda Tan
|
444b2ea7af
|
YARN-3388. Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit. (Nathan Roberts via wangda)
|
2016-08-19 16:28:32 -07:00 |
|
Varun Saxena
|
091dd19e86
|
YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)
|
2016-08-19 17:30:17 +05:30 |
|
Varun Saxena
|
8aed374182
|
Revert "YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)"
This reverts commit 59557e85a4.
|
2016-08-19 16:14:16 +05:30 |
|
Varun Saxena
|
59557e85a4
|
YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)
|
2016-08-19 15:01:48 +05:30 |
|
Junping Du
|
0da69c324d
|
YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi.
(cherry picked from commit d464483bf7f0b3e3be3ba32cd6c3eee546747ab5)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceTrackerService.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNode.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java
|
2016-08-18 07:27:23 -07:00 |
|
Karthik Kambatla
|
20f0eb871c
|
YARN-4702. FairScheduler: Allow setting maxResources for ad hoc queues. (Daniel Templeton via kasha)
|
2016-08-17 17:40:20 -07:00 |
|
Varun Vasudev
|
7f05ff7a4e
|
YARN-5455. Update Javadocs for LinuxContainerExecutor. Contributed by Daniel Templeton.
|
2016-08-17 15:34:58 +05:30 |
|
Varun Saxena
|
24249115bf
|
YARN-5521. Fix random failure of TestCapacityScheduler#testKillAllAppsInQueue (sandflee via Varun Saxena)
|
2016-08-16 00:03:29 +05:30 |
|
Varun Saxena
|
d677b68c25
|
YARN-5491. Fix random failure of TestCapacityScheduler#testCSQueueBlocked (Bibin A Chundatt via Varun Saxena)
|
2016-08-15 03:31:21 +05:30 |
|
Varun Saxena
|
23c6e3c4e4
|
YARN-5476. Non existent application reported as ACCEPTED by YarnClientImpl (Junping Du via Varun Saxena)
|
2016-08-12 20:37:58 +05:30 |
|
Naganarasimha
|
874577a67d
|
YARN-4833. For Queue AccessControlException client retries multiple times on both RM. Contributed by Bibin A Chundatt
|
2016-08-12 01:09:41 +05:30 |
|
Rohith Sharma K S
|
5199db387d
|
YARN-5492. TestSubmitApplicationWithRMHA is failing sporadically during precommit builds. Contributed by Vrushali C.
|
2016-08-11 11:50:46 +05:30 |
|
Ray Chiang
|
aea3e65749
|
YARN-5137. Make DiskChecker pluggable in NodeManager. (Yufei Gu via rchiang)
|
2016-08-10 19:23:29 -07:00 |
|
Naganarasimha
|
89c0bff719
|
YARN-5495. Remove import wildcard in CapacityScheduler. Contributed by Ray Chiang.
|
2016-08-11 00:35:19 +05:30 |
|
Jason Lowe
|
5c95bb315b
|
YARN-5382. RM does not audit log kill request for active applications. Contributed by Vrushali C
|
2016-08-10 18:25:54 +00:00 |
|
Jason Lowe
|
e0b570dffb
|
YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers. Contributed by sandflee
|
2016-08-10 18:04:18 +00:00 |
|
Karthik Kambatla
|
7992c0b42c
|
YARN-5343. TestContinuousScheduling#testSortedNodes fails intermittently. (Yufei Gu via kasha)
|
2016-08-09 16:51:03 -07:00 |
|
Varun Vasudev
|
522ddbde79
|
YARN-5394. Remove bind-mount /etc/passwd for Docker containers. Contributed by Zhankun Tang.
|
2016-08-09 16:04:09 +05:30 |
|
Arun Suresh
|
82c9e06101
|
YARN-5457. Refactor DistributedScheduling framework to pull out common functionality. (asuresh)
|
2016-08-09 00:42:29 -07:00 |
|
Varun Saxena
|
37d939a453
|
YARN-4910. Fix incomplete log info in ResourceLocalizationService (Jun Gong via Varun Saxena)
|
2016-08-08 22:12:53 +05:30 |
|
Naganarasimha
|
131d58a24e
|
YARN-5287. LinuxContainerExecutor fails to set proper permission. Contributed by Ying Zhang
|
2016-08-07 01:08:13 +05:30 |
|
Naganarasimha
|
d81b8163b4
|
YARN-4624. NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI. Contributed by Brahma Reddy Battula
|
2016-08-06 01:13:36 +05:30 |
|
Wangda Tan
|
3f100d76ff
|
YARN-4888. Changes in scheduler to identify resource-requests explicitly by allocation-id. (Subru Krishnan via wangda)
|
2016-08-05 10:43:35 -07:00 |
|
Wangda Tan
|
e0d131f055
|
YARN-4091. Add REST API to retrieve scheduler activity. (Chen Ge and Sunil G via wangda)
|
2016-08-05 10:27:34 -07:00 |
|
Rohith Sharma K S
|
d9a354c2f3
|
YARN-5333. Some recovered apps are put into default queue when RM HA. Contributed by Jun Gong.
|
2016-08-05 21:35:49 +05:30 |
|
Varun Vasudev
|
08e33381f5
|
YARN-5459. Add support for docker rm. Contributed by Shane Kumpf.
|
2016-08-04 14:08:34 +05:30 |
|
Jason Lowe
|
db4a61dc61
|
YARN-5469. Increase timeout of TestAmFilter.testFilter. Contributed by Eric Badger
|
2016-08-03 19:51:44 +00:00 |
|
Jason Lowe
|
db646540f0
|
YARN-5462. TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently. Contributed by Eric Badger
|
2016-08-03 19:17:25 +00:00 |
|
Jason Lowe
|
4d92aefd35
|
YARN-4280. CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster. Contributed by Kuhu Shukla
|
2016-08-03 18:53:14 +00:00 |
|
Varun Vasudev
|
d848184e90
|
YARN-5460. Change container runtime type logging in DelegatingLinuxContainerRuntime to debug. Contributed by Shane Kumpf.
|
2016-08-03 12:02:39 +05:30 |
|
Chris Nauroth
|
b913677365
|
YARN-5456. container-executor support for FreeBSD, NetBSD, and others if conf path is absolute. Contributed by Allen Wittenauer.
|
2016-08-02 22:24:34 -07:00 |
|
Varun Vasudev
|
7fc70c6422
|
YARN-5458. Rename DockerStopCommandTest to TestDockerStopCommand. Contributed by Shane Kumpf.
|
2016-08-02 16:56:45 +05:30 |
|
Varun Vasudev
|
2e7c2a13a8
|
YARN-5443. Add support for docker inspect command. Contributed by Shane Kumpf.
|
2016-08-02 16:55:10 +05:30 |
|
Varun Vasudev
|
95694b70cd
|
YARN-5444. Fix failing unit tests in TestLinuxContainerExecutorWithMocks. Contributed by Yufei Gu.
|
2016-08-01 16:08:38 +05:30 |
|
Arun Suresh
|
e5766b1dbe
|
YARN-5113. Refactoring and other clean-up for distributed scheduling. (Konstantinos Karanasos via asuresh)
|
2016-07-31 11:48:25 -07:00 |
|
Chris Nauroth
|
ef501b1a0b
|
YARN-5121. fix some container-executor portability issues. Contributed by Allen Wittenauer.
|
2016-07-30 08:26:19 -07:00 |
|
Subru Krishnan
|
4e756d7271
|
YARN-5203.Return ResourceRequest JAXB object in ResourceManager Cluster Applications REST API. Contributed by Ellen Hui.
|
2016-07-28 16:03:24 -07:00 |
|
Junping Du
|
7f3c306e2e
|
YARN-5432. Lock already held by another process while LevelDB cache store creation for dag. Contributed by Li Lu.
|
2016-07-28 06:35:24 -07:00 |
|
Subru Krishnan
|
d2cbfd7de3
|
YARN-5441. Fixing minor Scheduler test case failures
|
2016-07-27 18:21:58 -07:00 |
|
Akira Ajisaka
|
54fe17a607
|
HADOOP-9427. Use JUnit assumptions to skip platform-specific tests. Contributed by Gergely Novák.
|
2016-07-27 19:41:09 +09:00 |
|
Wangda Tan
|
d62e121ffc
|
YARN-5195. RM intermittently crashed with NPE while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. (sandflee via wangda)
|
2016-07-26 21:22:59 -07:00 |
|
Wangda Tan
|
49969b16cd
|
YARN-5342. Improve non-exclusive node partition resource allocation in Capacity Scheduler. (Sunil G via wangda)
|
2016-07-26 18:14:09 -07:00 |
|
Arun Suresh
|
5aace38b74
|
YARN-5392. Replace use of Priority in the Scheduling infrastructure with an opaque ShedulerRequestKey. (asuresh and subru)
|
2016-07-26 14:54:03 -07:00 |
|
Chris Douglas
|
d383bfdcd4
|
YARN-5164. Use plan RLE to improve CapacityOverTimePolicy efficiency
|
2016-07-25 16:37:50 -07:00 |
|
Rohith Sharma K S
|
557a245d83
|
YARN-5092. TestRMDelegationTokens fails intermittently. Contributed by Jason Lowe.
|
2016-07-21 12:47:27 +05:30 |
|
Akira Ajisaka
|
c63afdbe14
|
YARN-4883. Make consistent operation name in AdminService. Contributed by Kai Sasaki.
|
2016-07-20 16:51:01 -07:00 |
|
Vinod Kumar Vavilapalli
|
1c9d2ab503
|
YARN-5340. Fixed a race condition in RollingLevelDBTimelineStore that caused loss of Timeline events. Contributed by Li Lu.
|
2016-07-20 08:36:36 -07:00 |
|
Arun Suresh
|
8fbe6ece24
|
YARN-5350. Distributed Scheduling: Ensure sort order of allocatable nodes returned by the RM is not lost. (asuresh)
|
2016-07-19 23:03:58 -07:00 |
|
Arun Suresh
|
cda0a280dd
|
YARN-5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh)
|
2016-07-19 10:43:37 -07:00 |
|
Arun Suresh
|
5f2d33a551
|
Revert "YARN=5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh)"
This reverts commit e905a42a2c.
|
2016-07-19 10:43:19 -07:00 |
|
Varun Saxena
|
fe20494a72
|
YARN-4996. Make TestNMReconnect.testCompareRMNodeAfterReconnect() scheduler agnostic (Kai Sasaki via Varun Saxena)
|
2016-07-19 16:03:28 +05:30 |
|
Andrew Wang
|
da456ffd62
|
Preparing for 3.0.0-alpha2 development
|
2016-07-15 19:04:17 -07:00 |
|
Ray Chiang
|
f5f1c81e7d
|
YARN-5272. Handle queue names consistently in FairScheduler. (Wilfred Spiegelenburg via rchiang)
|
2016-07-15 14:38:50 -07:00 |
|
Arun Suresh
|
e905a42a2c
|
YARN=5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh)
|
2016-07-15 14:35:12 -07:00 |
|
Wangda Tan
|
24db9167f1
|
YARN-4484. Available Resource calculation for a queue is not correct when used with labels. (Sunil G via wangda)
|
2016-07-15 11:40:12 -07:00 |
|
Varun Saxena
|
a72cb3825a
|
YARN-5383. Fix findbugs and checkstyle issues in ContainerExecutor. (Vrushali C via Varun Saxena)
|
2016-07-15 23:17:04 +05:30 |
|
Naganarasimha
|
b5ee7dbd8d
|
YARN-5380. NMTimelinePublisher should use getMemorySize instead of getMemory. Contributed by Vrushali C
|
2016-07-15 14:34:48 +05:30 |
|
Sangjin Lee
|
e549a9af31
|
YARN-5379. TestHBaseTimelineStorage. testWriteApplicationToHBase() fails intermittently (Vrushali C via sjlee)
|
2016-07-14 15:19:03 -07:00 |
|
Akira Ajisaka
|
6cf017558a
|
YARN-5159. Wrong Javadoc tag in MiniYarnCluster. Contributed by Andras Bokor.
|
2016-07-14 10:45:11 -07:00 |
|
Varun Vasudev
|
54bf14f80b
|
YARN-5303. Clean up ContainerExecutor JavaDoc. Contributed by Daniel Templeton.
|
2016-07-14 19:28:11 +05:30 |
|
Varun Vasudev
|
e5e558b0a3
|
YARN-4759. Fix signal handling for docker containers. Contributed by Shane Kumpf.
|
2016-07-14 19:27:16 +05:30 |
|
Varun Vasudev
|
58e1850801
|
YARN-5298. Mount usercache and NM filecache directories into Docker container. Contributed by Sidharta Seethana.
|
2016-07-14 16:11:07 +05:30 |
|
Rohith Sharma K S
|
dbe97aa768
|
YARN-5299. Log Docker run command when container fails. Contributed by Varun Vasudev.
|
2016-07-14 11:48:10 +05:30 |
|
Naganarasimha
|
af8f480c24
|
YARN-5364. timelineservice modules have indirect dependencies on mapreduce artifacts. Contributed by Sangjin Lee
|
2016-07-14 01:43:37 +05:30 |
|
Varun Saxena
|
56142171b9
|
YARN-5359. FileSystemTimelineReader/Writer uses unix-specific default storage path (Sangjin Lee via Varun Saxena)
|
2016-07-13 21:15:41 +05:30 |
|
Rohith Sharma K S
|
d6d41e820a
|
YARN-5362. TestRMRestart#testFinishedAppRemovalAfterRMRestart can fail. Contributed by sandflee.
|
2016-07-13 19:12:35 +05:30 |
|
Varun Saxena
|
06c56ff79b
|
YARN-5353. ResourceManager can leak delegation tokens when they are shared across apps. (Jason Lowe via Varun Saxena).
|
2016-07-13 07:55:34 +05:30 |
|
Jason Lowe
|
10b704c594
|
YARN-5317. testAMRestartNotLostContainerCompleteMsg may fail. Contributed by sandflee
|
2016-07-12 20:27:41 +00:00 |
|
Jian He
|
819224dcf9
|
YARN-5270. Solve miscellaneous issues caused by YARN-4844. Contributed by Wangda Tan
|
2016-07-11 22:36:20 -07:00 |
|
Varun Saxena
|
0fd3980a1f
|
YARN-5037. Fix random failure of TestRMRestart#testQueueMetricsOnRMRestart (sandflee via Varun Saxena).
|
2016-07-10 21:28:52 +05:30 |
|
Sangjin Lee
|
6cf6ab7b78
|
Made a number of miscellaneous fixes for javac, javadoc, and checstyle warnings.
|
2016-07-10 08:46:05 -07:00 |
|
Sangjin Lee
|
c5dbde0cc4
|
Fixed the build after the rebase with trunk.
|
2016-07-10 08:46:05 -07:00 |
|
Vrushali
|
6d943038f6
|
Cleanup changes during rebase with trunk (Vrushali C)
|
2016-07-10 08:46:04 -07:00 |
|
Sangjin Lee
|
1a227744ac
|
YARN-5070. upgrade HBase version for first merge (Vrushali C via sjlee)
|
2016-07-10 08:46:04 -07:00 |
|
Varun Saxena
|
1ff6833bba
|
YARN-5243. fix several rebase and other miscellaneous issues before merge. (Sangjin Lee via Varun Saxena)
|
2016-07-10 08:46:03 -07:00 |
|
Varun Saxena
|
892b193bd7
|
YARN-5170. Eliminate singleton converters and static method access. (Joep Rottinghuis via Varun Saxena)
|
2016-07-10 08:46:03 -07:00 |
|