Tsuyoshi Ozawa
|
b5a22e9838
|
YARN-3258. FairScheduler: Need to add more logging to investigate allocations. Contributed by Anubhav Dhoot.
|
2015-03-31 17:42:44 +09:00 |
|
Wangda Tan
|
2a945d24f7
|
YARN-2495. Allow admin specify labels from each NM (Distributed configuration for node label). (Naganarasimha G R via wangda)
|
2015-03-30 12:05:21 -07:00 |
|
Wangda Tan
|
97a7277a2d
|
YARN-3383. AdminService should use warn instead of info to log exception when operation fails. (Li Lu via wangda)
|
2015-03-24 10:38:54 -07:00 |
|
Karthik Kambatla
|
972f1f1ab9
|
YARN-2868. FairScheduler: Metric for latency to allocate first container for an application. (Ray Chiang via kasha)
|
2015-03-23 14:07:05 -07:00 |
|
Karthik Kambatla
|
2bc097cd14
|
YARN-3241. FairScheduler handles invalid queue names inconsistently. (Zhihai Xu via kasha)
|
2015-03-23 13:22:03 -07:00 |
|
cnauroth
|
6ca1f12024
|
YARN-3336. FileSystem memory leak in DelegationTokenRenewer.
|
2015-03-23 10:45:50 -07:00 |
|
Jian He
|
e1feb4ea1a
|
YARN-3345. Add non-exclusive node label API. Contributed by Wangda Tan
|
2015-03-20 19:04:38 -07:00 |
|
Jian He
|
586348e4cb
|
YARN-3356. Capacity Scheduler FiCaSchedulerApp should use ResourceUsage to track used-resources-by-label. Contributed by Wangda Tan
|
2015-03-20 13:54:01 -07:00 |
|
Wangda Tan
|
6bc7710ec7
|
YARN-3369. Missing NullPointer check in AppSchedulingInfo causes RM to die. (Brahma Reddy Battula via wangda)
|
2015-03-20 10:42:05 -07:00 |
|
Jian He
|
4e886eb9cb
|
YARN-3379. Fixed missing data in localityTable and ResourceRequests table in RM WebUI. Contributed by Xuan Gong
|
2015-03-19 22:27:21 -07:00 |
|
Devaraj K
|
93d0f4acc8
|
YARN-3357. Move TestFifoScheduler to FIFO package. Contributed by Rohith
Sharmaks.
|
2015-03-19 12:16:52 +05:30 |
|
Jian He
|
658097d6da
|
YARN-3273. Improve scheduler UI to facilitate scheduling analysis and debugging. Contributed Rohith Sharmaks
|
2015-03-17 21:30:23 -07:00 |
|
Tsuyoshi Ozawa
|
3bc72cc16d
|
YARN-3205. FileSystemRMStateStore should disable FileSystem Cache to avoid get a Filesystem with an old configuration. Contributed by Zhihai Xu.
|
2015-03-18 11:53:19 +09:00 |
|
Jian He
|
968425e9f7
|
YARN-3305. Normalize AM resource request on app submission. Contributed by Rohith Sharmaks
|
2015-03-17 13:49:59 -07:00 |
|
Karthik Kambatla
|
32b4330456
|
Revert "YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)"
This reverts commit c2b185def8 .
|
2015-03-17 12:31:15 -07:00 |
|
Jian He
|
487374b7fe
|
YARN-3243. CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits. Contributed by Wangda Tan.
|
2015-03-17 10:24:23 -07:00 |
|
Devaraj K
|
7179f94f9d
|
YARN-3197. Confusing log generated by CapacityScheduler. Contributed by
Varun Saxena.
|
2015-03-17 15:57:57 +05:30 |
|
Tsuyoshi Ozawa
|
7522a643fa
|
YARN-3349. Treat all exceptions as failure in TestFSRMStateStore#testFSRMStateStoreClientRetry. Contributed by Zhihai Xu.
|
2015-03-17 08:09:55 +09:00 |
|
Tsuyoshi Ozawa
|
3da9a97cfb
|
YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA, Andrew Purtell, and Allen Wittenauer.
|
2015-03-16 23:19:05 +09:00 |
|
Vinod Kumar Vavilapalli
|
863079bb87
|
YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating running logs of application when rolling is enabled. Contributed by Xuan Gong.
|
2015-03-12 13:32:29 -07:00 |
|
Zhijie Shen
|
85f6d67fa7
|
YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM web page. Contributed by Xuan Gong.
|
2015-03-11 19:35:19 -07:00 |
|
Allen Wittenauer
|
a5cf985bf5
|
YARN-2280. Resource manager web service fields are not accessible (Krisztian Horvath via aw)
|
2015-03-10 16:32:20 -07:00 |
|
Jian He
|
c3003eba6f
|
YARN-3300. Outstanding_resource_requests table should not be shown in AHS. Contributed by Xuan Gong
|
2015-03-09 20:46:48 -07:00 |
|
Jason Lowe
|
27e8ea820f
|
YARN-3275. CapacityScheduler: Preemption happening on non-preemptable queues. Contributed by Eric Payne
|
2015-03-06 22:37:26 +00:00 |
|
Jian He
|
95bfd087dc
|
YARN-1809. Synchronize RM and TimeLineServer Web-UIs. Contributed by Zhijie Shen and Xuan Gong
|
2015-03-05 21:20:09 -08:00 |
|
Tsuyoshi Ozawa
|
1b67209612
|
YARN-3249. Add a 'kill application' button to Resource Manager's Web UI. Contributed by Ryu Kobayashi.
|
2015-03-05 19:55:56 +09:00 |
|
Karthik Kambatla
|
8d88691d16
|
YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client. (Zhihai Xu via kasha)
|
2015-03-04 19:49:05 -08:00 |
|
Karthik Kambatla
|
22426a1c9f
|
YARN-3231. FairScheduler: Changing queueMaxRunningApps interferes with pending jobs. (Siqi Li via kasha)
|
2015-03-04 18:06:58 -08:00 |
|
Jian He
|
b2f1ec312e
|
YARN-3222. Fixed NPE on RMNodeImpl#ReconnectNodeTransition when a node is reconnected with a different port. Contributed by Rohith Sharmaks
|
2015-03-03 16:28:28 -08:00 |
|
Wangda Tan
|
e17e5ba9d7
|
YARN-3272. Surface container locality info in RM web UI (Jian He via wangda)
|
2015-03-03 11:49:01 -08:00 |
|
Tsuyoshi Ozawa
|
d1c6accb6f
|
HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)
|
2015-03-03 14:17:52 +09:00 |
|
Vinod Kumar Vavilapalli
|
14dd647c55
|
YARN-3265. Fixed a deadlock in CapacityScheduler by always passing a queue's available resource-limit from the parent queue. Contributed by Wangda Tan.
|
2015-03-02 17:52:47 -08:00 |
|
Jian He
|
5d0bae550f
|
YARN-3281. Added RMStateStore to StateMachine visualization list. Contributed by Chengbing Liu
|
2015-03-02 14:39:49 -08:00 |
|
Wangda Tan
|
edcecedc1c
|
YARN-3262. Surface application outstanding resource requests table in RM web UI. (Jian He via wangda)
|
2015-02-27 16:13:32 -08:00 |
|
Tsuyoshi Ozawa
|
01a1621930
|
YARN-2820. Retry in FileSystemRMStateStore when FS's operations fail due to IOException. Contributed by Zhihai Xu.
|
2015-02-28 00:56:44 +09:00 |
|
Konstantin V Shvachko
|
8ca0d957c4
|
YARN-3255. RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic options. Contributed by Konstantin Shvachko.
|
2015-02-26 17:12:19 -08:00 |
|
Devaraj K
|
0d4296f0e0
|
YARN-3256. TestClientToAMTokens#testClientTokenRace is not running against
all Schedulers even when using ParameterizedSchedulerTestBase. Contributed
by Anubhav Dhoot.
|
2015-02-26 15:45:41 +05:30 |
|
Tsuyoshi Ozawa
|
6cbd9f1113
|
YARN-3247. TestQueueMappings should use CapacityScheduler explicitly. Contributed by Zhihai Xu.
|
2015-02-25 10:38:11 +09:00 |
|
Tsuyoshi Ozawa
|
9cedad11d8
|
Revert "HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)"
This reverts commit 946456c6d8 .
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/QuotaByStorageTypeEntry.java
|
2015-02-25 00:32:04 +09:00 |
|
Xuan
|
fe7a302473
|
YARN-2797. TestWorkPreservingRMRestart should use
ParametrizedSchedulerTestBase. Contributed by Karthik Kambatla
|
2015-02-21 19:17:29 -08:00 |
|
Wangda Tan
|
ce5bf927c3
|
YARN-3230. Clarify application states on the web UI. (Jian He via wangda)
|
2015-02-20 10:39:28 -08:00 |
|
Jason Lowe
|
a64dd3d24b
|
YARN-3194. RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node. Contributed by Rohith
|
2015-02-20 15:10:10 +00:00 |
|
Jian He
|
c0d9b93953
|
YARN-933. Fixed InvalidStateTransitonException at FINAL_SAVING state in RMApp. Contributed by Rohith Sharmaks
|
2015-02-19 15:42:39 -08:00 |
|
Wangda Tan
|
d49ae725d5
|
YARN-3076. Add API/Implementation to YarnClient to retrieve label-to-node mapping (Varun Saxena via wangda)
|
2015-02-19 11:00:57 -08:00 |
|
Tsuyoshi Ozawa
|
946456c6d8
|
HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)
|
2015-02-19 13:06:53 +09:00 |
|
Tsuyoshi Ozawa
|
b8a14efdf5
|
YARN-1615. Fix typos in delay scheduler's description. Contributed by Akira Ajisaka.
|
2015-02-19 10:24:07 +09:00 |
|
Jian He
|
1c03376300
|
YARN-1514. Utility to benchmark ZKRMStateStore#loadState for RM HA. Contributed by Tsuyoshi OZAWA
|
2015-02-18 16:06:55 -08:00 |
|
Jian He
|
f5da5566d9
|
YARN-3132. RMNodeLabelsManager should remove node from node-to-label mapping when node becomes deactivated. Contributed by Wangda Tan
|
2015-02-18 11:51:51 -08:00 |
|
Tsuyoshi Ozawa
|
556386a070
|
YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and Devaraj K.
|
2015-02-17 01:53:31 +09:00 |
|
Tsuyoshi Ozawa
|
3f32357c36
|
Revert "YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and devaraj."
This reverts commit 9aae81c934 .
|
2015-02-17 01:52:22 +09:00 |
|
Tsuyoshi Ozawa
|
9aae81c934
|
YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and devaraj.
|
2015-02-17 01:48:22 +09:00 |
|
Tsuyoshi Ozawa
|
110cf6b9a3
|
YARN-3182. Cleanup switch statement in ApplicationMasterLauncher#handle(). Contributed by Ray Chiang.
|
2015-02-13 14:21:21 +09:00 |
|
Xuan
|
99f6bd4f7a
|
YARN-3158. Correct log messages in ResourceTrackerService. Contributed
by Varun Saxena
|
2015-02-12 16:42:15 -08:00 |
|
Jian He
|
18297e0972
|
YARN-3104. Fixed RM to not generate new AMRM tokens on every heartbeat between rolling and activation. Contributed by Jason Lowe
|
2015-02-12 16:02:45 -08:00 |
|
Jian He
|
18a594257e
|
YARN-3124. Fixed CS LeafQueue/ParentQueue to use QueueCapacities to track capacities-by-label. Contributed by Wangda Tan
|
2015-02-12 14:58:09 -08:00 |
|
Karthik Kambatla
|
c2b185def8
|
YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)
|
2015-02-12 13:44:47 -08:00 |
|
Xuan
|
65c69e296e
|
YARN-3151. On Failover tracking url wrong in application cli for KILLED
application. Contributed by Rohith
|
2015-02-11 21:19:48 -08:00 |
|
Junping Du
|
c541a374d8
|
YARN-3160. Fix non-atomic operation on nodeUpdateQueue in RMNodeImpl. (Contributed by Chengbing Liu)
|
2015-02-11 03:44:31 -08:00 |
|
Zhijie Shen
|
d5855c0e46
|
YARN-2246. Made the proxy tracking URL always be http(s)://proxy addr:port/proxy/<appId> to avoid duplicate sections. Contributed by Devaraj K.
|
2015-02-10 15:24:01 -08:00 |
|
Zhijie Shen
|
23bf6c7207
|
YARN-3100. Made YARN authorization pluggable. Contributed by Jian He.
|
2015-02-09 20:34:56 -08:00 |
|
Jian He
|
0af6a99a3f
|
YARN-3094. Reset timer for liveness monitors after RM recovery. Contributed by Jun Gong
|
2015-02-09 13:47:08 -08:00 |
|
Karthik Kambatla
|
7e42088abf
|
YARN-2990. FairScheduler's delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requests. (kasha)
|
2015-02-08 22:48:10 -08:00 |
|
Jason Lowe
|
da2fb2bc46
|
YARN-3143. RM Apps REST API can return NPE or entries missing id and other fields. Contributed by Jason Lowe
|
2015-02-06 21:47:32 +00:00 |
|
Jian He
|
c1957fef29
|
YARN-2694. Ensure only single node label specified in ResourceRequest. Contributed by Wangda Tan
|
2015-02-06 11:34:20 -08:00 |
|
Arun C. Murthy
|
18b2507eda
|
YARN-1904. Ensure exceptions thrown in ClientRMService & ApplicationHistoryClientService are uniform when application-attempt is not found. Contributed by Zhijie Shen.
|
2015-02-05 23:48:55 -08:00 |
|
Jian He
|
4641196fe0
|
YARN-3145. Fixed ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo. Contributed by Tsuyoshi OZAWA
|
2015-02-05 16:12:53 -08:00 |
|
Jason Lowe
|
69c8a7f45b
|
YARN-1582. Capacity Scheduler: add a maximum-allocation-mb setting per queue. Contributed by Thomas Graves
|
2015-02-05 19:28:49 +00:00 |
|
Sandy Ryza
|
b6466deac6
|
YARN-3101. In Fair Scheduler, fix canceling of reservations for exceeding max share (Anubhav Dhoot via Sandy Ryza)
|
2015-02-05 09:39:28 -08:00 |
|
Tsuyoshi Ozawa
|
26dee1486b
|
YARN-3058. Fix error message of tokens' activation delay configuration. Contributed by Yi Liu.
|
2015-02-04 11:41:14 +09:00 |
|
Zhijie Shen
|
e5b56e2af6
|
YARN-2543. Made resource usage be published to the timeline server too. Contributed by Naganarasimha G R.
|
2015-02-03 17:34:22 -08:00 |
|
Wangda Tan
|
5bd984691b
|
YARN-3075. NodeLabelsManager implementation to retrieve label to node mapping (Varun Saxena via wangda)
|
2015-02-03 12:52:42 -08:00 |
|
Jian He
|
21d80b3dd9
|
YARN-3098. Created common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues. Contributed by Wangda Tan
|
2015-02-03 11:43:12 -08:00 |
|
Jason Lowe
|
a761bf8726
|
YARN-3085. Application summary should include the application type. Contributed by Rohith
|
2015-02-03 14:56:34 +00:00 |
|
Jian He
|
054a947989
|
YARN-3077. Fixed RM to create zk root path recursively. Contributed by Chun Chen
|
2015-01-30 17:34:49 -08:00 |
|
Jian He
|
86358221fc
|
YARN-3099. Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label. Contributed by Wangda Tan
|
2015-01-30 15:15:20 -08:00 |
|
Akira Ajisaka
|
342efa110a
|
HADOOP-9907. Webapp http://hostname:port/metrics link is not working. (aajisaka)
|
2015-01-30 02:49:10 +09:00 |
|
Wangda Tan
|
7882bc0f14
|
YARN-3079. Scheduler should also update maximumAllocation when updateNodeResource. (Zhihai Xu via wangda)
|
2015-01-28 21:54:38 -08:00 |
|
Wangda Tan
|
18741adf97
|
YARN-2932. Add entry for preemptable status (enabled/disabled) to scheduler web UI and queue initialize/refresh logging. (Eric Payne via wangda)
|
2015-01-27 15:36:09 -08:00 |
|
Jian He
|
6f9fe76918
|
YARN-3092. Created a common ResourceUsage class to track labeled resource usages in Capacity Scheduler. Contributed by Wangda Tan
|
2015-01-26 15:38:00 -08:00 |
|
Tsuyoshi Ozawa
|
24aa462673
|
YARN-2800. Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature. Contributed by Wangda Tan.
|
2015-01-23 20:37:05 +09:00 |
|
Wangda Tan
|
0a2d3e717d
|
YARN-2933. Capacity Scheduler preemption policy should only consider capacity without labels temporarily. Contributed by Mayank Bansal
|
2015-01-19 16:48:50 -08:00 |
|
Junping Du
|
5d1cca34fa
|
YARN-3064. TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeout. (Contributed by Jian He)
|
2015-01-16 00:08:36 -08:00 |
|
Jian He
|
9e33116d1d
|
YARN-2861. Fixed Timeline DT secret manager to not reuse RM's configs. Contributed by Zhijie Shen
|
2015-01-15 11:07:43 -08:00 |
|
Jian He
|
c53420f583
|
YARN-2637. Fixed max-am-resource-percent calculation in CapacityScheduler when activating applications. Contributed by Craig Welch
|
2015-01-13 17:32:07 -08:00 |
|
Robert Kanter
|
51881535e6
|
YARN-2643. Don't create a new DominantResourceCalculator on every FairScheduler.allocate call. (kasha via rkanter)
|
2015-01-12 17:51:00 -08:00 |
|
Robert Kanter
|
ae7bf31fe1
|
YARN-3027. Scheduler should use totalAvailable resource from node instead of availableResource for maxAllocation. (adhoot via rkanter)
|
2015-01-12 10:47:52 -08:00 |
|
Jian He
|
a260406268
|
YARN-3014. Replaces labels on a host should update all NM's labels on that host. Contributed by Wangda Tan
|
2015-01-09 17:49:53 -08:00 |
|
Zhijie Shen
|
dc2eaa26b2
|
YARN-2996. Improved synchronization and I/O operations of FS- and Mem- RMStateStore. Contributed by Yi Liu.
|
2015-01-08 09:47:02 -08:00 |
|
Jian He
|
e13a484a2b
|
YARN-3010. Fixed findbugs warning in AbstractYarnScheduler. Contributed by Yi Liu
|
2015-01-07 14:12:20 -08:00 |
|
Zhijie Shen
|
60103fca04
|
YARN-2427. Added the API of moving apps between queues in RM web services. Contributed by Varun Vasudev.
|
2015-01-06 14:37:44 -08:00 |
|
Jian He
|
dd57c2047b
|
YARN-2978. Fixed potential NPE while getting queue info. Contributed by Varun Saxena
|
2015-01-06 14:15:57 -08:00 |
|
Karthik Kambatla
|
0c4b112677
|
YARN-2881. [YARN-2574] Implement PlanFollower for FairScheduler. (Anubhav Dhoot via kasha)
|
2015-01-06 04:42:10 +05:30 |
|
Zhijie Shen
|
562a701945
|
YARN-2958. Made RMStateStore not update the last sequence number when updating the delegation token. Contributed by Varun Saxena.
|
2015-01-05 13:33:07 -08:00 |
|
Tsuyoshi Ozawa
|
ddc5be48fc
|
YARN-2922. ConcurrentModificationException in CapacityScheduler's LeafQueue. Contributed by Rohith Sharmaks.
|
2015-01-05 00:08:31 +09:00 |
|
Karthik Kambatla
|
e7257acd8a
|
YARN-2998. Abstract out scheduler independent PlanFollower components. (Anubhav Dhoot via kasha)
|
2014-12-30 19:55:24 -08:00 |
|
Jian He
|
e2351c7ae2
|
YARN-2987. Fixed ClientRMService#getQueueInfo to check against queue and app ACLs. Contributed by Varun Saxena
|
2014-12-30 17:15:37 -08:00 |
|
Jian He
|
b7442bf92e
|
YARN-2493. Added node-labels page on RM web UI. Contributed by Wangda Tan
|
2014-12-30 16:49:01 -08:00 |
|
Jian He
|
746ad6e989
|
Revert "YARN-2492(wrong jira number). Added node-labels page on RM web UI. Contributed by Wangda Tan"
This reverts commit 5f57b904f5 .
|
2014-12-30 16:48:49 -08:00 |
|
Jian He
|
5f57b904f5
|
YARN-2492. Added node-labels page on RM web UI. Contributed by Wangda Tan
|
2014-12-30 15:38:28 -08:00 |
|
Zhijie Shen
|
241d3b3a50
|
YARN-2938. Fixed new findbugs warnings in hadoop-yarn-resourcemanager and hadoop-yarn-applicationhistoryservice. Contributed by Varun Saxena.
|
2014-12-29 09:59:35 -08:00 |
|