Commit Graph

179 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli
44eb4c31b8 YARN-198. Added a link to RM pages from the NodeManager web app. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455800 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 04:24:35 +00:00
Thomas Graves
5f2c518c95 YARN-443. allow OS scheduling priority of NM to be different than the containers it launches (tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454411 13f79535-47bb-0310-9956-ffa450edef68
2013-03-08 14:46:26 +00:00
Arun Murthy
80c2cf57fd Preparing for bug-fix 2.0.4-alpha release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453886 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 14:21:40 +00:00
Suresh Srinivas
50d136f9c9 HADOOP-9373. Merge CHANGES.branch-trunk-win.txt to CHANGES.txt. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453599 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 22:37:42 +00:00
Hitesh Shah
2e4382b7c3 YARN-429. capacity-scheduler config missing from yarn-test artifact. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453501 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 19:26:57 +00:00
Jonathan Turner Eagles
21066255da YARN-227. Application expiration difficult to debug for end-users (Jason Lowe via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453080 13f79535-47bb-0310-9956-ffa450edef68
2013-03-05 23:12:17 +00:00
Jason Darrell Lowe
5889f54ad1 YARN-345. Many InvalidStateTransitonException errors for ApplicationImpl in Node Manager. Contributed by Robert Parker
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452548 13f79535-47bb-0310-9956-ffa450edef68
2013-03-04 21:47:39 +00:00
Robert Joseph Evans
9334dc23f9 YARN-448. Remove unnecessary hflush from log aggregation (Kihwal Lee via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452475 13f79535-47bb-0310-9956-ffa450edef68
2013-03-04 20:08:21 +00:00
Vinod Kumar Vavilapalli
6680ee5f5d YARN-410. Fixed RM UI so that the new lines diagnostics for a failed app on the per-application page are translated to html line breaks. Contributed by Omkar Vinit Joshi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451808 13f79535-47bb-0310-9956-ffa450edef68
2013-03-02 01:21:53 +00:00
Vinod Kumar Vavilapalli
0b708ab75d YARN-380. Fix yarn node -status output to be better readable. Contributed by Omkar Vinit Joshi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451711 13f79535-47bb-0310-9956-ffa450edef68
2013-03-01 20:39:18 +00:00
Siddharth Seth
83d8065867 YARN-376. Fixes a bug which would prevent the NM knowing about completed containers and applications. Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451473 13f79535-47bb-0310-9956-ffa450edef68
2013-03-01 05:59:54 +00:00
Siddharth Seth
62d70af19a YARN-406. Fix TestRackResolver to function in networks where "host1" resolves to a valid host. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451391 13f79535-47bb-0310-9956-ffa450edef68
2013-02-28 22:17:39 +00:00
Kihwal Lee
27c8a87a54 YARN-269. Resource Manager not logging the health_check_script result when taking it out. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451341 13f79535-47bb-0310-9956-ffa450edef68
2013-02-28 21:02:06 +00:00
Robert Joseph Evans
0057600a82 YARN-426. Failure to download a public resource prevents further downloads (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450807 13f79535-47bb-0310-9956-ffa450edef68
2013-02-27 15:30:10 +00:00
Siddharth Seth
7ea82ca558 YARN-365. Change NM heartbeat handling to not generate a scheduler event on each heartbeat. (Contributed by Xuan Gong)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450007 13f79535-47bb-0310-9956-ffa450edef68
2013-02-26 03:32:10 +00:00
Suresh Srinivas
10e1e314ac YARN-390. ApplicationCLI and NodeCLI hard-coded platform-specific line separator causes test failures on Windows. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449980 13f79535-47bb-0310-9956-ffa450edef68
2013-02-26 00:26:24 +00:00
Jonathan Turner Eagles
320f7bdcb8 YARN-236. RM should point tracking URL to RM web page when app fails to start (Jason Lowe via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448406 13f79535-47bb-0310-9956-ffa450edef68
2013-02-20 20:57:22 +00:00
Thomas Graves
efaaf58605 YARN-400. RM can return null application resource usage report leading to NPE in client (Jason Lowe via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448241 13f79535-47bb-0310-9956-ffa450edef68
2013-02-20 15:35:06 +00:00
Siddharth Seth
7bc6040ebb YARN-391. Formatting fixes for LCEResourceHandler classes. Contributed by Steve Loughran)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445882 13f79535-47bb-0310-9956-ffa450edef68
2013-02-13 19:40:36 +00:00
Thomas Graves
666667464a YARN-249. Capacity Scheduler web page should show list of active users per queue like it used to (in 1.x) (Ravi Prakash via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445673 13f79535-47bb-0310-9956-ffa450edef68
2013-02-13 15:40:01 +00:00
Jason Darrell Lowe
d4931241ab YARN-362. Unexpected extra results when using webUI table search. Contributed by Ravi Prakash
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1444085 13f79535-47bb-0310-9956-ffa450edef68
2013-02-08 15:55:32 +00:00
Tsz-wo Sze
a63d50f79a YARN-377. Use the new StringUtils methods added by HADOOP-9252 and fix TestContainersMonitor. Contributed by Chris Nauroth
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443796 13f79535-47bb-0310-9956-ffa450edef68
2013-02-07 23:53:49 +00:00
Siddharth Seth
362da383fd YARN-385. Add missing fields - location and #containers to ResourceRequestPBImpl's toString(). Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443702 13f79535-47bb-0310-9956-ffa450edef68
2013-02-07 20:28:20 +00:00
Siddharth Seth
bdfe23235e YARN-383. AMRMClientImpl should handle null rmClient in stop(). Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443699 13f79535-47bb-0310-9956-ffa450edef68
2013-02-07 20:21:38 +00:00
Siddharth Seth
ab16a37572 YARN-355. Fixes a bug where RM app submission could jam under load. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443131 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 19:03:52 +00:00
Daryn Sharp
d272918426 YARN-357. App submission should not be synchronized (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443016 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 15:26:30 +00:00
Arun Murthy
c52a277687 YARN-3. Merged to branch-2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443011 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 15:19:24 +00:00
Arun Murthy
7cc2050041 Preparing for hadoop-2.0.3-alpha release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442959 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 13:31:52 +00:00
Arun Murthy
38bb4ad738 YARN-370. Fix SchedulerUtils to correctly round up the resource for containers. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442840 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 04:24:56 +00:00
Siddharth Seth
5d679c4f43 YARN-360. Allow apps to concurrently register tokens for renewal. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442441 13f79535-47bb-0310-9956-ffa450edef68
2013-02-05 00:26:16 +00:00
Hitesh Shah
b1baf11fb2 YARN-372. Move InlineDispatcher from hadoop-yarn-server-resourcemanager to hadoop-yarn-common. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441668 13f79535-47bb-0310-9956-ffa450edef68
2013-02-02 00:43:54 +00:00
Jason Darrell Lowe
f811198164 YARN-364. AggregatedLogDeletionService can take too long to delete logs. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441239 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 22:46:05 +00:00
Thomas Graves
6384684299 YARN-343. Capacity Scheduler maximum-capacity value -1 is invalid (Xuan Gong via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440457 13f79535-47bb-0310-9956-ffa450edef68
2013-01-30 15:15:23 +00:00
Kihwal Lee
df10249669 YARN-133. Update web services docs for RM clusterMetrics. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439653 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 21:51:36 +00:00
Jason Darrell Lowe
2e9e7601e1 YARN-354. WebAppProxyServer exits immediately after startup. Contributed by Liang Xie
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437775 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 22:05:55 +00:00
Thomas White
345bcee066 YARN-319. Submitting a job to a fair scheduler queue for which the user does not have permission causes the client to wait forever. Contributed by shenhong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437336 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 10:53:05 +00:00
Hitesh Shah
29ddce96a2 YARN-231. RM Restart - Add FS-based persistent store implementation for RMStateStore. Contributed by Bikas Saha
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437245 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 00:57:37 +00:00
Hitesh Shah
f5551bf809 YARN-277. Use AMRMClient in DistributedShell to exemplify the approach. Contributed by Bikas Saha
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437156 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 20:49:09 +00:00
Alejandro Abdelnur
f85b583731 YARN-302. Fair scheduler assignmultiple should default to false. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434996 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 00:48:22 +00:00
Alejandro Abdelnur
c9dd4fa67f YARN-331. Fill in missing fair scheduler documentation. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434990 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 00:37:23 +00:00
Thomas Graves
f266efcd10 Preparing for release 0.23.6
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434030 13f79535-47bb-0310-9956-ffa450edef68
2013-01-16 16:43:12 +00:00
Siddharth Seth
6a2f2551fd YARN-135. Client tokens should be per app-attempt, and should be unregistered on App-finish. Contributed by Vinod Kumar Vavilapalli
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433570 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 18:33:38 +00:00
Thomas White
72e631098d YARN-336. Fair scheduler FIFO scheduling within a queue only allows 1 app at a time. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433526 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 17:09:48 +00:00
Thomas White
8447557333 YARN-335. Fair scheduler doesn't check whether rack needs containers before assigning to node. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433484 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 16:12:33 +00:00
Suresh Srinivas
bbfcc709a2 YARN-328. Use token request messages defined in hadoop common. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433231 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 00:16:57 +00:00
Hitesh Shah
d7f9f9d177 YARN-330. Fix flakey test: TestNodeManagerShutdown#testKillContainersOnShutdown. Contributed by Sandy Ryza
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433138 13f79535-47bb-0310-9956-ffa450edef68
2013-01-14 21:27:39 +00:00
Thomas Graves
ce9b0a05b0 YARN-334. Maven RAT plugin is not checking all source files (tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432931 13f79535-47bb-0310-9956-ffa450edef68
2013-01-14 14:34:51 +00:00
Thomas Graves
106e2e27ff YARN-325. RM CapacityScheduler can deadlock when getQueueInfo() is called and a container is completing (Arun C Murthy via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431070 13f79535-47bb-0310-9956-ffa450edef68
2013-01-09 21:00:47 +00:00
Siddharth Seth
ba5b19fb5d YARN-320. RM should always be able to renew its own tokens. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431020 13f79535-47bb-0310-9956-ffa450edef68
2013-01-09 19:33:06 +00:00
Arun Murthy
4539263971 YARN-2. Enhanced CapacityScheduler to account for CPU alongwith memory for multi-dimensional resource scheduling. Contributed by Arun C. Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430682 13f79535-47bb-0310-9956-ffa450edef68
2013-01-09 05:08:23 +00:00