big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,269 Commits 2 Branches 2 Tags 264 MiB
43f17f6e10
Commit Graph

78 Commits

Author SHA1 Message Date
Thomas Graves
106e2e27ff YARN-325. RM CapacityScheduler can deadlock when getQueueInfo() is called and a container is completing (Arun C Murthy via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431070 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 21:00:47 +00:00
Siddharth Seth
ba5b19fb5d YARN-320. RM should always be able to renew its own tokens. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431020 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 19:33:06 +00:00
Arun Murthy
4539263971 YARN-2. Enhanced CapacityScheduler to account for CPU alongwith memory for multi-dimensional resource scheduling. Contributed by Arun C. Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430682 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 05:08:23 +00:00
Thomas Graves
dd8fc7e499 YARN-50. Implement renewal / cancellation of Delegation Tokens(Siddharth Seth via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429085 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 20:15:32 +00:00
Thomas White
8cd026d365 YARN-301. Fair scheduler throws ConcurrentModificationException when iterating over app's priorities. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428400 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 15:26:55 +00:00
Thomas White
0768f96a83 YARN-300. After YARN-271, fair scheduler can infinite loop and not schedule any application. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428387 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 15:07:22 +00:00
Thomas White
19a291a0d6 YARN-288. Fair scheduler queue doesn't accept any jobs when ACLs are configured. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428362 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 14:32:01 +00:00
Thomas White
ba90c9c867 YARN-192. Node update causes NPE in the fair scheduler. Contributed by Sandy Ryza 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428314 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 12:29:13 +00:00
Thomas Graves
a806a2aac6 YARN-280. RM does not reject app submission with invalid tokens (Daryn Sharp via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425079 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-21 18:49:47 +00:00
Alejandro Abdelnur
a276f68b92 YARN-283. Fair scheduler fails to get queue info without root prefix. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424998 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-21 16:20:12 +00:00
Alejandro Abdelnur
5014a4b133 YARN-282. Fair scheduler web UI double counts Apps Submitted. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424995 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-21 16:12:20 +00:00
Alejandro Abdelnur
f121d1e333 YARN-278. Fair scheduler maxRunningApps config causes no apps to make progress. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424989 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-21 16:07:11 +00:00
Alejandro Abdelnur
39ec437268 YARN-272. Fair scheduler log messages try to print objects without overridden toString methods. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424984 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-21 16:01:48 +00:00
Thomas White
ee007d3f38 YARN-271. Fair scheduler hits IllegalStateException trying to reserve different apps on same node. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424945 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-21 15:10:24 +00:00
Arun Murthy
6cd0736cc5 YARN-230. RM Restart phase 1 - includes support for saving/restarting all applications on an RM bounce. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423758 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-19 04:21:18 +00:00
Alejandro Abdelnur
595d52cf37 YARN-254. Update fair scheduler web UI for hierarchical queues. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423742 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-19 03:04:39 +00:00
Alejandro Abdelnur
be8ef2ec33 YARN-264. y.s.rm.DelegationTokenRenewer attempts to renew token even after removing an app. (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1421575 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-13 22:16:29 +00:00
Thomas White
618fa6cd59 YARN-267. Fix fair scheduler web UI. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420704 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 14:35:01 +00:00
Jason Darrell Lowe
b72b36009a YARN-266. RM and JHS Web UIs are blank because AppsBlock is not escaping string properly. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420232 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-11 15:45:10 +00:00
Jason Darrell Lowe
2d1237cbb0 YARN-258. RM web page UI shows Invalid Date for start and finish times. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417948 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-06 15:39:30 +00:00
Jason Darrell Lowe
1573c1159a YARN-251. Proxy URI generation fails for blank tracking URIs. Contributed by Tom White 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415742 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 17:07:40 +00:00
Thomas White
ae6f1123f5 YARN-187. Add hierarchical queues to the fair scheduler. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415592 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 12:03:25 +00:00
Arun Murthy
1943fdbec6 YARN-229. Remove old unused RM recovery code. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415029 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-29 01:56:33 +00:00
Thomas White
dd0ba9c0cc MAPREDUCE-4778. Fair scheduler event log is only written if directory exists on HDFS. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414729 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-28 14:40:40 +00:00
Thomas White
fcbd55d092 YARN-222. Fair scheduler should create queue for each user by default. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414655 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-28 12:53:29 +00:00
Thomas White
d9050e1208 YARN-224. Fair scheduler logs too many nodeUpdate INFO messages. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414647 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-28 12:27:30 +00:00
Alejandro Abdelnur
576f96f0ac YARN-184. Remove unnecessary locking in fair scheduler, and address findbugs excludes. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410826 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 05:00:56 +00:00
Robert Joseph Evans
a23e8b0929 YARN-151. Browser thinks RM main page JS is taking too long (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410564 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-16 20:56:08 +00:00
Robert Joseph Evans
ab5039d4f1 YARN-214. RMContainerImpl does not handle event EXPIRE at state RUNNING (jeagles via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410522 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-16 18:26:19 +00:00
Robert Joseph Evans
1dedca8c9a YARN-188. Coverage fixing for CapacityScheduler (Aleksey Gorshkov via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409827 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 15:15:51 +00:00
Jason Darrell Lowe
397c261433 YARN-216. Remove jquery theming support. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409313 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 19:22:11 +00:00
Jonathan Turner Eagles
9e3af0ccd2 YARN-206. TestApplicationCleanup.testContainerCleanup occasionally fails. (jlowe via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407606 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 19:52:28 +00:00
Thomas White
933a6d2c1e YARN-183. Clean up fair scheduler code. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407433 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 12:38:10 +00:00
Arun Murthy
fb5b96dfc3 YARN-201. Fix CapacityScheduler to be less conservative for starved off-switch requests. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406834 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 21:56:18 +00:00
Vinod Kumar Vavilapalli
a124297cf0 YARN-189. Fixed a deadlock between RM's ApplicationMasterService and the dispatcher. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404431 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-01 00:32:37 +00:00
Robert Joseph Evans
ab8fa651f7 YARN-166. capacity scheduler doesn't allow capacity < 1.0 (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404247 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 16:56:23 +00:00
Robert Joseph Evans
9f55dd3a54 YARN-159. RM web ui applications page should be sorted to display last app first (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404228 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 16:22:34 +00:00
Robert Joseph Evans
c15c192ad0 YARN-165. RM should point tracking URL to RM web page for app when AM fails (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404211 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 15:47:11 +00:00
Thomas White
b54e794fb0 YARN-145. Add a Web UI to the fair share scheduler. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402657 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 20:55:57 +00:00
Robert Joseph Evans
90ba993bc7 YARN-180. Capacity scheduler - containers that get reserved create container token to early (acmurthy and bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401703 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 14:16:49 +00:00
Thomas Graves
cc523683cf YARN-177. CapacityScheduler - adding a queue while the RM is running has wacky results (acmurthy vai tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401668 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 13:21:09 +00:00
Vinod Kumar Vavilapalli
ca4bc1a417 YARN-181. Fixed eclipse settings broken by capacity-scheduler.xml move via YARN-140. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401504 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 22:48:49 +00:00
Siddharth Seth
88d326f0a4 YARN-179. Fix some unit test failures. (Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401481 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 21:06:36 +00:00
Alejandro Abdelnur
d0a2d55b1a YARN-140. Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler. (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400335 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 23:16:07 +00:00
Siddharth Seth
f79ae91414 YARN-136. Make ClientToAMTokenSecretManager part of RMContext (Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400278 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 20:37:30 +00:00
Vinod Kumar Vavilapalli
6cfa710bad YARN-32. Fix TestApplicationTokens to not depend on test order and thus pass on JDK7. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399795 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-18 19:12:13 +00:00
Vinod Kumar Vavilapalli
ab727f4966 YARN-43. Fix TestResourceTrackerService to not depend on test order and thus pass on JDK7. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399066 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 01:24:50 +00:00
Thomas White
3d76be910d YARN-146. Add unit tests for computing fair share in the fair scheduler. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396972 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 10:07:01 +00:00
Siddharth Seth
0e2d93557e YARN-150. Fixes AppRejectedTransition does not unregister a rejected app-attempt from the ApplicationMasterService (Contributed by Bikas Saha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396429 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 00:08:25 +00:00
Vinod Kumar Vavilapalli
a5ebccd7bc YARN-30. Fixed tests verifying web-services to work on JDK7. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396391 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 22:54:11 +00:00