Commit Graph

72 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli
bca57d471f YARN-94. Modify DistributedShell to point to main-class by default, clean up the help message, and hard-code the AM class. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396226 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 19:40:31 +00:00
Siddharth Seth
1e30e49bf6 YARN-33. Change LocalDirsHandlerService to validate the configured local and log dirs. (Contributed by Mayank Bansal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395844 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 02:26:24 +00:00
Siddharth Seth
c074cfd6f0 YARN-134. Fixes ClientToAMSecretManager creates keys without checking for validity of the appID. (Contributed by Vinod Kumar Vavilapalli)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395841 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 01:56:05 +00:00
Vinod Kumar Vavilapalli
38e1a5a5d6 YARN-40. Fixed CHANGES.txt from previous commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395799 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 22:35:50 +00:00
Vinod Kumar Vavilapalli
331b1123fb YARN-40. Provided support for missing YARN commands Contributed by Devaraj K and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395793 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 22:18:42 +00:00
Vinod Kumar Vavilapalli
494e210521 YARN-127. Move RMAdmin tool to its correct location - the client module. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395781 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 21:21:38 +00:00
Alejandro Abdelnur
b8f81d74c8 YARN-23. FairScheduler: FSQueueSchedulable#updateDemand() - potential redundant aggregation. (kkambatl via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394321 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 23:00:41 +00:00
Siddharth Seth
247a5ee2f9 YARN-102. Move the apache header to the top of the file in MemStore.java. (Contributed by Devaraj K)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393769 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 21:19:11 +00:00
Siddharth Seth
db51b03d72 YARN-131. Fix incorrect ACL properties in capacity scheduler documentation. (Contributed by Ahmed Radwan)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393262 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 02:56:20 +00:00
Arun Murthy
b146f9f9ca HADOOP-8738. Reverted since it broke MR based system tests.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392675 13f79535-47bb-0310-9956-ffa450edef68
2012-10-01 22:42:46 +00:00
Arun Murthy
92f1f2c2a6 YARN-138. Ensure default values for minimum/maximum container sizes is sane. Contributed by Harsh J and Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391944 13f79535-47bb-0310-9956-ffa450edef68
2012-09-30 03:32:07 +00:00
Arun Murthy
70c295d90d YARN-137. Change the default YARN scheduler to be the CapacityScheduler. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391929 13f79535-47bb-0310-9956-ffa450edef68
2012-09-30 00:41:24 +00:00
Siddharth Seth
39f15579b8 YARN-116. Add the ability to change the RM include/exclude file without a restart. (Contributed by xieguiming and Harsh J)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391912 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 22:39:03 +00:00
Robert Joseph Evans
af647bb3ce Preparing for release 0.23.4
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391805 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 14:15:39 +00:00
Harsh J
34becbb019 HADOOP-8386. hadoop script doesn't work if 'cd' prints to stdout (default behavior in Ubuntu). Contributed by Christopher Berner and Andy Isaacson. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391780 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 10:57:53 +00:00
Robert Joseph Evans
41ebf4fb24 YARN-106. Nodemanager needs to set permissions of local directories (jlowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391649 13f79535-47bb-0310-9956-ffa450edef68
2012-09-28 20:50:44 +00:00
Vinod Kumar Vavilapalli
40062e1aaa Fix NodeManager to verify the application's user-name.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390825 13f79535-47bb-0310-9956-ffa450edef68
2012-09-27 03:43:57 +00:00
Thomas Graves
050fd3a117 MAPREDUCE-4647. We should only unjar jobjar if there is a lib directory in it. (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390557 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 15:22:21 +00:00
Arun Murthy
8912aac81e YARN-9. Rename YARN_HOME to HADOOP_YARN_HOME. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390218 13f79535-47bb-0310-9956-ffa450edef68
2012-09-25 23:37:32 +00:00
Vinod Kumar Vavilapalli
d524942289 YARN-53. Added the missing getGroups API to ResourceManager. Contributed by Bo Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389176 13f79535-47bb-0310-9956-ffa450edef68
2012-09-24 00:51:51 +00:00
Siddharth Seth
bfe3816c66 YARN-88. DefaultContainerExecutor can fail to set proper permissions. (Contributed by Jason Lowe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388580 13f79535-47bb-0310-9956-ffa450edef68
2012-09-21 17:29:33 +00:00
Siddharth Seth
ff7b818432 YARN-82. Correct the fix version in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388340 13f79535-47bb-0310-9956-ffa450edef68
2012-09-21 06:34:06 +00:00
Siddharth Seth
f4c336d547 YARN-82. Change the default local and log dirs to be based on hadoop.tmp.dir and yarn.log.dir. (Contributed by Hemanth Yamijala)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388339 13f79535-47bb-0310-9956-ffa450edef68
2012-09-21 06:28:47 +00:00
Vinod Kumar Vavilapalli
37d5618742 YARN-28. Fixed TestCompositeService to not depend on test-order and thus made it pass on JDK7. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386907 13f79535-47bb-0310-9956-ffa450edef68
2012-09-17 23:30:27 +00:00
Robert Joseph Evans
2526a96aaa YARN-108. FSDownload can create cache directories with the wrong permissions (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386838 13f79535-47bb-0310-9956-ffa450edef68
2012-09-17 21:05:11 +00:00
Aaron Myers
d8e386f01a HADOOP-8755. Print thread dump when tests fail due to timeout. Contributed by Andrey Klochkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384627 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 01:44:23 +00:00
Vinod Kumar Vavilapalli
7c491887e5 YARN-93. Fixed RM to propagate diagnostics from applications that have finished but failed Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384169 13f79535-47bb-0310-9956-ffa450edef68
2012-09-13 00:46:39 +00:00
Vinod Kumar Vavilapalli
11cf00b08a YARN-78. Changed UnManagedAM application to use YarnClient. Contributed by Bikas Saha.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383705 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 00:49:17 +00:00
Arun Murthy
681408f898 Set date for hadoop-2.0.2-alpha
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382199 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 22:39:45 +00:00
Arun Murthy
7851676f22 Preparing for hadoop-2.0.2-alpha release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382191 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 22:09:48 +00:00
Arun Murthy
a1aa1b9349 YARN-57. Allow process-tree based resource calculation et al. to be pluggable to support it on multiple platforms. Contributed by Radim Kolar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382072 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 15:48:39 +00:00
Arun Murthy
56d72dfdf1 YARN-80. Add support for delaying rack-local containers in CapacityScheduler. Contributed by Arun C. Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381872 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 05:10:51 +00:00
Vinod Kumar Vavilapalli
e4679b5caf YARN-75. Missing test. Ugh.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381811 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 00:04:40 +00:00
Vinod Kumar Vavilapalli
e9411ae5e3 YARN-75. Added file missing from previous commit. Bad day with svn.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381809 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 23:55:10 +00:00
Vinod Kumar Vavilapalli
68ad1716b2 YARN-75. Removing spurious file from the previous commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381807 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 23:47:41 +00:00
Vinod Kumar Vavilapalli
3a4e87e813 YARN-75. Modified ResourceManager's RMContainer to handle a valid RELEASE event at RUNNING state. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381806 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 23:46:31 +00:00
Vinod Kumar Vavilapalli
d3224aff28 YARN-15. Fixing CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381801 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 23:36:27 +00:00
Vinod Kumar Vavilapalli
d093dcce45 YARN-15. Updated default classpath for YARN applications to reflect split of YARN into a sub-project. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381794 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 23:06:35 +00:00
Thomas Graves
02c0317eff YARN-87. NM ResourceLocalizationService does not set permissions of local cache directories (Jason Lowe via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381459 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 02:08:37 +00:00
Robert Joseph Evans
726b48f51a YARN-68. NodeManager will refuse to shutdown indefinitely due to container log aggregation (daryn via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381317 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 19:39:53 +00:00
Vinod Kumar Vavilapalli
87c5d243db YARN-83. Change package of YarnClient to org.apache.hadoop. Contributed by Bikas Saha.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381273 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 17:54:32 +00:00
Vinod Kumar Vavilapalli
65b308f783 YARN-42. Modify NM's non-aggregating logs' handler to stop properly so that NMs don't get NPEs on startup errors. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380954 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 02:46:07 +00:00
Vinod Kumar Vavilapalli
ab74b1adde YARN-79. Implement close on all clients to YARN so that RPC clients don't throw exceptions on shut-down. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380942 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 00:14:35 +00:00
Suresh Srinivas
60af999c73 YARN-84. Use Builder to build RPC server. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380921 13f79535-47bb-0310-9956-ffa450edef68
2012-09-04 22:24:04 +00:00
Robert Joseph Evans
f5943c1eef Updated CHANGES.txt for 0.23.4
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380906 13f79535-47bb-0310-9956-ffa450edef68
2012-09-04 21:45:33 +00:00
Vinod Kumar Vavilapalli
b1632b4a77 YARN-10. Fix DistributedShell module to not have a dependency on hadoop-mapreduce-client-core. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380879 13f79535-47bb-0310-9956-ffa450edef68
2012-09-04 20:56:53 +00:00
Robert Joseph Evans
60b8c6e1e1 YARN-66. aggregated logs permissions not set properly (tgraves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379565 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 19:57:34 +00:00
Robert Joseph Evans
27cfde7f4d YARN-60: Fix minor merge conflict (bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379555 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 19:24:31 +00:00
Vinod Kumar Vavilapalli
45a8e8c5a4 YARN-60. Fixed a bug in ResourceManager which causes all NMs to get NPEs and thus causes all containers to be rejected. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379550 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 19:11:05 +00:00
Robert Joseph Evans
d8ce3bee58 YARN-63. RMNodeImpl is missing valid transitions from the UNHEALTHY state (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379498 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 16:33:21 +00:00