big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
10,269 Commits 2 Branches 2 Tags 264 MiB
f222bde273
Commit Graph

1618 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli
0b668c21b2 MAPREDUCE-5234. Change mapred.TaskReport and mapreduce.TaskReport for binary compatibility with mapred in 1.x but incompatible with 0.23.x. Contributed by Mayank Bansal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1483940 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-17 18:16:33 +00:00
Vinod Kumar Vavilapalli
4d8e350750 MAPREDUCE-5232. Add a configuration to be able to log classpath and other system properties on mapreduce JVMs startup. Contributed by Sangjin Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482643 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-14 23:43:53 +00:00
Alejandro Abdelnur
3472800eb6 MAPREDUCE-5244. Two functions changed their visibility in JobStatus. (zjshen via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482622 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-14 22:12:40 +00:00
Vinod Kumar Vavilapalli
febf951220 MAPREDUCE-5222. Bring back some methods and constants in Jobclient for binary compatibility with mapred in 1.x. Contributed by Karthik Kambatla. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482208 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-14 05:52:11 +00:00
Vinod Kumar Vavilapalli
14d856be57 MAPREDUCE-5240. Fix a bug in MRAppMaster because of which OutputCommitter could not access credentials set by the user. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482175 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-14 02:48:53 +00:00
Alejandro Abdelnur
2103c80b77 MAPREDUCE-5220. Setter methods in TaskCompletionEvent are public in MR1 and protected in MR2. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482142 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-13 23:08:10 +00:00
Vinod Kumar Vavilapalli
7359dc32d3 MAPREDUCE-4067. Changed MRClientProtocol api to throw IOException only (Xuan Gong via vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481695 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-13 03:34:25 +00:00
Vinod Kumar Vavilapalli
47d1ca402f MAPREDUCE-5208. Modified ShuffleHandler to use SecureIOUtils for reading local files. Contributed by Omkar Vinit Joshi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481657 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-12 21:59:16 +00:00
Vinod Kumar Vavilapalli
2638bc67a4 YARN-634. Modified YarnRemoteException to be not backed by PB and introduced a separate SerializedException record. Contributed by Siddharth Seth. 
MAPREDUCE-5239. Updated MR App to reflect YarnRemoteException changes after YARN-634. Contributed by Siddharth Seth.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481205 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 21:49:28 +00:00
Alejandro Abdelnur
d303f01297 MAPREDUCE-4942. mapreduce.Job has a bunch of methods that throw InterruptedException so its incompatible with MR1. (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480748 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-09 20:04:32 +00:00
Vinod Kumar Vavilapalli
9c4f86879c YARN-630. Changed AMRMProtocol api to throw IOException and YarnRemoteException. Contributed by Xuan Gong. 
MAPREDUCE-5226. Handling YarnRemoteException separately from IOException in MR App's use of AMRMProtocol after YARN-630. Contributed by Xuan Gong.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480529 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-09 05:32:04 +00:00
Vinod Kumar Vavilapalli
0727ecaf50 YARN-631. Changed ClientRMProtocol api to throw IOException and YarnRemoteException. Contributed by Xuan Gong. 
MAPREDUCE-5212. Handling YarnRemoteException separately from IOException in MR App after YARN-631. Contributed by Xuan Gong.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480494 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-08 22:53:01 +00:00
Vinod Kumar Vavilapalli
e5692ecbe1 Fixing release date for 2.0.4-alpha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480480 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-08 21:57:44 +00:00
Vinod Kumar Vavilapalli
f6167ef6c6 MAPREDUCE-5157. Bring back old sampler related code so that we can support binary compatibility with hadoop-1 sorter example. Contributed by Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480474 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-08 21:42:47 +00:00
Christopher Douglas
67d7d8f4d3 MAPREDUCE-5209. Fix units in a ShuffleScheduler log message. 
Contributed by Tsuyoshi OZAWA


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480464 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-08 21:12:27 +00:00
Vinod Kumar Vavilapalli
8888d3fc49 MAPREDUCE-5159. Change ValueAggregatorJob to add APIs which can support binary compatibility with hadoop-1 examples. Contributed by Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480394 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-08 18:28:22 +00:00
Vinod Kumar Vavilapalli
92b7165a71 YARN-629. Make YarnRemoteException not be rooted at IOException. Contributed by Xuan Gong. 
MAPREDUCE-5204. Handling YarnRemoteException separately from IOException in MR app after YARN-629. Contributed by Xuan Gong.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1479680 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-06 19:04:31 +00:00
Vinod Kumar Vavilapalli
6e37a7e5e1 MAPREDUCE-5205. Fixed MR App to load tokens correctly. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1479016 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-04 00:27:47 +00:00
Thomas White
9b97df9abe MAPREDUCE-5036. Default shuffle handler port should not be 8080. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478422 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-02 15:58:53 +00:00
Aaron Myers
ca2c38fba1 MAPREDUCE-5193. A few MR tests use block sizes which are smaller than the default minimum block size. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478250 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-02 01:59:36 +00:00
Vinod Kumar Vavilapalli
71be8ad325 MAPREDUCE-5145. Changed default max-attempts to be more than one for MR jobs inline with YARN. Contributed by Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477889 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-01 00:42:32 +00:00
Suresh Srinivas
8f7ce62085 MAPREDUCE-5177. Use common utils FileUtil#setReadable/Writable/Executable & FileUtil#canRead/Write/Execute. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477403 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 23:00:39 +00:00
Vinod Kumar Vavilapalli
ae393ab26e MAPREDUCE-5179. Fix unit test in TestHSWebServices which fails when versionInfo has parantheses like when running on a git checkout. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476835 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-28 21:02:25 +00:00
Vinod Kumar Vavilapalli
fbb55784d9 YARN-562. Modified NM to reject any containers allocated by a previous ResourceManager. Contributed by Jian He. 
MAPREDUCE-5167. Update MR App after YARN-562 to use the new builder API for the container. Contributed by Jian He.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476034 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 03:50:20 +00:00
Vinod Kumar Vavilapalli
448df18646 YARN-577. Add application-progress also to ApplicationReport. Contributed by Hitesh Shah. 
MAPREDUCE-5178. Update MR App to set progress in ApplicationReport after YARN-577. Contributed by Hitesh Shah.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1475636 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-25 05:42:22 +00:00
Siddharth Seth
e96077aaf4 MAPREDUCE-5181. RMCommunicator should not use AMToken from the env. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471816 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-25 02:50:16 +00:00
Arun Murthy
daaa73b657 MAPREDUCE-5166. Fix ConcurrentModificationException due to insufficient synchronization on updates to task Counters. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471796 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-25 00:54:04 +00:00
Arun Murthy
40e78c2ca2 MAPREDUCE-4737. Ensure that mapreduce APIs are semantically consistent with mapred API w.r.t Mapper.cleanup and Reducer.cleanup; in the sense that cleanup is now called even if there is an error. The old mapred API already ensures that Mapper.close and Reducer.close are invoked during error handling. Note that it is an incompatible change, however end-users can override Mapper.run and Reducer.run to get the old (inconsistent) behaviour. Contributed by Arun C. Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471556 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-24 17:38:43 +00:00
Robert Joseph Evans
0777474cc2 MAPREDUCE-5069. add concrete common implementations of CombineFileInputFormat (Sangjin Lee via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471424 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-24 14:11:50 +00:00
Vinod Kumar Vavilapalli
27e8c86999 YARN-561. Modified NodeManager to set key information into the environment of every container that it launches. Contributed by Xuan Gong. 
MAPREDUCE-5175. Updated MR App to not set envs that will be set by NMs anyways after YARN-561. Contributed by Xuan Gong.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471156 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-23 21:39:51 +00:00
Thomas White
009af54d51 MAPREDUCE-5146. application classloader may be used too early to load classes. Contributed by Sangjin Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470694 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-22 20:07:06 +00:00
Arun Murthy
794f9bb3e4 MAPREDUCE-5066. Added a timeout for the job.end.notification.url. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470216 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-20 19:18:24 +00:00
Thomas Graves
febc52be37 MAPREDUCE-5147. Maven build should create hadoop-mapreduce-client-app-VERSION.jar directly (Robert Parker via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470035 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-19 20:50:48 +00:00
Bikas Saha
c1ce3c5ad2 MAPREDUCE-4987. TestMRJobs#testDistributedCache fails on Windows due to classpath problems and unexpected behavior of symlinks (Chris Nauroth via bikas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470003 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-19 19:32:33 +00:00
Vinod Kumar Vavilapalli
8e1c2823fc YARN-441. Removed unused utility methods for collections from two API records. Contributed by Xuan Gong. 
MAPREDUCE-5163. Update MR App to not use API utility methods for collections after YARN-441. Contributed by Xuan Gong.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469657 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-19 01:33:13 +00:00
Alejandro Abdelnur
e222d1e783 MAPREDUCE-4932. mapreduce.job#getTaskCompletionEvents incompatible with Hadoop 1. (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469587 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-18 21:42:03 +00:00
Vinod Kumar Vavilapalli
cb78a65a15 MAPREDUCE-5152. Make MR App to simply pass through the container from RM instead of extracting and populating information itself to start any container. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469544 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-18 20:13:40 +00:00
Alejandro Abdelnur
d12c463121 MAPREDUCE-4898. FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1. (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469523 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-18 18:51:45 +00:00
Alejandro Abdelnur
cd27afa71a MAPREDUCE-5128. mapred-default.xml is missing a bunch of history server configs. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469095 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-17 23:14:34 +00:00
Bikas Saha
9e650d36b7 MAPREDUCE-5140. MR part of YARN-514 (Zhijie Shen via bikas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469060 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-17 20:25:21 +00:00
Kihwal Lee
2e789dd9a6 MAPREDUCE-5065. DistCp should skip checksum comparisons if block-sizes are different on source/target. Contributed by Mithun Radhakrishnan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468629 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-16 22:01:18 +00:00
Thomas Graves
9ea20fc537 MAPREDUCE-5015. Coverage fix for org.apache.hadoop.mapreduce.tools.CLI (Aleksey Gorshkov via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468483 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-16 16:11:35 +00:00
Vinod Kumar Vavilapalli
0e01f26821 YARN-444. Moved special container exit codes from YarnConfiguration to API where they belong. Contributed by Sandy Ryza. 
MAPREDUCE-5151. Updated MR AM to use standard exit codes from the API after YARN-444. Contributed by Sandy Ryza.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468276 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-15 23:54:09 +00:00
Robert Joseph Evans
947e97f354 MAPREDUCE-4974. Optimising the LineRecordReader initialize() method (Gelesh via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468232 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-15 21:33:47 +00:00
Bikas Saha
41c4cd08a0 MAPREDUCE-4885. Streaming tests have multiple failures on Windows. (Chris Nauroth via bikas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467158 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-12 03:00:29 +00:00
Konstantin Shvachko
8e838bd03c MAPREDUCE-4985. Add compression option to TestDFSIO usage. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467145 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-11 23:49:16 +00:00
Vinod Kumar Vavilapalli
3c8bd60616 MAPREDUCE-5094. Disabled memory monitoring by default in MiniMRYarnCluster to avoid some downstream tests failing. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467124 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-11 22:54:02 +00:00
Vinod Kumar Vavilapalli
5fd460e688 MAPREUDUCE-5059. Change average merge time on Job overview page to be the time delta between the end of the shuffle and the start of the reduce. Contributed by Omkar Vinit Joshi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467120 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-11 22:27:45 +00:00
Konstantin Shvachko
21c14c0b02 MAPREDUCE-4981. Add WordMean, WordMedian, WordStandardDeviation to ExamplesDriver. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467076 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-11 20:28:30 +00:00
Thomas Graves
6d9c311840 Preparing for release 0.23.7 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467069 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-11 20:08:00 +00:00
Vinod Kumar Vavilapalli
e4c55e17fe YARN-486. Changed NM's startContainer API to accept Container record given by RM as a direct parameter instead of as part of the ContainerLaunchContext record. Contributed by Xuan Gong. 
MAPREDUCE-5139. Update MR AM to use the modified startContainer API after YARN-486. Contributed by Xuan Gong.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467063 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-11 19:28:51 +00:00
Jason Darrell Lowe
8e86ffd91e MAPREDUCE-5136. TestJobImpl->testJobNoTasks fails with IBM JAVA. Contributed by Amir Sanjar 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467061 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-11 19:12:59 +00:00
Jason Darrell Lowe
d04e65b797 MAPREDUCE-5137. AM web UI: clicking on Map Task results in 500 error. Contributed by Thomas Graves 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466948 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-11 16:27:24 +00:00
Siddharth Seth
972eb9bbfe Additional fixes to CHANGES.txt to move jiras under the correct 2.x revision. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466778 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-11 07:21:43 +00:00
Siddharth Seth
9e2a96a2ac Undo the unnecessary changes to CHANGES.txt included in git-revision 06b93c7 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466777 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-11 07:21:00 +00:00
Siddharth Seth
6a1c41111e MAPREDUCE-5079. Changes job recovery to restore state directly from job history, instaed of simulating state machine events. Contributed by Jason Lowe and Robert Parker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466767 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-11 04:52:38 +00:00
Vinod Kumar Vavilapalli
3a54a5653b YARN-112. Fixed a race condition during localization that fails containers. Contributed by Omkar Vinit Joshi. 
MAPREDUCE-5138. Fix LocalDistributedCacheManager after YARN-112. Contributed by Omkar Vinit Joshi.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466196 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-09 19:56:10 +00:00
Arun Murthy
7f13207ed1 MAPREDUCE-5129. Allow tags to JobHistory for deeper analytics. Contributed by Billie Rinaldi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465188 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-06 05:30:56 +00:00
Thomas Graves
a5734cd38a MAPREDUCE-5007. fix coverage org.apache.hadoop.mapreduce.v2.hs (Aleksey Gorshkov via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465017 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-05 15:43:53 +00:00
Jason Darrell Lowe
fc75d3f3dc MAPREDUCE-5086. MR app master deletes staging dir when sent a reboot command from the RM. Contributed by Jian He 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464255 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-04 01:56:49 +00:00
Alejandro Abdelnur
070916130a MAPREDUCE-5098. Fix findbugs warnings in gridmix. (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464209 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-03 21:22:02 +00:00
Konstantin Boudnik
d18cc69d4e MAPREDUCE-5088. MR Client gets an renewer token exception while Oozie is submitting a job (daryn) 
merge -c1463804 from branch-2.0.4-alpha



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464153 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-03 18:45:15 +00:00
Vinod Kumar Vavilapalli
38678cc3d9 MAPREDUCE-5117. Changed MRClientProtocolPBClientImpl to be closeable and thus fix failures in renewal of HistoryServer's delegations tokens. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463828 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-03 05:37:10 +00:00
Thomas Graves
75ef1b4845 MAPREDUCE-4991. coverage for gridmix (Aleksey Gorshkov via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463806 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-03 01:45:24 +00:00
Robert Joseph Evans
6f0c4dca74 Reverted MAPREDUCE-4974 because of test failures. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463359 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-02 02:13:18 +00:00
Alejandro Abdelnur
806073867e MAPREDUCE-5113. Streaming input/output types are ignored with java mapper/reducer. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463307 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-01 21:42:12 +00:00
Robert Joseph Evans
b55756dd03 MAPREDUCE-4974. Optimising the LineRecordReader initialize() method (Gelesh via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463221 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-01 17:45:07 +00:00
Thomas White
375584ae0f MAPREDUCE-5006. Fix failing streaming tests due to MAPREDUCE-4994. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461541 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-27 11:47:06 +00:00
Siddharth Seth
d41e67b966 MAPREDUCE-5077. Remove mapreduce.util.ResourceCalculatorPlugin and related code. Contributed by Karthik Kambatla. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461251 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-26 18:15:40 +00:00
Robert Joseph Evans
a0a844222d MAPREDUCE-4875. coverage fixing for org.apache.hadoop.mapred (Aleksey Gorshkov via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461146 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-26 14:16:13 +00:00
Vinod Kumar Vavilapalli
46315a2d91 MAPREDUCE-5062. Fix MR AM to read max-retries from the RM. Contributed by *Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1460923 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-25 22:33:43 +00:00
Hitesh Shah
b8c74a8a25 MAPREDUCE-5083. MiniMRCluster should use a random component when creating an actual cluster. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459932 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-22 19:11:01 +00:00
Amareshwari Sri Ramadasu
6f92ad9868 MAPREDUCE-5014. Extend Distcp to accept a custom CopyListing. Contributed by Srikanth Sundarrajan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459690 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-22 10:09:06 +00:00
Siddharth Seth
cd2c5fab8b MAPREDUCE-3872. Fix an event handling races in ContainerLauncherImpl. (Contributed by Robert Kanter) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459547 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-21 21:55:31 +00:00
Siddharth Seth
6610212dd3 MAPREDUCE-5078. TestMRAppMaster fails on Windows due to mismatched path separators. (Contributed by Chris Nauroth) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459544 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-21 21:44:13 +00:00
Robert Joseph Evans
f7df0cb7df MAPREDUCE-4972. Coverage fixing for org.apache.hadoop.mapreduce.jobhistory (Aleksey Gorshkov via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1458906 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-20 16:05:33 +00:00
Tsz-wo Sze
efe93340ce Move MAPREDUCE-5075 to 2.0.5-beta in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1458749 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-20 10:47:15 +00:00
Tsz-wo Sze
718f0f92a9 MAPREDUCE-5075. DistCp leaks input file handles since ThrottledInputStream does not close the wrapped InputStream. Contributed by Chris Nauroth 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1458741 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-20 10:40:14 +00:00
Alejandro Abdelnur
c19633da5b Reverting MAPREDUCE-5028 (commit 1457918) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1458433 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-19 17:56:29 +00:00
Jonathan Turner Eagles
523d3daac0 MAPREDUCE-5053. java.lang.InternalError from decompression codec cause reducer to fail (Robert Parker via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1458350 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-19 15:45:35 +00:00
Alejandro Abdelnur
53e7aaa6dd MAPREDUCE-5028. Maps fail when io.sort.mb is set to high value. (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457918 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-18 18:56:40 +00:00
Alejandro Abdelnur
5ac6abe107 MAPREDUCE-4990. Construct debug strings conditionally in ShuffleHandler.Shuffle#sendMapOutput(). (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457914 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-18 18:45:55 +00:00
Robert Joseph Evans
7d7553c4eb MAPREDUCE-5042. Reducer unable to fetch for a map task that was recovered (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457119 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-15 21:09:25 +00:00
Alejandro Abdelnur
8c8ff3f5e0 MAPREDUCE-4716. TestHsWebServicesJobsQuery.testJobsQueryStateInvalid fails with jdk7. (tgraves via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457065 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-15 18:55:22 +00:00
Alejandro Abdelnur
d412a1a1a8 MAPREDUCE-4571. TestHsWebServicesJobs fails on jdk7. (tgraves via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457061 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-15 18:50:51 +00:00
Jason Darrell Lowe
57803245ec MAPREDUCE-5060. Fetch failures that time out only count against the first map task. Contributed by Robert Joseph Evans 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455740 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-12 22:51:28 +00:00
Thomas Graves
7122cb5bf4 MAPREDUCE-5023. History Server Web Services missing Job Counters (Ravi Prakash via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454156 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 23:02:28 +00:00
Arun Murthy
80c2cf57fd Preparing for bug-fix 2.0.4-alpha release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453886 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 14:21:40 +00:00
Suresh Srinivas
6942fd1db5 HADOOP-9372. Fix bad timeout annotations on tests. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453637 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 01:09:53 +00:00
Suresh Srinivas
50d136f9c9 HADOOP-9373. Merge CHANGES.branch-trunk-win.txt to CHANGES.txt. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453599 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 22:37:42 +00:00
Arun Murthy
df68c56267 MAPREDUCE-3685. Fix bugs in MergeManager to ensure compression codec is appropriately used and that on-disk segments are correctly sorted on file-size. Contributed by Anty Rao and Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453365 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 15:02:45 +00:00
Jonathan Turner Eagles
e1062b8b78 MAPREDUCE-5027. Shuffle does not limit number of outstanding connections (Robert Parker via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453098 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 00:03:41 +00:00
Robert Joseph Evans
ec13f1eb3a MAPREDUCE-5043. Fetch failure processing can cause AM event queue to backup and eventually OOM (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452372 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-04 16:32:18 +00:00
Jonathan Turner Eagles
38c4e17ec1 MAPREDUCE-4794. DefaultSpeculator generates error messages on normal shutdown (Jason Lowe via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451826 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-02 03:30:58 +00:00
Alejandro Abdelnur
5d6eca08bd MAPREDUCE-4896. mapred queue -info spits out ugly exception when queue does not exist. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451452 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-01 01:28:18 +00:00
Jonathan Turner Eagles
892846dc04 MAPREDUCE-4871. AM uses mapreduce.jobtracker.split.metainfo.maxsize but mapred-default has mapreduce.job.split.metainfo.maxsize (Jason Lowe via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451318 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-28 19:55:10 +00:00
Siddharth Seth
979fb054f8 MAPREDUCE-4693. Historyserver should provide counters for failed tasks. Contributed by Xuan Gong. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450956 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-27 21:03:19 +00:00
Vinod Kumar Vavilapalli
0b9ed2364a MAPREDUCE-4892. Modify CombineFileInputFormat to not skew input slits' allocation on small clusters. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450912 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-27 18:49:37 +00:00
Thomas White
14089f1e57 MAPREDUCE-5008. Merger progress miscounts with respect to EOF_MARKER. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450723 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-27 10:40:00 +00:00
Aaron Myers
42e987f11e MAPREDUCE-5033. mapred shell script should respect usage flags (--help -help -h). Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450584 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-27 02:42:38 +00:00
Thomas White
0b73dde6ce MAPREDUCE-4951. Container preemption interpreted as task failure. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448615 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 11:56:08 +00:00
Thomas White
87035a004c MAPREDUCE-5013. mapred.JobStatus compatibility: MR2 missing constructors from MR1. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448602 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 11:42:48 +00:00
Thomas White
7555b4df74 MAPREDUCE-4846. Some JobQueueInfo methods are public in MR1 but protected in MR2. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448597 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 11:34:09 +00:00
Jonathan Turner Eagles
c8f35bc3d2 MAPREDUCE-5009. Killing the Task Attempt slated for commit does not clear the value from the Task commitAttempt member (Robert Parker via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1447965 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-19 23:35:56 +00:00
Suresh Srinivas
1c49e77998 MAPREDUCE-5012. Typo in javadoc for IdentityMapper class. Contributed by Adam Monsen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1447865 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-19 18:45:22 +00:00
Alejandro Abdelnur
ab330b33bb MAPREDUCE-4994. Addendum fixing testcases failures. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1446042 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-14 04:22:04 +00:00
Siddharth Seth
43204f0c83 MAPREDUCE-5000. Fixes getCounters when speculating by fixing the selection of the best attempt for a task. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445871 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-13 19:20:31 +00:00
Jason Darrell Lowe
390d1fbef8 MAPREDUCE-4992. AM hangs in RecoveryService when recovering tasks with speculative attempts. Contributed by Robert Parker 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445456 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-13 02:11:36 +00:00
Jason Darrell Lowe
c2d6407070 MAPREDUCE-4989. JSONify DataTables input data for Attempts page. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445448 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-13 01:15:48 +00:00
Alejandro Abdelnur
7e615c7f75 MAPREDUCE-4994. -jt generic command line option does not work. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445330 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-12 20:16:08 +00:00
Siddharth Seth
35832053bf MAPREDUCE-4671. AM does not tell the RM about container requests which are no longer needed. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443323 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-07 07:07:11 +00:00
Jason Darrell Lowe
ea94b7b9dd MAPREDUCE-4822. Unnecessary conversions in History Events. Contributed by Chu Tong 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443257 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-06 22:47:10 +00:00
Alejandro Abdelnur
17e72be6d8 MAPREDUCE-4977. Documentation for pluggable shuffle and pluggable sort. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443168 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-06 19:52:25 +00:00
Robert Joseph Evans
79b12f6f4c MAPREDUCE-4905. test org.apache.hadoop.mapred.pipes (Aleksey Gorshkov via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443027 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-06 15:50:23 +00:00
Arun Murthy
7cc2050041 Preparing for hadoop-2.0.3-alpha release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442959 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-06 13:31:52 +00:00
Aaron Myers
bdb5342b2d MAPREDUCE-4953. HadoopPipes misuses fprintf. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442471 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-05 04:53:32 +00:00
Siddharth Seth
a04bee4567 MAPREDUCE-4971. Minor extensibility enhancements to Counters & FileOutputFormat. Contributed by Arun C Murthy 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441670 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-02 00:47:58 +00:00
Suresh Srinivas
ac21e15a39 MAPREDUCE-4969. TestKeyValueTextInputFormat test fails with Open JDK 7. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441069 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 17:11:36 +00:00
Vinod Kumar Vavilapalli
28c308d5e8 MAPREDUCE-4893. Fixed MR ApplicationMaster to do optimal assignment of containers to get maximum locality. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440749 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 00:28:10 +00:00
Alejandro Abdelnur
0f430e53fd MAPREDUCE-2264. Job status exceeds 100% in some cases. (devaraj.k and sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440076 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 19:38:40 +00:00
Siddharth Seth
c163dc2fce MAPREDUCE-4838. Add additional fields like Locality, Avataar to the JobHistory logs. Contributed by Zhijie Shen 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439714 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 00:21:58 +00:00
Siddharth Seth
8a5fadc5a0 MAPREDUCE-4803. Remove duplicate copy of TestIndexCache. Contributed by Mariappan Asokan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439590 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-28 19:18:35 +00:00
Alejandro Abdelnur
da4cab1099 Revering MAPREDUCE-2264 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439561 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-28 18:58:34 +00:00
Alejandro Abdelnur
759a3fae86 Amending MR CHANGES.txt to reflect that MAPREDUCE-4049/4809/4807/4808 are in branch-2 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438799 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-26 00:44:56 +00:00
Alejandro Abdelnur
539153a679 MAPREDUCE-2264. Job status exceeds 100% in some cases. (devaraj.k and sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438277 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-25 00:25:59 +00:00
Siddharth Seth
74ffc7a74d MAPREDUCE-4946. Fix a performance problem for large jobs by reducing the number of map completion event type conversions. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437103 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-22 19:07:08 +00:00
Alejandro Abdelnur
bb81a17e0b MAPREDUCE-4949. Enable multiple pi jobs to run in parallel. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437029 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-22 16:26:29 +00:00
Alejandro Abdelnur
73fd247c76 MAPREDUCE-4808. Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations. (masokan via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1436936 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-22 14:10:42 +00:00
Jonathan Turner Eagles
88c7fdd065 MAPREDUCE-4458. Warn if java.library.path is used for AM or Task (Robert Parker via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435386 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-18 22:41:19 +00:00
Siddharth Seth
76f9af4ccf MAPREDUCE-4948. Fix a failing unit test - TestYARNRunner.testHistoryServerToken. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435312 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-18 19:30:00 +00:00
Alejandro Abdelnur
1c308188bb MAPREDUCE-4923. Add toString method to TaggedInputSplit. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434993 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-18 00:40:58 +00:00
Thomas Graves
f266efcd10 Preparing for release 0.23.6 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434030 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-16 16:43:12 +00:00
Alejandro Abdelnur
26275e5323 MAPREDUCE-4924. flakey test: org.apache.hadoop.mapred.TestClusterMRNotification.testMR. (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433753 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-16 00:08:25 +00:00
Jason Darrell Lowe
dd6aa0cf12 MAPREDUCE-4936. JobImpl uber checks for cpu are wrong. Contributed by Arun C Murthy 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433445 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 14:45:08 +00:00
Harsh J
d9a21df34b MAPREDUCE-4925. The pentomino option parser may be buggy. Contributed by Karthik Kambatla. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433414 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 13:53:18 +00:00
Harsh J
0b9a1f908a Moving MAPREDUCE-4678's changes line to 0.23 section to prepare for backport. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433409 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 13:36:45 +00:00
Suresh Srinivas
86825d8390 MAPREDUCE-4938. Use token request messages defined in hadoop common. Contributed by Suresh Srinvias. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433227 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:11:16 +00:00
Thomas Graves
e7aeb9d129 MAPREDUCE-4934. Maven RAT plugin is not checking all source files (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432932 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 14:35:45 +00:00
Robert Joseph Evans
12293f8a13 MAPREDUCE-4921. JobClient should acquire HS token with RM principal (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432230 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 19:00:51 +00:00
Alejandro Abdelnur
59d9d8bca9 MAPREDUCE-4907. TrackerDistributedCacheManager issues too many getFileStatus calls. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431166 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-10 00:50:03 +00:00
Jason Darrell Lowe
b16dfc125d MAPREDUCE-4848. TaskAttemptContext cast error during AM recovery. Contributed by Jerry Chen 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431131 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 22:56:09 +00:00
Thomas White
0ba7078ef4 MAPREDUCE-1700. User supplied dependencies may conflict with MapReduce system JARs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430929 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 16:12:58 +00:00
Vinod Kumar Vavilapalli
5f7d4d2b45 MAPREDUCE-4810. Added new admin command options for MR AM. Contributed by Jerry Chen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430707 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 06:31:36 +00:00
Arun Murthy
2c5c8fdb80 MAPREDUCE-4520. Added support for MapReduce applications to request for CPU cores along-with memory post YARN-2. Contributed by Arun C. Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430688 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 05:28:40 +00:00
Thomas White
0f1f5491bc MAPREDUCE-4278. Cannot run two local jobs in parallel from the same gateway. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430363 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 16:26:33 +00:00
Vinod Kumar Vavilapalli
b8a7a17191 MAPREDUCE-4920. Use security token protobuf definition from hadoop common. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429751 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-07 11:13:26 +00:00
Thomas Graves
bbc426f53a MAPREDUCE-4913. TestMRAppMaster#testMRAppMasterMissingStaging occasionally exits (Jason Lowe via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429371 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-05 20:07:24 +00:00
Robert Joseph Evans
64e4fb983e MAPREDUCE-4819. AM can rerun job after reporting final job status to the client (bobby and Bikas Saha via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429114 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 20:35:56 +00:00
Thomas Graves
e17cecf550 MAPREDUCE-4894. Renewal / cancellation of JobHistory tokens (Siddharth Seth via tgraves 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429086 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 20:15:43 +00:00
Jason Darrell Lowe
78ab699fe9 MAPREDUCE-4832. MR AM can get in a split brain situation. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429040 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 19:15:21 +00:00
Robert Joseph Evans
e229e25cc3 MAPREDUCE-4279. getClusterStatus() fails with null pointer exception when running jobs in local mode (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428482 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 17:09:18 +00:00
Suresh Srinivas
1f41061132 MAPREDUCE-4884. Streaming tests fail to start MiniMRCluster due to missing queue configuration. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1427945 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-02 19:31:11 +00:00
Robert Joseph Evans
402eb18513 MAPREDUCE-4813. AM timing out during job commit (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1426536 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-28 15:01:46 +00:00
Jason Darrell Lowe
a7d444d002 MAPREDUCE-4902. Fix typo "receievd" should be "received" in log output. Contributed by Albert Chu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1426018 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-26 20:47:39 +00:00
Vinod Kumar Vavilapalli
dae6f0b7d9 MAPREDUCE-4899. Implemented a MR specific plugin for tracking finished applications that YARN's ResourceManager doesn't keep track off anymore. Contributed by Derek Dagit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425225 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-22 01:47:51 +00:00
Jason Darrell Lowe
04db3ce177 MAPREDUCE-4890. Invalid TaskImpl state transitions when task fails while speculating. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425223 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-22 01:41:26 +00:00
Luke Lu
02e940d6a4 MAPREDUCE-4272. SortedRanges.Range#compareTo was not spec compliant. (Yu Gao via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425180 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-21 23:10:52 +00:00
Jason Darrell Lowe
40c3b7f0b2 MAPREDUCE-4793. Problem with adding resources when using both -files and -file to hadoop streaming. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425177 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-21 23:05:54 +00:00
Jason Darrell Lowe
92692c863c MAPREDUCE-4833. Task can get stuck in FAIL_CONTAINER_CLEANUP. Contributed by Robert Parker 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425167 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-21 22:27:54 +00:00
Jason Darrell Lowe
92774331cc MAPREDUCE-4842. Shuffle race can hang reducer. Contributed by Mariappan Asokan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425071 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-21 18:24:25 +00:00
Doug Cutting
aa30056d09 MAPREDUCE-4887. Add RehashPartitioner, to smooth distributions with poor implementations of Object#hashCode(). Contributed by Radim Kolar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424158 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-19 21:50:17 +00:00
Thomas White
9189917be5 MAPREDUCE-4845. ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423470 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-18 15:23:49 +00:00
Alejandro Abdelnur
8329fae686 MAPREDUCE-4807. Allow MapOutputBuffer to be pluggable. (masokan via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422345 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-15 20:23:08 +00:00
Alejandro Abdelnur
803e5155d1 MAPREDUCE-4809. Change visibility of classes for pluggable sort changes. (masokan via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422341 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-15 20:18:23 +00:00
Thomas White
4993314895 MAPREDUCE-4856. TestJobOutputCommitter uses same directory as TestJobCleanup. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420634 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 12:12:10 +00:00
Alejandro Abdelnur
c5080ef336 MAPREDUCE-4861. Cleanup: Remove unused mapreduce.security.token.DelegationTokenRenewal. (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420345 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-11 19:26:57 +00:00
Alejandro Abdelnur
054270cc28 MAPREDUCE-4703. Add the ability to start the MiniMRClientCluster using the configurations used before it is being stopped. (ahmed.radwan via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419618 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 18:07:20 +00:00
Arun Murthy
b096f61fe2 MAPREDUCE-4049. Experimental api to allow for alternate shuffle plugins. Contributed by Anver BenHanoch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418173 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 02:36:33 +00:00
Jonathan Turner Eagles
fdcfef0a26 MAPREDUCE-4836. Elapsed time for running tasks on AM web UI tasks page is 0. (Ravi Prakash via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415860 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 21:43:43 +00:00
Thomas Graves
5caef48947 MAPREDUCE-4817. Hardcoded task ping timeout kills tasks localizing large amounts of data (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414873 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-28 19:19:16 +00:00
Robert Joseph Evans
b43deb9af8 MAPREDUCE-4825. JobImpl.finished doesn't expect ERROR as a final job state (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414840 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-28 17:52:45 +00:00
Robert Joseph Evans
481f451ca2 MAPREDUCE-4764. repair TestBinaryTokenFile (Ivan A. Veselovsky via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413739 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-26 17:37:05 +00:00
Jason Darrell Lowe
6c5f37e46d MAPREDUCE-4811. JobHistoryServer should show when it was started in WebUI About page. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412377 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-22 00:05:26 +00:00
Alejandro Abdelnur
0f0caede29 MAPREDUCE-4800. Cleanup o.a.h.mapred.MapTaskStatus - remove unused code. (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410700 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-17 06:08:06 +00:00
Robert Joseph Evans
d2b9a604bd MAPREDUCE-4802. Takes a long time to load the task list on the AM for large jobs (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410498 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-16 17:30:22 +00:00
Robert Joseph Evans
f13da263bf MAPREDUCE-4801. ShuffleHandler can generate large logs due to prematurely closed channels (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410131 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-16 00:52:43 +00:00
Robert Joseph Evans
d158daecb5 Updated CHANGES.txt in preparation for 0.23.5 release 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409818 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 14:57:23 +00:00
Eli Collins
905b17876c MAPREDUCE-4723. Fix warnings found by findbugs 2. Contributed by Sandy Ryza 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409601 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 00:16:35 +00:00
Robert Joseph Evans
7e2ecffd88 MAPREDUCE-4720. Browser thinks History Server main page JS is taking too long (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409580 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 00:01:07 +00:00
Robert Joseph Evans
316c23dd7e MAPREDUCE-4797. LocalContainerAllocator can loop forever trying to contact the RM (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409525 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 23:02:29 +00:00
Thomas Graves
b2f7a66e50 MAPREDUCE-4517. Too many INFO messages written out during AM to RM heartbeat (Jason Lowe via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409032 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 23:47:57 +00:00
Robert Joseph Evans
cf6ab9b2e7 MAPREDUCE-4786. Job End Notification retry interval is 5 milliseconds by default (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408444 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 20:32:04 +00:00
Robert Joseph Evans
c493d06b1b MAPREDUCE-4425. Speculation + Fetch failures can lead to a hung job (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408360 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 17:15:45 +00:00
Robert Joseph Evans
1a45b7e357 MAPREDUCE-4787. TestJobMonitorAndPrint is broken (Rob Parker via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408355 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 17:06:07 +00:00
Robert Joseph Evans
dd72ca3536 MAPREDUCE-4751. AM stuck in KILL_WAIT for days (vinodkv via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408314 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 15:15:52 +00:00
Robert Joseph Evans
7c9778e2c3 MAPREDUCE-4774. JobImpl does not handle asynchronous task events in FAILED state (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407679 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 22:55:57 +00:00
Jonathan Turner Eagles
3ccc76c29b MAPREDUCE-4666. JVM metrics for history server. (jlowe via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407669 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 22:14:06 +00:00
Robert Joseph Evans
ca1c683b47 MAPREDUCE-4266. remove Ant remnants from MR (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407551 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 17:26:40 +00:00
Robert Joseph Evans
1f40b8b4e8 MAPREDUCE-4782. NLineInputFormat skips first line of last InputSplit (Mark Fuhs via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407505 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 15:52:33 +00:00
Robert Joseph Evans
6ee6eb8430 MAPREDUCE-4772. Fetch failures can take way too long for a map to be restarted (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407118 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-08 15:17:34 +00:00
Thomas White
8d483fff2c MAPREDUCE-4777. In TestIFile, testIFileReaderWithCodec relies on testIFileWriterWithCodec. Contributed by Sandy Ryza 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406645 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 14:11:59 +00:00
Robert Joseph Evans
0eadfcfcf5 MAPREDUCE-4771. KeyFieldBasedPartitioner not partitioning properly when configured (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405975 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 21:52:06 +00:00
Robert Joseph Evans
1783f209f0 MAPREDUCE-4763 repair test TestUmbilicalProtocolWithJobToken (Ivan A. Veselovsky via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404988 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-02 15:00:56 +00:00
Jason Darrell Lowe
42d1eaf237 MAPREDUCE-4729. job history UI not showing all job attempts. Contributed by Vinod Kumar Vavilapalli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404817 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-01 22:59:43 +00:00
Robert Joseph Evans
b50a3c5de3 MAPREDUCE-4746. The MR Application Master does not have a config to set environment variables (Rob Parker via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404674 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-01 17:02:52 +00:00
Robert Joseph Evans
50993e9d48 MAPREDUCE-4724. job history web ui applications page should be sorted to display last app first (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404305 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 19:13:03 +00:00
Thomas Graves
aac5c149c7 MAPREDUCE-4752. Reduce MR AM memory usage through String Interning (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404177 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 14:57:12 +00:00
Alejandro Abdelnur
16e21dfe92 MAPREDUCE-1806. CombineFileInputFormat does not work with paths not on default FS. (Gera Shegalov via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403614 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 05:41:59 +00:00
Jason Darrell Lowe
286c171987 MAPREDUCE-4748. Invalid event: T_ATTEMPT_SUCCEEDED at SUCCEEDED. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402658 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 21:02:52 +00:00
Vinod Kumar Vavilapalli
895029b2f2 MAPREDUCE-4730. Fix Reducer's EventFetcher to scale the map-completion requests slowly to avoid HADOOP-8942. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401941 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 01:26:30 +00:00
Jason Darrell Lowe
1e45b1f1fd MAPREDUCE-4741. WARN and ERROR messages logged during normal AM shutdown. Contributed by Vinod Kumar Vavilapalli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401738 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 15:45:35 +00:00
Daryn Sharp
aaa07fc01b Updating credits for MAPREDUCE-4229. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401493 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 21:23:21 +00:00
Siddharth Seth
382b565e8c MAPREDUCE-4637. Handle TaskAttempt diagnostic updates while in the NEW and UNASSIGNED states. (Contributed by Mayank Bansal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401474 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 21:02:22 +00:00
Daryn Sharp
def0b949d4 MAPREDUCE-4229. Intern counter names in the JT (bobby via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401467 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 20:57:36 +00:00
Jason Darrell Lowe
49beea562a MAPREDUCE-4740. only .jars can be added to the Distributed Cache classpath. Contributed by Robert Joseph Evans 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401054 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-22 19:50:23 +00:00
Suresh Srinivas
5be6e234c5 Moved MAPREDUCE-4736 jira from trunk to Release 2.0.3 section 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400314 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 22:08:28 +00:00
Suresh Srinivas
c195ce4d67 MAPREDUCE-4736. Remove obsolete option [-rootDir] from TestDFSIO. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400313 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 22:05:30 +00:00
Vinod Kumar Vavilapalli
1195f844a9 MAPREDUCE-4733. Reducer can fail to make progress during shuffle if too many reducers complete consecutively. Contributed by Jason Lowe via. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400264 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 20:18:46 +00:00
Robert Joseph Evans
a234472d1c MAPREDUCE-4479. Fix parameter order in assertEquals() in TestCombineInputFileFormat.java (Mariappan Asokan via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400192 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 17:51:33 +00:00
Vinod Kumar Vavilapalli
022f7b4a25 MAPREDUCE-4596. Split StateMachine state from states seen by MRClientProtocol for Job, Task and TaskAttempt. Contributed by Siddarth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399976 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 05:57:57 +00:00
Suresh Srinivas
adcf7d10b9 MAPREDUCE-4735. Make arguments in TestDFSIO case insensitive. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399952 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 02:37:59 +00:00
Robert Joseph Evans
c63811790a MAPREDUCE-4721. Task startup time in JHS is same as job startup time. (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399289 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 14:58:08 +00:00
Robert Joseph Evans
0e9f40df97 MAPREDUCE-4521. mapreduce.user.classpath.first incompatibility with 0.20/1.x (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399011 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 22:00:03 +00:00
Suresh Srinivas
94ed14c48c HADOOP-8911. CRLF characters in source and text files. Contributed Raja Aluri. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397432 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 04:35:42 +00:00
Arun Murthy
f174adfc15 MAPREDUCE-4616. Improve javadoc for MultipleOutputs. Contributed by Tony Burton. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397182 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 17:21:45 +00:00
Thomas White
aa934616dd MAPREDUCE-4654. TestDistCp is ignored. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396047 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 14:37:46 +00:00
Harsh J
0aa8188d18 MAPREDUCE-3678. The Map tasks logs should have the value of input split it processed. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396032 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 13:39:26 +00:00
Harsh J
5c3a331040 MAPREDUCE-4574. Fix TotalOrderParitioner to work with non-WritableComparable key types. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395936 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 09:58:21 +00:00
Siddharth Seth
8ac3910ae0 MAPREDUCE-4705. Fix a bug in job history lookup, which makes older jobs inaccessible despite the presence of a valid history file. (Contributed by Jason Lowe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395850 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 03:23:07 +00:00
Robert Joseph Evans
49b20c2ed1 MAPREDUCE-4554. Job Credentials are not transmitted if security is turned off (Benoy Antony via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395769 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 20:50:40 +00:00
Thomas Graves
a047fa9b23 MAPREDUCE-4712. mr-jobhistory-daemon.sh doesn't accept --config (Vinod Kumar Vavilapalli via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395724 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 19:03:43 +00:00
Siddharth Seth
803828b996 MAPREDUCE-4123. Remove the 'mapred groups' command, which is no longer supported. (Contributed by Devaraj K) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393775 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 21:24:55 +00:00
Harsh J
7137503eb7 MAPREDUCE-4695. Fix LocalRunner on trunk after MAPREDUCE-3223 broke it. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392446 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-01 17:10:11 +00:00
Arun Murthy
57807d50bf MAPREDUCE-4681. Fix unit tests broken by HDFS-3910. Contributed by Arun C. Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392075 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-30 17:01:00 +00:00
Robert Joseph Evans
af647bb3ce Preparing for release 0.23.4 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391805 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 14:15:39 +00:00
Robert Joseph Evans
b897d6c35a MAPREDUCE-4689. JobClient.getMapTaskReports on failed job results in NPE (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391679 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-28 22:17:32 +00:00
Jason Darrell Lowe
03b7ad04fa MAPREDUCE-4691. Historyserver can report "Unknown job" after RM says job has completed. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391671 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-28 21:55:45 +00:00
Harsh J
e45b103655 MAPREDUCE-4678. Running the Pentomino example with defaults throws java.lang.NegativeArraySizeException. Contributed by Chris McConnell. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391551 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-28 16:48:01 +00:00
Harsh J
6d77365a83 MAPREDUCE-3223. Remove MR1 configs from mapred-default.xml. Contributed by Todd Lipcon (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391498 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-28 15:08:48 +00:00
Arun Murthy
036530fc12 Reverted MAPREDUCE-4253. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390652 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 18:41:08 +00:00
Thomas Graves
050fd3a117 MAPREDUCE-4647. We should only unjar jobjar if there is a lib directory in it. (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390557 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 15:22:21 +00:00
Harsh J
462ba6a3de MAPREDUCE-4686. hadoop-mapreduce-client-core fails compilation in Eclipse due to missing Avro-generated classes. Contributed by Chris Nauroth. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390446 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 12:52:41 +00:00
Harsh J
2610acf0fb MAPREDUCE-4685. DBCount should not use ACCESS. Contributed by Viji. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390372 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 10:21:17 +00:00
Arun Murthy
1eedee177e MAPREDUCE-4649. Ensure MapReduce JobHistory Daemon doens't assume HADOOP_YARN_HOME and HADOOP_MAPRED_HOME are the same. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390224 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 23:49:09 +00:00
Konstantin Shvachko
33a3efcd18 MAPREDUCE-4651. Benchmarking random reads with DFSIO. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390159 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 21:32:29 +00:00
Konstantin Shvachko
78fa84a08a Move MAPREDUCE-4645 under 0.23.4 release section in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389576 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-24 21:01:05 +00:00
Konstantin Shvachko
b26ed9d6f8 MAPREDUCE-4645. Provide a random seed to Slive to make the sequence of file names deterministic. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389568 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-24 20:54:20 +00:00
Eli Collins
eb547be607 MAPREDUCE-4674. Hadoop examples secondarysort has a typo "secondarysrot" in the usage. Contributed by Robert Justice 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388661 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 20:15:07 +00:00
Vinod Kumar Vavilapalli
229a79bbc3 MAPREDUCE-4646. Fixed MR framework to send diagnostic information correctly to clients in case of failed jobs also. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383709 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 00:59:15 +00:00
Thomas White
c406e65f24 Update CHANGES.txt for MAPREDUCE-4607 commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383423 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 14:06:51 +00:00
Arun Murthy
681408f898 Set date for hadoop-2.0.2-alpha 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382199 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 22:39:45 +00:00
Arun Murthy
7851676f22 Preparing for hadoop-2.0.2-alpha release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382191 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 22:09:48 +00:00
Alejandro Abdelnur
a7998921a7 MAPREDUCE-4642. MiniMRClientClusterFactory should not use job.setJar() (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382093 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 17:05:11 +00:00
Robert Joseph Evans
77805c7ae4 MAPREDUCE-4629. Remove JobHistory.DEBUG_MODE (Karthik Kambatla via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382088 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 16:45:03 +00:00
Arun Murthy
0056914773 MAPREDUCE-4638. MR AM supplies MapReduce jars in classpath rather than rely on YARN. Contributed by Arun C Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381868 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 04:56:32 +00:00
Robert Joseph Evans
09038b741d MAPREDUCE-4641. Exception in commitJob marks job as successful in job history (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381784 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 22:20:15 +00:00
Robert Joseph Evans
5dcb594cb8 MAPREDUCE-4633. history server doesn't set permissions on all subdirs (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381614 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 14:20:43 +00:00
Robert Joseph Evans
f5943c1eef Updated CHANGES.txt for 0.23.4 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380906 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-04 21:45:33 +00:00
Konstantin Shvachko
ab986d7cf6 MAPREDUCE-2786. Add compression option for TestDFSIO. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380310 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-03 18:54:27 +00:00
Jonathan Turner Eagles
94129df354 MAPREDUCE-4604. In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker. (Ravi Prakash via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379617 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 21:25:25 +00:00
Thomas Graves
25e96e455b MAPREDUCE-4611. MR AM dies badly when Node is decommissioned (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379599 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 20:43:46 +00:00
Robert Joseph Evans
63f941d2ad MAPREDUCE-4614. Simplify debugging a job's tokens (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379595 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 20:37:41 +00:00
Robert Joseph Evans
015256524c MAPREDUCE-4612. job summary file permissions not set when its created (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379584 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 20:25:27 +00:00
Vinod Kumar Vavilapalli
65e447cd8b MAPREDUCE-4569. Fixed TestHsWebServicesJobsQuery to pass on JDK7 by not depending on test order. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379146 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 21:02:55 +00:00
Thomas White
2f1a133dcf MAPREDUCE-4610. Support deprecated mapreduce.job.counters.limit property in MR2. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379022 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 17:12:14 +00:00
Thomas White
95af351615 MAPREDUCE-4608. hadoop-mapreduce-client is missing some dependencies. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378873 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 09:57:45 +00:00
Robert Joseph Evans
963d01a0af MAPREDUCE-4600. TestTokenCache.java from MRV1 no longer compiles (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378255 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 18:29:17 +00:00
Vinod Kumar Vavilapalli
cfe25b8828 MAPREDUCE-4579. Split TestTaskAttempt into two so as to pass tests on jdk7. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377943 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 02:03:26 +00:00
Siddharth Seth
24e47ebc18 MAPREDUCE-4580. Change MapReduce to use the yarn-client module. (Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377922 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 00:40:02 +00:00
Alejandro Abdelnur
7b541d619f MAPREDUCE-4408. allow jobs to set a JAR that is in the distributed cached (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377149 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 23:36:55 +00:00
Alejandro Abdelnur
f909a1d4d7 MAPREDUCE-4470. Fix TestCombineFileInputFormat.testForEmptyFile (ikatsov via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376325 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 00:22:14 +00:00
Aaron Myers
0555a2145d MAPREDUCE-4577. HDFS-3672 broke TestCombineFileInputFormat.testMissingBlocks() test. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376297 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 22:43:50 +00:00
Alejandro Abdelnur
dc33a0765c MAPREDUCE-4068. Jars in lib subdirectory of the submittable JAR are not added to the classpath (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376253 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 21:18:34 +00:00
Robert Joseph Evans
ca2dc3e785 MAPREDUCE-4570. ProcfsBasedProcessTree#constructProcessInfo() prints a warning if procfsDir/<pid>/stat is not found. (Ahmed Radwan via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375687 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 17:46:07 +00:00
Robert Joseph Evans
0c2887b617 MAPREDUCE-3506. Calling getPriority on JobInfo after parsing a history log with JobHistoryParser throws a NullPointerException (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375602 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 15:20:21 +00:00
Thomas White
3204b1f450 MAPREDUCE-4562. Support for "FileSystemCounter" legacy counter group name for compatibility reasons is creating incorrect counter name. Contributed by Jarek Jarcec Cecho. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373823 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 13:26:12 +00:00
Alejandro Abdelnur
8fcad7e8e9 MAPREDUCE-4511. Add IFile readahead (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373669 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 23:08:40 +00:00
Thomas Graves
dfad16fed2 MAPREDUCE-4053. Counters group names deprecation is wrong, iterating over group names deprecated names don't show up (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372636 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 21:48:33 +00:00
Robert Joseph Evans
201d0ecb78 MAPREDUCE-3782. teragen terasort jobs fail when using webhdfs:// (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371325 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 17:29:36 +00:00
Alejandro Abdelnur
1799046f7a MAPREDUCE-4484. Incorrect IS_MINI_YARN_CLUSTER property name in YarnConfiguration. (ahmed.radwan via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370120 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 05:15:25 +00:00
Alejandro Abdelnur
c2cac2748e MAPREDUCE-4494. TestFifoScheduler failing with Metrics source QueueMetrics,q0=default already exists. (ahmed.radwan via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370118 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 05:11:22 +00:00
Alejandro Abdelnur
117145f1ad MAPREDUCE-4498. Remove hsqldb jar from Hadoop runtime classpath. (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369906 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-06 18:14:47 +00:00
Jonathan Turner Eagles
72789336b2 MAPREDUCE-4503. Should throw InvalidJobConfException if duplicates found in cacheArchives or cacheFiles (Robert Evans via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369197 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-03 20:29:29 +00:00
Siddharth Seth
3eb0cb27e8 MAPREDUCE-3289. Make use of fadvise in the NM's shuffle handler. (Contributed by Todd Lipcon and Siddharth Seth) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368718 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-02 21:55:37 +00:00
Thomas Graves
28320c5220 MAPREDUCE-4504. SortValidator writes to wrong directory (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368294 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 22:14:13 +00:00
Jonathan Turner Eagles
5938c86352 MAPREDUCE-4234. SortValidator.java is incompatible with multi-user or parallel use (due to a /tmp file with static name) (Robert Evans via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367789 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 21:26:08 +00:00
Robert Joseph Evans
123c4f57d3 MAPREDUCE-4444. nodemanager fails to start when one of the local-dirs is bad (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367783 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 21:08:40 +00:00
Thomas Graves
9d42fb2e8e MAPREDUCE-4457. mr job invalid transition TA_TOO_MANY_FETCH_FAILURE at FAILED (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367771 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 20:52:41 +00:00
Robert Joseph Evans
27eb14c3c3 MAPREDUCE-4483. 2.0 build does not work (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367726 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 19:43:51 +00:00
Robert Joseph Evans
89c59bbe3d MAPREDUCE-4492. Configuring total queue capacity between 100.5 and 99.5 at perticular level is sucessfull (Mayank Bansal via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367719 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 19:34:29 +00:00
Thomas Graves
735b50e8bd MAPREDUCE-4493. Distibuted Cache Compatability Issues (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367713 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 19:20:03 +00:00
Robert Joseph Evans
a37272e0e3 MAPREDUCE-4496. AM logs link is missing user name (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367601 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 15:08:47 +00:00
Thomas Graves
e9bf6c56c5 MAPREDUCE-4456. LocalDistributedCacheManager can get an ArrayIndexOutOfBounds when creating symlinks (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367581 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 14:46:57 +00:00
Thomas Graves
a3e695ab2c MAPREDUCE-4375. Show Configuration Tracability in MR UI (bobby via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367539 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 13:39:41 +00:00
Alejandro Abdelnur
e217a05255 MAPREDUCE-4342. Distributed Cache gives inconsistent result if cache files get deleted from tasktracker. (mayank_bansal via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367352 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 22:56:15 +00:00
Thomas Graves
d87b545165 MAPREDUCE-4423. Potential infinite fetching of map output (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366258 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-27 01:48:09 +00:00
Alejandro Abdelnur
9d16c9354b MAPREDUCE-4417. add support for encrypted shuffle (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365979 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-26 13:23:05 +00:00
Alejandro Abdelnur
515a332912 MAPREDUCE-4465. Update description of yarn.nodemanager.address property. (bowang via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365322 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-24 22:08:27 +00:00
Thomas Graves
cdef12644b MAPREDUCE-4467. IndexCache failures due to missing synchronization (Kihwal Lee via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365240 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-24 19:27:29 +00:00
Arun Murthy
3ef19e9dbd MAPREDUCE-4438. Add a simple, generic client to run 'easy' AMs in YARN. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365185 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-24 17:33:15 +00:00
Robert Joseph Evans
97ed48e035 MAPREDUCE-3893. allow capacity scheduler configs max-apps and max-am-pct per queue (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364764 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-23 19:31:33 +00:00
Alejandro Abdelnur
9c9f29ac7e MAPREDUCE-987. Exposing MiniDFS and MiniMR clusters as a single process command-line. (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364020 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-20 23:19:23 +00:00
Thomas Graves
d45922de2c svn merge --change -1363454 for reverting MAPREDUCE-4423 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363935 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-20 20:18:48 +00:00
Thomas Graves
8e69f883a0 MAPREDUCE-4423. Potential infinite fetching of map output (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363454 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-19 18:19:59 +00:00
Alejandro Abdelnur
12979570be MAPREDUCE-4407. Add hadoop-yarn-server-tests-<version>-tests.jar to hadoop dist package. (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363162 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 22:43:01 +00:00
Robert Joseph Evans
1efd2e1d45 MAPREDUCE-4157. ResourceManager should not kill apps that are well behaved (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363067 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 19:40:36 +00:00
Alejandro Abdelnur
c700642308 MAPREDUCE-4406. Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports. (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362751 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 03:36:46 +00:00
Alejandro Abdelnur
2e00d28f14 MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration. (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362722 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-17 23:31:16 +00:00
Daryn Sharp
e9aa5aac68 MAPREDUCE-4448. Fix NM crash during app cleanup if aggregation didn't init. (Jason Lowe via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362618 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-17 19:32:14 +00:00
Robert Joseph Evans
603418c173 MAPREDUCE-4380. Empty Userlogs directory is getting created under logs directory (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362612 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-17 19:14:33 +00:00
Robert Joseph Evans
8e576570a9 MAPREDUCE-4283. Display tail of aggregated logs by default (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362608 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-17 19:01:42 +00:00
Robert Joseph Evans
177f6feaa1 MAPREDUCE-4449. Incorrect MR_HISTORY_STORAGE property name in JHAdminConfig (Ahmed Radwan via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362495 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-17 13:50:35 +00:00
Arun Murthy
7f2b1eadc1 MAPREDUCE-4440. Changed SchedulerApp and SchedulerNode to be a minimal interface to allow schedulers to maintain their own. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362332 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-17 01:43:03 +00:00
Robert Joseph Evans
e1c5e7dd2b MAPREDUCE-4437. Race in MR ApplicationMaster can cause reducers to never be scheduled (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362209 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 19:11:08 +00:00
Eli Collins
18f1feb64b MAPREDUCE-4447. Remove aop from cruft from the ant build. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362204 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 19:09:33 +00:00
Robert Joseph Evans
612443951b MAPREDUCE-4395. Possible NPE at ClientDistributedCacheManager#determineTimestamps (Bhallamudi via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362052 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 14:19:36 +00:00
Arun Murthy
ae6cc14611 MAPREDUCE-4427. Added an 'unmanaged' mode for AMs so as to ease development of new applications. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361813 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 21:46:07 +00:00
Eli Collins
bf34f62e43 HADOOP-8499. Lower min.user.id to 500 for the tests. Contributed Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361438 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 23:04:21 +00:00
Robert Joseph Evans
17de78a43e MAPREDUCE-4299. Terasort hangs with MR2 FifoScheduler (Tom White via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361397 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 20:53:43 +00:00
Robert Joseph Evans
228736ab51 MAPREDUCE-4419. ./mapred queue -info <queuename> -showJobs displays all the jobs irrespective of <queuename> (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361389 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 20:42:48 +00:00
Alejandro Abdelnur
9dcd317d9b MAPREDUCE-4441. Fix build issue caused by MR-3451 (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361387 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 20:42:00 +00:00
Harsh J
af0e0b1676 MAPREDUCE-4432. Confusing warning message when GenericOptionsParser is not used. Contributed by Gabriel Reid. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361273 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 15:22:15 +00:00
Harsh J
bea60b6c86 Reverting MAPREDUCE-4422 from trunk until all comments are addressed 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361107 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 08:52:03 +00:00
Harsh J
48c1a2bdfc MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration. Contributed by Ahmed Radwan. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361061 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 07:26:54 +00:00
Alejandro Abdelnur
1ef64e64c0 MAPREDUCE-3451. Port Fair Scheduler to MR2 (pwendell via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361020 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 00:43:01 +00:00
Robert Joseph Evans
26910fd058 MAPREDUCE-4416. Some tests fail if Clover is enabled (Kihwal Lee via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360735 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 15:52:12 +00:00
Vinod Kumar Vavilapalli
3bfb26ad3b MAPREDUCE-3940. ContainerTokens should have an expiry interval. Contributed by Siddharth Seth and Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359910 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 21:26:48 +00:00
Robert Joseph Evans
6804ef32fc MAPREDUCE-4252. MR2 job never completes with 1 pending task (Tom White via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359747 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 16:10:14 +00:00
Thomas Graves
11782dd3a5 MAPREDUCE-4300. OOM in AM can turn it into a zombie. (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359399 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 21:08:40 +00:00
Alejandro Abdelnur
820be7cbef MAPREDUCE-3993. Graceful handling of codec errors during decompression (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359345 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 19:19:00 +00:00
Alejandro Abdelnur
1153780655 MAPREDUCE-2739. Update installation docs (remove YarnClientFactory) (bowang via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359303 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 17:40:31 +00:00
Robert Joseph Evans
832ba3bae1 MAPREDUCE-4402. TestFileInputFormat fails intermittently (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359252 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 16:14:24 +00:00
Harsh J
80875153c3 MAPREDUCE-3906. Fix inconsistency in documentation regarding mapreduce.jobhistory.principal. Contributed by Eugene Koontz. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358896 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 02:12:22 +00:00
Harsh J
c3b0bed21e MAPREDUCE-3907. Document entries mapred-default.xml for the jobhistory server. Contributed by Eugene Koontz. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358892 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 02:01:54 +00:00
Harsh J
52a4678a1d MAPREDUCE-2220. Fix new API FileOutputFormat-related typos in mapred-default.xml. Contributed by Rui Kubo. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358788 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-08 17:23:40 +00:00
Robert Joseph Evans
0e7204c9e7 MAPREDUCE-4379. Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358305 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-06 17:19:13 +00:00
Thomas Graves
072292219e MAPREDUCE-4387. RM gets fatal error and exits during TestRM (Kihwal Lee via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358201 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-06 13:38:11 +00:00
Thomas Graves
3d5a44f919 MAPREDUCE-4384. Race conditions in IndexCache (Kihwal Lee via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357937 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-05 21:36:02 +00:00
Robert Joseph Evans
c1bf8a3f03 MAPREDUCE-4392. Counters.makeCompactString() changed behavior from 0.20 (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357776 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-05 18:09:09 +00:00
Alejandro Abdelnur
72fb517469 MAPREDUCE-4355. Add RunningJob.getJobStatus() (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357723 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-05 16:29:09 +00:00
Robert Joseph Evans
eff5abb4f7 MAPREDUCE-4371. Check for cyclic dependencies in Jobcontrol job DAG (madhukara phatak via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356414 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-02 19:02:51 +00:00
Harsh J
e967e98f74 MAPREDUCE-4253. Tests for mapreduce-client-core are lying under mapreduce-client-jobclient. Contributed by Tsuyoshi Ozawa. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355766 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-30 16:49:24 +00:00
Eli Collins
cd9ce99740 MAPREDUCE-4383. HadoopPipes.cc needs to include unistd.h. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355555 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-29 20:57:20 +00:00
Robert Joseph Evans
d1f05ce29f Reverting MAPREDUCE-4371 to address test failures. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355382 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-29 13:41:46 +00:00
Robert Joseph Evans
78c27ca2e3 MAPREDUCE-4371. Check for cyclic dependencies in Jobcontrol job DAG (madhukara phatak via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355139 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 19:59:19 +00:00
Robert Joseph Evans
aad2a6f0fc MAPREDUCE-4376. TestClusterMRNotification times out (Kihwal Lee via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355124 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 19:28:42 +00:00
Alejandro Abdelnur
1b21c9836e Reverting MAPREDUCE-4346 r1353757 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354656 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-27 18:29:42 +00:00
Robert Joseph Evans
bb9ac4fe4c MAPREDUCE-4372. Deadlock in Resource Manager (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354531 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-27 14:28:08 +00:00
Robert Joseph Evans
03f2f9b580 MAPREDUCE-4228. mapreduce.job.reduce.slowstart.completedmaps is not working properly (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354181 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-26 19:17:33 +00:00
Alejandro Abdelnur
d9bbd5997d MAPREDUCE-4355. Add JobStatus getJobStatus(JobID) to JobClient. (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353757 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-25 21:55:44 +00:00
Alejandro Abdelnur
5b36106934 MAPREDUCE-2289. Permissions race can make getStagingDir fail on local filesystem (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353750 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-25 21:36:17 +00:00
Siddharth Seth
75269b5488 MAPREDUCE-4290. Fix Yarn Applicaiton Status to MR JobState conversion. (Contributed by Devaraj K) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353684 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-25 17:54:48 +00:00
Alejandro Abdelnur
db31b6c0e4 MAPREDUCE-4336. Distributed Shell fails when used with the CapacityScheduler (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353625 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-25 15:58:55 +00:00
Siddharth Seth
18052795a7 MAPREDUCE-4031 amendment. Fixes CHANGES.txt to reflect correct fix version. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353039 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-22 21:45:59 +00:00
Siddharth Seth
a945336368 MAPREDUCE-4031. Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353038 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-22 21:40:35 +00:00
Thomas Graves
126dd6adef MAPREDUCE-4295. RM crashes due to DNS issue (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352638 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-21 18:14:22 +00:00
Thomas Graves
b91910dd3e MAPREDUCE-4320. gridmix mainClass wrong in pom.xml (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352550 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-21 15:01:35 +00:00
Ravi Gummadi
b685486fbb MAPREDUCE-4356. [Rumen] Provide access to the method ParsedTask.obtainTaskAttempts(). (ravigummadi) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352415 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-21 05:44:20 +00:00
Robert Joseph Evans
cf5dd32932 MAPREDUCE-3889. job client tries to use /tasklog interface, but that doesn't exist anymore (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352330 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-20 21:22:33 +00:00
Siddharth Seth
daa28cc6ce MAPREDUCE-4306. Fix distributed shell to work with users other than the one running the daemons. (Contributed by Ahmed Radwan) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351876 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-19 22:00:45 +00:00
Siddharth Seth
10bc39ea02 MAPREDUCE-4270. Move the data_join test classes to the correct path. (Contributed by Thomas Graves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351869 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-19 21:51:15 +00:00
Robert Joseph Evans
49feb6a039 MAPREDUCE-4267. mavenize pipes (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351818 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-19 19:40:44 +00:00
Thomas Graves
01b2040810 MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351762 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-19 16:17:21 +00:00
Thomas Graves
01b61c76a8 MAPREDUCE-4311. Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings (Karthik Kambatla via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351700 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-19 13:06:51 +00:00
Scott Chun-Yang Chen
277b3dd736 MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351548 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-19 00:55:28 +00:00
Siddharth Seth
eff9fa1aad MAPREDUCE-3921. MR AM should act on node health status changes. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349065 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-11 23:14:06 +00:00
Thomas White
13ad756796 MAPREDUCE-3871. Allow symlinking in LocalJobRunner DistributedCache. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348997 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-11 20:37:03 +00:00
Thomas Graves
27d1c74a0c MAPREDUCE-3927. Shuffle hang when set map.failures.percent (Bhallamudi Venkata Siva Kamesh via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348846 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-11 13:54:46 +00:00
Thomas Graves
9368be0e73 MAPREDUCE-3842. Stop webpages from automatic refreshing (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348123 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-08 15:47:50 +00:00
Vinod Kumar Vavilapalli
9ae7639405 Fixing CHANGES.txt to refer to branch-2 instead of (an unreleased, not-yet-decided) release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347136 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-06 21:19:33 +00:00
Vinod Kumar Vavilapalli
67cbc289e4 MAPREDUCE-3873. Fixed NodeManagers' decommissioning at RM to accept IP addresses also. Contributed by xieguiming and vinodkv. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346671 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-05 23:52:16 +00:00
Robert Joseph Evans
d6467bb3b1 MAPREDUCE-4313. TestTokenCache doesn't compile due TokenCache.getDelegationToken compilation error (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346406 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-05 15:01:26 +00:00
Eli Collins
119a8c7b15 Updated CHANGES.txt files to reflect the 2.0.0-alpha release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346150 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-04 20:53:15 +00:00
Thomas Graves
358eda0bfa MAPREDUCE-3350. Per-app RM page should have the list of application-attempts like on the app JHS page (Jonathon Eagles via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346047 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-04 17:41:52 +00:00
Thomas Graves
1283ab51a9 MAPREDUCE-4301. Dedupe some strings in MRAM for memory savings (bobby via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346002 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-04 15:14:27 +00:00
Eli Collins
18ba716922 MAPREDUCE-4307. TeraInputFormat calls FileSystem.getDefaultBlockSize() without a Path - Failure when using ViewFileSystem. Contributed by Ahmed Radwan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345546 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-02 18:47:40 +00:00
Robert Joseph Evans
1cf6010675 MAPREDUCE-4302. NM goes down if error encountered during log aggregation (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345362 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-01 21:54:49 +00:00
Robert Joseph Evans
8bbacfaa31 MAPREDUCE-4297. Usersmap file in gridmix should not fail on empty lines (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344763 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-31 15:16:48 +00:00
Robert Joseph Evans
0a80f82a30 MAPREDUCE-4152. map task left hanging after AM dies trying to connect to RM (Tom Graves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344283 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-30 14:48:53 +00:00
Harsh J
515e29ac82 MAPREDUCE-3493. Add the default mapreduce.shuffle.port property to mapred-default.xml. Contributed by Madhukara Phatak. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343804 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-29 16:10:59 +00:00
Thomas White
45be2c085d MAPREDUCE-4146. Support limits on task status string length and number of block locations in branch-2. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343755 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-29 14:43:40 +00:00
Harsh J
fcf47eb4b8 MAPREDUCE-3990. MRBench allows Long-sized input-lines value but parses CLI argument as an Integer. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343247 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-28 13:26:35 +00:00
Harsh J
0037bf5dc5 MAPREDUCE-2384. The job submitter should make sure to validate jobs before creation of necessary files. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343240 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-28 13:14:14 +00:00
Harsh J
2ebb1f47db MAPREDUCE-3302. Remove the last dependency call from org.apache.hadoop.record package in MR. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342613 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 13:21:30 +00:00
Thomas Graves
c4f17d242d MAPREDUCE-4224. TestFifoScheduler throws org.apache.hadoop.metrics2.MetricsException (Devaraj K via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342244 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-24 13:10:57 +00:00
Alejandro Abdelnur
cf7b017422 MAPREDUCE-4276. Allow setting yarn.nodemanager.delete.debug-delay-sec property to -1 for easier container debugging. (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342075 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 22:22:55 +00:00
Thomas Graves
432c4a6ffc MAPREDUCE-4262. NM gives wrong log message saying Connected to ResourceManager before trying to connect. (Devaraj K via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341972 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 18:37:37 +00:00
Thomas Graves
d74bec2f88 MAPREDUCE-3870. Invalid App Metrics (Bhallamudi Venkata Siva Kamesh via tgraves). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341160 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-21 19:15:41 +00:00
Robert Joseph Evans
2eebc21a55 MAPREDUCE-4274 MapOutputBuffer should use native byte order for kvmeta. (todd via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341151 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-21 19:05:19 +00:00
Thomas Graves
d239307d00 MAPREDUCE-4269. documentation: Gridmix has javadoc warnings in StressJobFactory (Jonathon Eagles via tgraves). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340880 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-21 01:55:44 +00:00
Todd Lipcon
a37aa28e4a MAPREDUCE-4002. MultiFileWordCount job fails if the input path is not from default file system. Contributed by Bhallamudi Venkata Siva Kamesh. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340630 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-20 07:41:56 +00:00
Thomas Graves
bacb4080a0 MAPREDUCE-4197. Include the hsqldb jar in the hadoop-mapreduce tar file (Ravi Prakash via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339957 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-18 02:50:48 +00:00
Thomas Graves
dcf84707ab MAPREDUCE-3543. Mavenize Gridmix. (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339629 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 15:06:33 +00:00
Thomas Graves
7e3d016845 MAPREDUCE-4102. job counters not available in Jobhistory webui for killed jobs (Bhallamudi Venkata Siva Kamesh via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339174 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-16 14:08:08 +00:00
Todd Lipcon
9142dcac9e Move changes from 2.0.0-alpha to 2.0.1-alpha in CHANGES.txt for those that did not make rc1 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339019 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-16 05:48:16 +00:00
Alejandro Abdelnur
2eeafa78c9 MAPREDUCE-4250. hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster. (phunt via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339000 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-16 04:15:02 +00:00
Thomas Graves
f35294eb95 MAPREDUCE-4238. mavenize data_join. (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338835 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 19:09:59 +00:00
Robert Joseph Evans
a446ad2c26 MAPREDUCE-4233. NPE can happen in RMNMNodeInfo. (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337363 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 20:26:42 +00:00
Thomas White
aea890f7d2 MAPREDUCE-4148. MapReduce should not have a compile-time dependency on HDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337199 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 15:00:48 +00:00
Robert Joseph Evans
0308423b9c MAPREDUCE-4237. TestNodeStatusUpdater can fail if localhost has a domain associated with it (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336399 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-09 21:08:53 +00:00
Tsz-wo Sze
f6d6218348 MAPREDUCE-4231. Update RAID to use the new BlockCollection interface. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335661 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-08 17:53:15 +00:00
Thomas Graves
0caac704fb MAPREDUCE-4215. RM app page shows 500 error on appid parse error (Jonathon Eagles via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335647 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-08 17:13:33 +00:00
Robert Joseph Evans
67a514b647 MAPREDUCE-3850. Avoid redundant calls for tokens in TokenCache (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335585 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-08 15:25:08 +00:00
Robert Joseph Evans
aa60da6c2e MAPREDUCE-4162. Correctly set token service (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335567 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-08 15:07:40 +00:00
Thomas White
55cd161a35 MAPREDUCE-4226. ConcurrentModificationException in FileSystemCounterGroup. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335197 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-07 19:05:59 +00:00
Robert Joseph Evans
d3599de399 MAPREDUCE-4220. RM apps page starttime/endtime sorts are incorrect (Jonathan Eagles via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335096 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-07 16:18:33 +00:00
Robert Joseph Evans
407cfa3b56 MAPREDUCE-3958. RM: Remove RMNodeState and replace it with NodeState (Bikas Saha via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334043 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 15:47:02 +00:00
Robert Joseph Evans
48f95779c1 MAPREDUCE-4048. NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334013 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 15:02:54 +00:00
Alejandro Abdelnur
0fca4fbaf3 MAPREDUCE-4205. retrofit all JVM shutdown hooks to use ShutdownHookManager (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333748 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 03:20:16 +00:00
Robert Joseph Evans
48414b0827 MAPREDUCE-4163. consistently set the bind address (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333579 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 18:35:21 +00:00
Alejandro Abdelnur
ca5b406ac0 MAPREDUCE-4219. make default container-executor.conf.dir be a path relative to the container-executor binary. (rvs via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333241 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-02 22:53:50 +00:00
Robert Joseph Evans
f8ed2ad524 MAPREDUCE-4210. Expose listener address for WebApp (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333144 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-02 18:27:17 +00:00
Robert Joseph Evans
1c96e52533 MAPREDUCE-3173. MRV2 UI doesn't work properly without internet (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333063 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-02 14:40:01 +00:00
Robert Joseph Evans
6fec13abdd MAPREDUCE-4202. Updating changes to just be branch-2 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332731 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-01 16:14:16 +00:00
Robert Joseph Evans
512fd2756a MAPREDUCE-4202. TestYarnClientProtocolProvider is broken (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332716 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-01 15:59:36 +00:00
Robert Joseph Evans
506232da5c MAPREDUCE-4211. Error conditions (missing appid, appid not found) are masked in the RM app page (Jonathan Eagles via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332701 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-01 15:34:19 +00:00
Thomas Graves
2755a2e283 MAPREDUCE-4212. TestJobClientGetJob sometimes fails (Daryn Sharp via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332665 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-01 14:10:45 +00:00
Thomas Graves
47df4697ba MAPREDUCE-4206. Sorting by Last Health-Update on the RM nodes page sorts does not work correctly (Jonathon Eagles via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332232 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-30 15:07:08 +00:00
Robert Joseph Evans
7407d5cd0f MAPREDUCE-4209. junit dependency in hadoop-mapreduce-client is missing scope test (Radim Kolar via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332226 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-30 14:48:22 +00:00
Thomas Graves
252568085a MAPREDUCE-3883. Document yarn.nodemanager.delete.debug-delay-sec configuration property (Eugene Koontz via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332196 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-30 13:43:09 +00:00
Robert Joseph Evans
1c0231cc74 MAPREDUCE-4189. TestContainerManagerSecurity is failing (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331046 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 19:40:48 +00:00
Thomas White
1a118d6a32 MAPREDUCE-4138. Reduce memory usage of counters due to non-static nested classes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331023 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 18:39:22 +00:00
Robert Joseph Evans
cda16311a9 MAPREDUCE-4169. Container Logs appear in unsorted order (Jonathan Eagles via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331012 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 18:27:05 +00:00
Thomas Graves
e7583d816a MAPREDUCE-3613. web service calls header contains 2 content types (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330560 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 21:13:06 +00:00
Robert Joseph Evans
719b719e3d MAPREDUCE-4194. ConcurrentModificationError in DirectoryCollection (Jonathan Eagles via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330552 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 20:49:41 +00:00
Thomas White
bcfb66ebb2 MAPREDUCE-4193. broken doc link for yarn-default.xml in site.xml. Contributed by Patrick Hunt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330427 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 17:20:00 +00:00
Thomas Graves
f340d6c894 MAPREDUCE-4079. Allow MR AppMaster to limit ephemeral port range.(bobby via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329694 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 13:03:15 +00:00
Alejandro Abdelnur
ebe0e9a99b MAPREDUCE-4141. clover integration broken, also mapreduce poms are pulling in clover as a dependency. (phunt via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329493 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 22:32:06 +00:00
Robert Joseph Evans
80ab78c217 MAPREDUCE-4133. MR over viewfs is broken (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329403 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 19:44:30 +00:00
Robert Joseph Evans
796e1a48ac MAPREDUCE-4190. Improve web UI for task attempts userlog link (Tom Graves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329398 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 19:38:28 +00:00
Sanjay Radia
589c68ae09 HADOOP-8285 Use ProtoBuf for RpcPayLoadHeader (sanjay radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329319 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 16:34:21 +00:00
Robert Joseph Evans
1eb1d0ae4f MAPREDUCE-3812. Lower default allocation sizes, fix allocation configurations and document them (Harsh J via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329282 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 15:26:35 +00:00
Robert Joseph Evans
8d09ab0da2 MAPREDUCE-3947. yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328111 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 20:35:54 +00:00
Alejandro Abdelnur
df654cca49 MAPREDUCE-3867. MiniMRYarn/MiniYarn uses fixed ports (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328109 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 20:33:11 +00:00
Robert Joseph Evans
7d2466c0c8 MAPREDUCE-4129. Lots of unneeded counters log messages (Ahmed Radwan via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328106 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 20:23:47 +00:00
Robert Joseph Evans
d09cf903ab MAPREDUCE-4093. Improve RM WebApp start up when proxy address is not set (Devaraj K vai bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328090 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 19:42:32 +00:00
Robert Joseph Evans
5b35f7df64 MAPREDUCE-4165. Committing is misspelled as commiting in task logs (John Eagles via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328086 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 19:32:16 +00:00
Robert Joseph Evans
e3806060ce MAPREDUCE-4159. Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328031 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 16:22:22 +00:00
Thomas Graves
97ae5b675f MAPREDUCE-4074. Client continuously retries to RM When RM goes down before launching Application Master (xieguiming via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327972 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 14:44:57 +00:00
Amar Kamat
3edc40e377 MAPREDUCE-4100. [Gridmix] Bug fixed in compression emulation feature for map only jobs. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327816 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 04:26:53 +00:00
Robert Joseph Evans
32d511065a MAPREDUCE-4161. create sockets consistently (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327621 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 18:46:34 +00:00
Ravi Gummadi
2ada53f107 MAPREDUCE-4149. [Rumen] Rumen fails to parse certain counter strings. (ravigummadi) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327461 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 11:59:38 +00:00
Siddharth Seth
7d04a96027 MAPREDUCE-3972. Fix locking and exception issues in JobHistory server. (Contributed by Robert Joseph Evans) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327354 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 01:59:16 +00:00
Robert Joseph Evans
a15e69cb9f MAPREDUCE-4134. Remove references of mapred.child.ulimit etc. since they are not being used any more (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327304 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 22:05:42 +00:00
Thomas Graves
ca9f62121e MAPREDUCE-4151. RM scheduler web page should filter apps to those that are relevant to scheduling (Jason Lowe via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327263 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 20:05:44 +00:00
Thomas Graves
b89b6bd75f MAPREDUCE-4160. some mrv1 ant tests fail with timeout - due to 4156 (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327233 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 19:21:34 +00:00
Siddharth Seth
fe7711df98 MAPREDUCE-3942. Randomize master key generation for ApplicationTokenSecretManager and roll it every so often. (Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327220 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 18:48:42 +00:00
Thomas Graves
159646f2a4 MAPREDUCE-4156. ant build fails compiling JobInProgress (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326795 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 20:46:30 +00:00
Thomas Graves
24d6a8b29c MAPREDUCE-4008. ResourceManager throws MetricsException on start up saying QueueMetrics MBean already exists (Devaraj K via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326707 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 18:02:51 +00:00
Siddharth Seth
9a10b4e773 MAPREDUCE-4144. Fix a NPE in the ResourceManager when handling node updates. (Contributed by Jason Lowe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325991 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 22:24:16 +00:00
Robert Joseph Evans
27ea3ab6ba MAPREDUCE-4128. AM Recovery expects all attempts of a completed task to also be completed. (Bikas Saha via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325765 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 13:45:03 +00:00
Thomas White
02db5b7ef7 MAPREDUCE-4147. YARN should not have a compile-time dependency on HDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325573 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 00:10:30 +00:00
Siddharth Seth
ecb30a48c4 MAPREDUCE-4050. For tasks without assigned containers, changes the node text on the UI to N/A instead of a link to null. (Contributed by Bhallamudi Venkata Siva Kamesh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325435 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 18:39:49 +00:00
Thomas White
346d50782d MAPREDUCE-4140. mapreduce classes incorrectly importing "clover.org.apache.*" classes. Contributed by Patrick Hunt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325352 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 16:22:25 +00:00
Amar Kamat
d310c48ce4 MAPREDUCE-4083. [Gridmix] NPE in cpu emulation. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325145 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 07:17:34 +00:00
Thomas Graves
aca6ca0059 MAPREDUCE-4107. Fix tests in org.apache.hadoop.ipc.TestSocketFactory (Devaraj K via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325010 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 21:13:49 +00:00
Siddharth Seth
7809acd67b MAPREDUCE-3932. Fix the TaskAttempt state machine to handle CONTIANER_LAUNCHED and CONTIANER_LAUNCH_FAILED events in additional states. (Contributed by Robert Joseph Evans) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324902 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 18:18:40 +00:00
Siddharth Seth
cfafd8c29d MAPREDUCE-4099 amendment. ApplicationMaster will remove staging directory after the history service is stopped. (Contributed by Jason Lowe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324866 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 17:09:54 +00:00
Siddharth Seth
13bfe4794b MAPREDUCE-4040. History links should use hostname rather than IP address. (Contributed by Bhallamudi Venkata Siva Kamesh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312076 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 02:50:02 +00:00
Thomas Graves
94843b848a MAPREDUCE-4108. Fix tests in org.apache.hadoop.util.TestRunJar (Devaraj K via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312018 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 22:09:00 +00:00
Robert Joseph Evans
eb74ff0c3b MAPREDUCE-4076. Stream job fails with ZipException when use yarn jar command (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312003 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 21:30:05 +00:00
Robert Joseph Evans
2accda38a1 MAPREDUCE-4017. Add jobname to jobsummary log (tgraves and Koji Noguchi via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311972 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 20:36:09 +00:00
Tsz-wo Sze
d9b740cb14 MAPREDUCE-4057. Update RAID for the HA and fsdataset changes. Contributed by Devaraj K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311959 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 19:46:44 +00:00
Robert Joseph Evans
793746870b MAPREDUCE-4099. ApplicationMaster may fail to remove staging directory (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311926 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 18:57:34 +00:00
Thomas Graves
cbb5f61090 MAPREDUCE-4059. The history server should have a separate pluggable storage/query interface. (Robert Evans via tgraves). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311896 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 18:11:26 +00:00
Siddharth Seth
b28f134e9c MAPREDUCE-3869. Fix classpath for DistributedShell application. (Contributed by Devaraj K) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311523 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 00:01:49 +00:00
Thomas White
241e3d40ac MAPREDUCE-4105. Yarn RackResolver ignores rack configurations. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311520 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 23:32:43 +00:00
Robert Joseph Evans
48ab08f1c6 MAPREDUCE-4117. mapred job -status throws NullPointerException (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311479 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 21:52:50 +00:00
Robert Joseph Evans
b435e2202d MAPREDUCE-4110. Fix tests in TestMiniMRClasspath & TestMiniMRWithDFSWithDistinctUsers (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310546 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 18:56:55 +00:00
Robert Joseph Evans
c156906c73 MAPREDUCE-4051. Remove the empty hadoop-mapreduce-project/assembly/all.xml file (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310528 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 18:09:09 +00:00
Robert Joseph Evans
2bb3407af9 MAPREDUCE-4111. Fix tests in org.apache.hadoop.mapred.TestJobName (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310431 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 16:04:40 +00:00
Robert Joseph Evans
b447d94094 MAPREDUCE-4112. Fix tests org.apache.hadoop.mapred.TestClusterMapReduceTestCase (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310418 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 15:57:39 +00:00
Robert Joseph Evans
adeef5ec8f MAPREDUCE-4113. Fix tests org.apache.hadoop.mapred.TestClusterMRNotification (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310409 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 15:49:52 +00:00
Robert Joseph Evans
c76b264196 MAPREDUCE-4073. CS assigns multiple off-switch containers when using multi-level-queues (Siddharth Seth via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310056 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 20:27:55 +00:00
Thomas Graves
98df316058 MAPREDUCE-3621. TestDBJob and TestDataDrivenDBInputFormat ant tests fail (Ravi Prakash via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310043 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 20:11:52 +00:00
Alejandro Abdelnur
1d6038ecfb MAPREDUCE-4097. tools testcases fail because missing mrapp-generated-classpath file in classpath (rvs via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309583 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 20:24:01 +00:00
Todd Lipcon
1b93f8e5c3 MAPREDUCE-4103. Fix HA docs for changes to shell command fencer args. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309533 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 18:46:22 +00:00
Robert Joseph Evans
db075f93ae MAPREDUCE-3650. testGetTokensForHftpFS() fails (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309481 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 16:23:29 +00:00
Robert Joseph Evans
594dd9eb25 MAPREDUCE-3082. Archive command take wrong path for input file with current directory (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309453 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 15:28:17 +00:00
Thomas Graves
4e44259cbd MAPREDUCE-3682 Tracker URL says AM tasks run on localhost. (Ravi Prakash via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309440 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 15:08:39 +00:00
Alejandro Abdelnur
da1b01c9e3 MAPREDUCE-4098. TestMRApps testSetClasspath fails (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309432 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 14:56:13 +00:00
Thomas Graves
d99c2958dd MAPREDUCE-3672. Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS. (Anupam Seth via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309401 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 14:17:22 +00:00
Thomas Graves
1f4197984c MAPREDUCE-4020. Web services returns incorrect JSON for deep queue tree (Anupam Seth via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309133 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 20:39:08 +00:00
Robert Joseph Evans
7b387f55c3 MAPREDUCE-3999. Tracking link gives an error if the AppMaster hasn't started yet (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309108 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 19:37:46 +00:00
Robert Joseph Evans
b45c450026 MAPREDUCE-3988. mapreduce.job.local.dir doesn't point to a single directory on a node. (Eric Payne via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309086 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 18:29:40 +00:00
Robert Joseph Evans
20184e7ddc MAPREDUCE-4072. User set java.library.path seems to overwrite default creating problems native lib loading (Anupam Seth via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309077 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 18:01:43 +00:00
Robert Joseph Evans
2b5c36b695 MAPREDUCE-4062. AM Launcher thread can hang forever (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309037 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 16:59:26 +00:00
Thomas Graves
00eb28d927 MAPREDUCE-4012 Hadoop Job setup error leaves no useful info to users. (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308976 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 15:27:46 +00:00
Robert Joseph Evans
8c8dbba8a6 MAPREDUCE-3983. TestTTResourceReporting can fail, and should just be deleted (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308957 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 14:47:35 +00:00
Robert Joseph Evans
4d876c7800 MAPREDUCE-4060. Multiple SLF4J binding warning (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308925 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 14:19:29 +00:00
Robert Joseph Evans
01ce7ba3a4 MAPREDUCE-4024. RM webservices can't query on finalStatus (Tom Graves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308566 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 21:06:16 +00:00
Thomas Graves
bb74427da2 MAPREDUCE-4089. Hung Tasks never time out. (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308531 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 20:20:41 +00:00
Eli Collins
354025b6e7 MAPREDUCE-4095. TestJobInProgress#testLocality uses a bogus topology. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308519 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 20:04:31 +00:00
Robert Joseph Evans
3a8d123ccb MAPREDUCE-4092. commitJob Exception does not fail job (Jon Eagles via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308507 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 19:51:06 +00:00
Robert Joseph Evans
57af34b776 Preping for 0.23.3 stabilization. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308473 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 19:13:53 +00:00
Ravi Gummadi
170ff8d81c MAPREDUCE-4087. [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases (ravigummadi) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307740 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-31 08:24:15 +00:00
Alejandro Abdelnur
c4c7ee5b8c MAPREDUCE-4091. tools testcases failing because of MAPREDUCE-4082 (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307623 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 21:30:11 +00:00
Alejandro Abdelnur
d1893c8f5b MAPREDUCE-3916. various issues with running yarn proxyserver (devaraj via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307413 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 13:40:48 +00:00
Alejandro Abdelnur
57e175fddf hadoop-mapreduce-client-app's mrapp-generated-classpath file should not be in the module JAR (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307124 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 21:43:50 +00:00
Eli Collins
d05cc8e5cd MAPREDUCE-3989. Cap space usage of default log4j rolling policy. Contributed by Patrick Hunt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307102 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 20:53:44 +00:00
Robert Joseph Evans
f11a5dc5f6 MAPREDUCE-4081. TestMROutputFormat.java does not compile (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306901 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 15:18:41 +00:00
Arun Murthy
9bb6a025de MAPREDUCE-3377. Added a unit test to ensure OutputCommitter.checkOutputSpecs is called prior to copying job.xml. Contributed by Jane Chen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306736 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 07:45:45 +00:00
Siddharth Seth
db3e592df0 REDUCE-3955. Change MR to use ProtobufRpcEngine from hadoop-common instead of ProtoOverHadoopRpcEngine. (Contributed by Jitendra Nath Pandey) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306689 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 02:02:17 +00:00
Aaron Myers
991eddd043 Change "0.23.3" to "2.0.0" in CHANGES.txt files. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306538 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 18:55:33 +00:00
Robert Joseph Evans
1650a49993 MAPREDUCE-4061. RM only has 1 AM launcher thread (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305607 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 21:23:31 +00:00
Arun Murthy
1a9385d516 MAPREDUCE-3353. Fixed commit msg to point to right jira. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305457 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 17:29:02 +00:00
Harsh J
d5836856a2 MAPREDUCE-4066. Use default value when fetching MR_AM_STAGING_DIR. Contributed by xieguiming. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305343 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 13:21:36 +00:00
Arun Murthy
606114d602 MAPREDUCE-3533. Add a channel between RM and AM to get information on nodes. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305230 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 05:45:29 +00:00
Robert Joseph Evans
f67c2d1bd0 MAPREDUCE-4043. Secret keys set in Credentials are not seen by tasks (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304587 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 20:46:18 +00:00
Ravi Gummadi
7b3a98cfcd MAPREDUCE-3953. [Gridmix] Gridmix throws NPE and does not simulate a job if the trace contains null taskStatus for a task.(ravigummadi) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303330 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 09:42:23 +00:00
Alejandro Abdelnur
a24d12bdec MAPREDUCE-1740. NPE in getMatchingLevelForNodes when node locations are variable depth (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303076 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 18:36:56 +00:00
Robert Joseph Evans
40a8293d36 MAPREDUCE-4034. Unable to view task logs on history server with mapreduce.job.acl-view-job=* (Jason Lowe and Siddarth Seth via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302980 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 16:29:42 +00:00
Todd Lipcon
04a47dea74 MAPREDUCE-3992. Reduce fetcher doesn't verify HTTP status code of response. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302754 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 02:28:53 +00:00
Robert Joseph Evans
9d8d02b68b MAPREDUCE-4025. AM can crash if task attempt reports bogus progress value (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302645 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-19 20:31:55 +00:00
Thomas Graves
f58e3c8b12 MAPREDUCE-4006. History server container log web UI sometimes combines stderr/stdout/syslog contents together (Siddharth Seth via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301731 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 20:10:51 +00:00
Siddharth Seth
274d6909f3 MAPREDUCE-4005. Fixes broken AM container logs URL on ResourceManager Application Info page. (Contributed by Jason Lowe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301691 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 18:47:48 +00:00
Robert Joseph Evans
3e8c273f37 MAPREDUCE-4010. TestWritableJobConf fails on trunk (tucu via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301551 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 14:39:01 +00:00
Steve Loughran
e8ae52823f MAPREDUCE-3431 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301500 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 13:36:09 +00:00
Steve Loughran
af0227e32a MAPREDUCE-3970 ServiceOperations class 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300894 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 10:39:17 +00:00
Alejandro Abdelnur
7609243e58 MAPREDUCE-4007. JobClient getJob(JobID) should return NULL if the job does not exist (for backwards compatibility) (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300750 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-14 22:02:53 +00:00
Thomas Graves
3f46a62ff9 MAPREDUCE-3974. Change to release 23.3 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299775 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-12 18:30:32 +00:00
Ravi Gummadi
7d60932060 MAPREDUCE-3829. [Gridmix] Gridmix should give better error message when input data directory already exists and -generate option is given.(ravigummadi) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299625 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-12 11:08:32 +00:00
Arun Murthy
ed4c222d5c MAPREDUCE-3773. Add queue metrics with buckets for job run times. Contributed by Owen O'Malley. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299100 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 23:34:49 +00:00
Vinod Kumar Vavilapalli
558cc8c0bf MAPREDUCE-3982. Fixed FileOutputCommitter to not err out for an 'empty-job' whose tasks don't write any outputs. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299047 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 21:13:42 +00:00
Harsh J
1c534d0f9d MAPREDUCE-3991. Streaming FAQ has some wrong instructions about input files splitting. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299045 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 21:07:33 +00:00
Vinod Kumar Vavilapalli
ad3d3f54d5 MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298978 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 18:53:19 +00:00
Thomas White
4001b95cf2 MAPREDUCE-3578. Starting nodemanager as root gives "Unknown -jvm option" 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298941 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 17:37:00 +00:00
Robert Joseph Evans
13ea1d575c MAPREDUCE-3975. Default value not set for Configuration parameter mapreduce.job.local.dir (Eric Payne via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297825 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-07 01:27:02 +00:00
Robert Joseph Evans
25cceb65ce MAPREDUCE-3977. LogAggregationService leaks log aggregator objects (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297796 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 23:44:58 +00:00
Robert Joseph Evans
c3a4de0ec0 MAPREDUCE-3961. Map/ReduceSlotMillis computation incorrect (Siddharth Seth via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297788 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 23:21:13 +00:00
Siddharth Seth
4ce5f6553f MAPREDUCE-3944. Change the history jobs/ webservice to return partial job info for a significant performance improvement. (Contributed by Robert Joseph Evans) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297672 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 19:52:00 +00:00
Aaron Myers
1a0e088a19 MAPREDUCE-3974. TestSubmitJob in MR1 tests doesn't compile after HDFS-1623 merge. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297662 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 19:31:23 +00:00
Robert Joseph Evans
a98b756c73 MAPREDUCE-3976. TestRMContainerAllocator failing (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297557 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 16:17:41 +00:00
Arun Murthy
b9fd9e1759 MAPREDUCE-3034. Ensure NodeManager reboots itself on direction from ResourceManager. Contributed by Devaraj K & Eric Payne. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297310 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 00:52:10 +00:00
Alejandro Abdelnur
739f688f5a MAPREDUCE-3952. In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split. (zhenxiao via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297293 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-05 23:56:46 +00:00
Robert Joseph Evans
774f809f15 MAPREDUCE-3964. ResourceManager does not have JVM metrics (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297248 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-05 22:03:09 +00:00
Vinod Kumar Vavilapalli
7c1e857176 MAPREDUCE-3954. Added new envs to separate heap size for different daemons started via bin scripts. Contributed by Robert Joseph Evans. 
.--This line, and those below, will be ignored--

M    hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm
M    hadoop-mapreduce-project/hadoop-yarn/bin/yarn
M    hadoop-mapreduce-project/CHANGES.txt
M    hadoop-mapreduce-project/bin/mapred


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297174 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-05 19:03:56 +00:00
Vinod Kumar Vavilapalli
b73738d21e MAPREDUCE-3009. Fixed node link on JobHistory webapp. Contributed by hackaravarthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297149 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-05 18:29:29 +00:00
Ravi Gummadi
231e39462d MAPREDUCE-2722. [Gridmix] Gridmix simulated job's map's hdfsBytesRead counter is wrong when compressed input is used.(ravigummadi) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297052 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-05 13:44:01 +00:00
Arun Murthy
d5f4fcef5c MAPREDUCE-3497. Added docs for YARN CLI. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296902 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-04 23:50:58 +00:00
Arun Murthy
6d80dc2a84 MAPREDUCE-3897. Fixed computation of maxActiveAppsPerUser for queues by using capacity and not max-capacity since we are already scaling it by userLimitFactor. Contributed by Eric Payne. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296898 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-04 23:44:57 +00:00
Arun Murthy
d41cb76b56 MAPREDUCE-3960. Fix web-proxy to forward request to AM with configured hostname or IP. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296878 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-04 21:14:53 +00:00
Arun Murthy
bd38a29673 MAPREDUCE-3929. Fixed output of 'bin/mapred queue -showacl' command to clarify ACLs for users. Contributed by John George. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296835 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-04 17:14:23 +00:00
Vinod Kumar Vavilapalli
5f52156aa2 MAPREDUCE-3614. Fixed MR AM to close history file quickly and send a correct final state to the RM when it is killed. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296747 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-04 05:23:16 +00:00
Vinod Kumar Vavilapalli
fab57a144d MAPREDUCE-3792. Fix "bin/mapred job -list" to display all jobs instead of only the jobs owned by the user. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296721 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-03 23:40:35 +00:00
Thomas White
ce11ff73db MAPREDUCE-3935. Annotate Counters.Counter and Counters.Group as @Public. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296523 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-03 00:08:58 +00:00
Siddharth Seth
99bf2902b2 MAPREDUCE-3896. Add user information to the delegation token issued by the history server. (Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296401 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 19:28:04 +00:00
Tsz-wo Sze
b2f67b4704 HADOOP-8124, HDFS-3034, MAPREDUCE-3956. Remove the deprecated Syncable.sync(). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295999 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 23:51:19 +00:00
Siddharth Seth
7ae1523865 MAPREDUCE-3885. Avoid an unnecessary copy for all requests/responses in MRs ProtoOverHadoopRpcEngine. (Contributed by Devaraj Das) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295362 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 00:56:53 +00:00
Arun Murthy
7bf2f9559f MAPREDUCE-3706. Fix circular redirect error in job-attempts page. Contributed by Robert Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295314 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 22:14:32 +00:00
Siddharth Seth
3cbb9d20d0 MAPREDUCE-3903. Add support for mapreduce admin users. (Contributed by Thomas Graves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295262 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 20:48:09 +00:00
Alejandro Abdelnur
2659fded83 MAPREDUCE-3728. ShuffleHandler can't access results when configured in a secure mode (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295245 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 20:05:10 +00:00
Alejandro Abdelnur
a4ad12dd2d MAPREDUCE-3933. Failures because MALLOC_ARENA_MAX is not set (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295178 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 16:20:40 +00:00
Thomas Graves
547ded7bfe MAPREDUCE-3920. Revise yarn default port number selection (Dave Thompson via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295162 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 15:49:27 +00:00
Robert Joseph Evans
defa1c5bab MAPREDUCE-3687. If AM dies before it returns new tracking URL, proxy redirects to http://N/A/ and doesn't return error code (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295147 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 15:19:51 +00:00
Vinod Kumar Vavilapalli
44a003d8ec MAPREDUCE-3931. Changed PB implementation of LocalResource to take locks so that race conditions don't fail tasks by inadvertantly changing the timestamps. Contributed by Siddarth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294970 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 04:55:29 +00:00
Siddharth Seth
137aa0763f MAPREDUCE-3930. Fixed an NPE while accessing the AM page/webservice for a task attempt without an assigned container. (Contributed by Robert Joseph Evans) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294901 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 23:50:47 +00:00
Robert Joseph Evans
ffdf980b20 MAPREDUCE-3816 capacity scheduler web ui bar graphs for used capacity wrong (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294808 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 20:06:53 +00:00
Robert Joseph Evans
ab29f5c5f9 MAPREDUCE-3790 Broken pipe on streaming job can lead to truncated output for a successful job (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294750 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 17:50:38 +00:00
Vinod Kumar Vavilapalli
cfe214220f MAPREDUCE-3922. Fixed build to not compile 32bit container-executor binary by default on all platforms. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294446 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 02:35:37 +00:00