Arun Murthy
|
40e78c2ca2
|
MAPREDUCE-4737. Ensure that mapreduce APIs are semantically consistent with mapred API w.r.t Mapper.cleanup and Reducer.cleanup; in the sense that cleanup is now called even if there is an error. The old mapred API already ensures that Mapper.close and Reducer.close are invoked during error handling. Note that it is an incompatible change, however end-users can override Mapper.run and Reducer.run to get the old (inconsistent) behaviour. Contributed by Arun C. Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471556 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-24 17:38:43 +00:00 |
|
Robert Joseph Evans
|
0777474cc2
|
MAPREDUCE-5069. add concrete common implementations of CombineFileInputFormat (Sangjin Lee via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471424 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-24 14:11:50 +00:00 |
|
Aaron Myers
|
4c662fd3fe
|
HDFS-4737. JVM path embedded in fuse binaries. Contributed by Sean Mackrory.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471215 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-24 00:47:13 +00:00 |
|
Vinod Kumar Vavilapalli
|
cd975d4b64
|
YARN-581. Added a test to verify that app delegation tokens are restored after RM restart. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471187 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-23 22:49:44 +00:00 |
|
Vinod Kumar Vavilapalli
|
27e8c86999
|
YARN-561. Modified NodeManager to set key information into the environment of every container that it launches. Contributed by Xuan Gong.
MAPREDUCE-5175. Updated MR App to not set envs that will be set by NMs anyways after YARN-561. Contributed by Xuan Gong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471156 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-23 21:39:51 +00:00 |
|
Tsz-wo Sze
|
631be95398
|
HDFS-4732. Fix TestDFSUpgradeFromImage which fails on Windows due to failure to unpack old image tarball that contains hard links. Chris Nauroth
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471090 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-23 18:47:47 +00:00 |
|
Vinod Kumar Vavilapalli
|
ffd7dbb34a
|
YARN-583. Moved application level local resources to be localized under the filecache sub-directory under application directory. Contributed by Omkar Vinit Joshi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470812 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-23 04:37:45 +00:00 |
|
Bikas Saha
|
a1ee2145cf
|
YARN-549. YarnClient.submitApplication should wait for application to be accepted by the RM (Zhijie Shen via bikas)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470797 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-23 03:06:41 +00:00 |
|
Tsz-wo Sze
|
fd24c6e833
|
HDFS-4725. Fix HDFS file handle leaks in FSEditLog, NameNode, OfflineEditsBinaryLoader and some tests. Contributed by Chris Nauroth
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470771 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-23 01:18:36 +00:00 |
|
Thomas White
|
009af54d51
|
MAPREDUCE-5146. application classloader may be used too early to load classes. Contributed by Sangjin Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470694 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-22 20:07:06 +00:00 |
|
Bikas Saha
|
e24a9b83f1
|
YARN-594. Update test and add comments in YARN-534 (Jian He via bikas)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470243 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-20 22:04:08 +00:00 |
|
Suresh Srinivas
|
7e122e1009
|
HADOOP-9443. Port winutils static code analysis change to trunk. Contributed by Chuan Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470224 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-20 20:20:44 +00:00 |
|
Arun Murthy
|
794f9bb3e4
|
MAPREDUCE-5066. Added a timeout for the job.end.notification.url. Contributed by Ivan Mitic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470216 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-20 19:18:24 +00:00 |
|
Vinod Kumar Vavilapalli
|
a91067fc5e
|
YARN-542. Changed the default global AM max-attempts value to be not one. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470094 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-20 00:35:29 +00:00 |
|
Vinod Kumar Vavilapalli
|
c570309b07
|
YARN-547. Fixed race conditions in public and private resource localization which used to cause duplicate downloads. Contributed by Omkar Vinit Joshi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470076 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-19 22:35:43 +00:00 |
|
Vinod Kumar Vavilapalli
|
d5556cb5c4
|
YARN-586. Fixed a typo in ApplicationSubmissionContext#setApplicationId. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470068 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-19 22:25:17 +00:00 |
|
Thomas Graves
|
7049c83d0e
|
HADOOP-9469. mapreduce/yarn source jars not included in dist tarball (Robert Parker via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470047 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-19 21:18:05 +00:00 |
|
Thomas Graves
|
febc52be37
|
MAPREDUCE-5147. Maven build should create hadoop-mapreduce-client-app-VERSION.jar directly (Robert Parker via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470035 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-19 20:50:48 +00:00 |
|
Bikas Saha
|
c1ce3c5ad2
|
MAPREDUCE-4987. TestMRJobs#testDistributedCache fails on Windows due to classpath problems and unexpected behavior of symlinks (Chris Nauroth via bikas)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470003 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-19 19:32:33 +00:00 |
|
Bikas Saha
|
edcfd4527c
|
YARN-593. container launch on Windows does not correctly populate classpath with new process's environment variables and localized resources (Chris Nauroth via bikas)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469998 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-19 19:29:22 +00:00 |
|
Bikas Saha
|
7c66645417
|
HADOOP-9488. FileUtil#createJarWithClassPath only substitutes environment variables from current process environment/does not support overriding when launching new process (Chris Nauroth via bikas)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469996 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-19 19:23:35 +00:00 |
|
Kihwal Lee
|
16cc4a6e86
|
HDFS-4699. TestPipelinesFailover#testPipelineRecoveryStress fails sporadically. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469839 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-19 14:08:29 +00:00 |
|
Vinod Kumar Vavilapalli
|
44bf8525a5
|
YARN-493. Fixed some shell related flaws in YARN on Windows. Contributed by Chris Nauroth.
HADOOP-9486. Promoted Windows and Shell related utils from YARN to Hadoop Common. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469667 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-19 02:14:58 +00:00 |
|
Vinod Kumar Vavilapalli
|
8e1c2823fc
|
YARN-441. Removed unused utility methods for collections from two API records. Contributed by Xuan Gong.
MAPREDUCE-5163. Update MR App to not use API utility methods for collections after YARN-441. Contributed by Xuan Gong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469657 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-19 01:33:13 +00:00 |
|
Suresh Srinivas
|
980e6c54ba
|
HDFS-4434. Provide a mapping from INodeId to INode. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469644 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-19 00:10:09 +00:00 |
|
Alejandro Abdelnur
|
e222d1e783
|
MAPREDUCE-4932. mapreduce.job#getTaskCompletionEvents incompatible with Hadoop 1. (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469587 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-18 21:42:03 +00:00 |
|
Vinod Kumar Vavilapalli
|
cb78a65a15
|
MAPREDUCE-5152. Make MR App to simply pass through the container from RM instead of extracting and populating information itself to start any container. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469544 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-18 20:13:40 +00:00 |
|
Alejandro Abdelnur
|
d12c463121
|
MAPREDUCE-4898. FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1. (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469523 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-18 18:51:45 +00:00 |
|
Alejandro Abdelnur
|
df55edd5de
|
YARN-482. FS: Extend SchedulingMode to intermediate queues. (kkambatl via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469506 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-18 18:11:21 +00:00 |
|
Vinod Kumar Vavilapalli
|
d219c904d3
|
YARN-585. Fix failure in TestFairScheduler#testNotAllowSubmitApplication caused by YARN-514. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469492 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-18 17:49:22 +00:00 |
|
Harsh J
|
5003e8de76
|
HADOOP-9450. HADOOP_USER_CLASSPATH_FIRST is not honored; CLASSPATH is PREpended instead of APpended. Contributed by Chris Nauroth and Harsh J. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469214 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-18 07:59:06 +00:00 |
|
Alejandro Abdelnur
|
cd27afa71a
|
MAPREDUCE-5128. mapred-default.xml is missing a bunch of history server configs. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469095 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-17 23:14:34 +00:00 |
|
Alejandro Abdelnur
|
de6d05c8b0
|
YARN-476. ProcfsBasedProcessTree info message confuses users. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469093 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-17 23:11:15 +00:00 |
|
Alejandro Abdelnur
|
014dc3ae9b
|
YARN-518. Fair Scheduler's document link could be added to the hadoop 2.x main doc page. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469091 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-17 23:05:58 +00:00 |
|
Bikas Saha
|
9e650d36b7
|
MAPREDUCE-5140. MR part of YARN-514 (Zhijie Shen via bikas)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469060 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-17 20:25:21 +00:00 |
|
Bikas Saha
|
ef9f251679
|
YARN-514.Delayed store operations should not result in RM unavailability for app submission (Zhijie Shen via bikas)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469059 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-17 20:19:43 +00:00 |
|
Suresh Srinivas
|
d090a3b600
|
HDFS-4695. TestEditLog leaks open file handles between tests. Contributed by Ivan Mitic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469015 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-17 18:11:31 +00:00 |
|
Vinod Kumar Vavilapalli
|
dbcda89fef
|
YARN-500. Fixed YARN webapps to not roll-over ports when explicitly asked to use non-ephemeral ports. Contributed by Kenji Kikushima.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468739 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-17 04:16:51 +00:00 |
|
Luke Lu
|
9bebccc755
|
Fix HADOOP-9467 attribution.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468731 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-17 02:57:29 +00:00 |
|
Kihwal Lee
|
2e789dd9a6
|
MAPREDUCE-5065. DistCp should skip checksum comparisons if block-sizes are different on source/target. Contributed by Mithun Radhakrishnan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468629 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-16 22:01:18 +00:00 |
|
Thomas Graves
|
9ea20fc537
|
MAPREDUCE-5015. Coverage fix for org.apache.hadoop.mapreduce.tools.CLI (Aleksey Gorshkov via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468483 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-16 16:11:35 +00:00 |
|
Suresh Srinivas
|
1822529e88
|
HDFS-4693. Some test cases in TestCheckpoint do not clean up after themselves. Contributed by Arpit Agarwal and Suresh.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468457 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-16 15:10:47 +00:00 |
|
Vinod Kumar Vavilapalli
|
0e01f26821
|
YARN-444. Moved special container exit codes from YarnConfiguration to API where they belong. Contributed by Sandy Ryza.
MAPREDUCE-5151. Updated MR AM to use standard exit codes from the API after YARN-444. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468276 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-15 23:54:09 +00:00 |
|
Robert Joseph Evans
|
947e97f354
|
MAPREDUCE-4974. Optimising the LineRecordReader initialize() method (Gelesh via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468232 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-15 21:33:47 +00:00 |
|
Suresh Srinivas
|
108e0e0953
|
HADOOP-9473. Add change description missed in previous commit 1467694
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467696 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-13 20:26:51 +00:00 |
|
Suresh Srinivas
|
e408d9904b
|
HADOOP-9473. Typo in FileUtil copy() method. Contributed by Glen Mazza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467694 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-13 20:22:02 +00:00 |
|
Aaron Myers
|
801b484f97
|
HDFS-347. DFS read performance suboptimal when client co-located on nodes with data. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467538 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-13 02:13:59 +00:00 |
|
Konstantin Shvachko
|
242028a3fb
|
HDFS-4639. startFileInternal() should not increment generation stamp. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467534 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-13 01:35:58 +00:00 |
|
Aaron Myers
|
b7aaa1b74c
|
Merge trunk into the HDFS-347 branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1467511 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-12 23:05:28 +00:00 |
|
Arun Murthy
|
5e94420456
|
YARN-412. Pushing to 2.0.5-beta only.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467470 13f79535-47bb-0310-9956-ffa450edef68
|
2013-04-12 21:19:39 +00:00 |
|