big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
8,477 Commits 2 Branches 2 Tags 264 MiB
a18424e724
Commit Graph

1487 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli
1355ff6132 MAPREDUCE-5830. Added back the private API HostUtil.getTaskLogUrl(..) for binary compatibility with older clients like Hive 0.13. Contributed by Akira Ajisaka. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604230 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-20 18:28:21 +00:00
Karthik Kambatla
7b9c074b76 MAPREDUCE-5844. Add a configurable delay to reducer-preemption. (Maysam Yabandeh via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603957 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-19 17:22:56 +00:00
Karthik Kambatla
bd23a2ff22 MAPREDUCE-5896. InputSplits should indicate which locations have the block cached in memory. (Sandy Ryza via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603670 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-18 23:28:50 +00:00
Jian He
0abddac476 MAPREDUCE-5924. Changed TaskAttemptImpl to ignore TA_COMMIT_PENDING event at COMMIT_PENDING state. Contributed by Zhijie Shen 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603338 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-18 00:51:39 +00:00
Arun Murthy
26936978be Preparing to release hadoop-2.4.1. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602886 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-16 15:07:00 +00:00
Uma Maheswara Rao G
2ad014a097 Moved CHANGES.txt entries of MAPREDUCE-5898, MAPREDUCE-5920, HDFS-6464, HDFS-6375 from trunk to 2.5 section on merging HDFS-2006 to branch-2 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602699 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-15 14:54:36 +00:00
Chris Nauroth
180ac8dc1d MAPREDUCE-5912. Task.calculateOutputSize does not handle Windows files after MAPREDUCE-5196. Contributed by Remus Rusanu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602282 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-12 20:02:45 +00:00
Chris Nauroth
473e83ab71 MAPREDUCE-5920. Add Xattr option in DistCp docs. Contributed by Yi Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601983 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-11 18:36:06 +00:00
Vinod Kumar Vavilapalli
6480fdfd33 MAPREDUCE-5834. Increased test-timeouts in TestGridMixClasses to avoid occassional failures. Contributed by Mit Desai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601764 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-10 20:24:57 +00:00
Chris Nauroth
4888b16a43 MAPREDUCE-5886. Allow wordcount example job to accept multiple input paths. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601704 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-10 17:48:52 +00:00
Karthik Kambatla
40ba8c17c1 MAPREDUCE-5777. Support utf-8 text with Byte Order Marker. (Zhihai Xu via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600977 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-06 18:37:03 +00:00
Uma Maheswara Rao G
f81c7b0252 MAPREDUCE-5898. distcp to support preserving HDFS extended attributes(XAttrs). Contributed by Yi Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600900 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-06 14:45:39 +00:00
Devarajulu K
61c59c0704 MAPREDUCE-5895. Close streams properly to avoid leakage in TaskLog. Contributed by Kousuke Saruta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598209 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-29 07:05:26 +00:00
Jason Darrell Lowe
4bb4de93d6 MAPREDUCE-5862. Line records longer than 2x split size aren't handled correctly. Contributed by bc Wong 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598111 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-28 19:37:52 +00:00
Jing Zhao
3671a5e16f MAPREDUCE-5899. Support incremental data copy in DistCp. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596931 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-22 18:17:11 +00:00
Jason Darrell Lowe
1f8bb1001a MAPREDUCE-5309. 2.0.4 JobHistoryParser can't parse certain failed job history files generated by 2.0.3 history server. Contributed by Rushabh S Shah 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596295 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-20 15:46:54 +00:00
Devarajulu K
f74e446355 MAPREDUCE-5867. Fix NPE in KillAMPreemptionPolicy related to ProportionalCapacityPreemptionPolicy. Contributed by Sunil G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595754 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-19 06:42:29 +00:00
Chris Nauroth
11be7334c4 MAPREDUCE-5809. Enhance distcp to support preserving HDFS ACLs. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595283 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-16 18:25:23 +00:00
Junping Du
1e5d2c612b MAPREDUCE-5861. finishedSubMaps field in LocalContainerLauncher does not need to be volatile. (Contributed by Tsuyoshi OZAWA) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594795 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-15 07:07:18 +00:00
Christopher Douglas
5bf7ef839b MAPREDUCE-5821. Avoid unintentional reallocation of byte arrays in segments 
during merge. Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594654 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-14 17:51:11 +00:00
Karthik Kambatla
f3c3d9e0c6 MAPREDUCE-5652. NM Recovery. ShuffleHandler should handle NM restarts. (Jason Lowe via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594329 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-13 19:10:48 +00:00
Jason Darrell Lowe
b0e80d1a47 MAPREDUCE-5814. fat jar with *-default.xml may fail when mapreduce.job.classloader=true. Contributed by Gera Shegalov 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594326 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-13 18:55:05 +00:00
Jonathan Turner Eagles
4bc3371824 MAPREDUCE-5888. Failed job leaves hung AM after it unregisters (Jason Lowe via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594317 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-13 18:27:26 +00:00
Karthik Kambatla
5e337149e3 MAPREDUCE-5774. Job overview in History UI should list reducer phases in chronological order. (Gera Shegalov via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593890 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-12 06:15:33 +00:00
Jason Darrell Lowe
e2c18809d3 MAPREDUCE-5884. History server uses short user name when canceling tokens. Contributed by Mohammad Kamrul Islam 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593422 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-08 21:22:26 +00:00
Jonathan Turner Eagles
7fe28fc8f9 MAPREDUCE-5636. Convert MapReduce Tutorial document to APT (Akira AJISAKA via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592795 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-06 16:17:16 +00:00
Jonathan Turner Eagles
bd54137afa MAPREDUCE-5637. Convert Hadoop Streaming document to APT (Akira AJISAKA via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592789 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-06 16:01:21 +00:00
Tsz-wo Sze
03db13206f MAPREDUCE-5402. In DynamicInputFormat, change MAX_CHUNKS_TOLERABLE, MAX_CHUNKS_IDEAL, MIN_RECORDS_PER_CHUNK and SPLIT_RATIO to be configurable. Contributed by Tsuyoshi OZAWA 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592703 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-06 10:24:10 +00:00
Jonathan Turner Eagles
693025a3d4 MAPREDUCE-5638. Port Hadoop Archives document to trunk (Akira AJISAKA via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591107 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-29 21:23:50 +00:00
Jason Darrell Lowe
bb7ce82816 MAPREDUCE-5812. Make job context available to OutputCommitter.isRecoverySupported(). Contributed by Mohammad Kamrul Islam 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590668 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-28 15:18:02 +00:00
Eric Yang
39abe66822 MAPREDUCE-5714. Removed forceful JVM exit in shutDownJob. 
(Jinghui Wang via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590263 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-26 17:59:14 +00:00
Jason Darrell Lowe
283a3a246a MAPREDUCE-5835. Killing Task might cause the job to go to ERROR state. Contributed by Ming Ma 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590168 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-25 22:26:24 +00:00
Jonathan Turner Eagles
a059eadbe9 MAPREDUCE-5639. Port DistCp2 document to trunk (Akira AJISAKA via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590058 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-25 15:23:42 +00:00
Jason Darrell Lowe
5492149c3c MAPREDUCE-5749. TestRMContainerAllocator#testReportedAppProgress Failed. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590046 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-25 14:53:17 +00:00
Haohui Mai
c7e87574cb MAPREDUCE-5837. MRAppMaster fails when checking on uber mode. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589903 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-24 22:53:46 +00:00
Ravi Prakash
a93be7b46c MAPREDUCE-5846. Rumen doesn't understand JobQueueChangedEvent (Nathan Roberts via raviprak) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589595 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-24 05:59:28 +00:00
Vinod Kumar Vavilapalli
e33ba5d944 MAPREDUCE-5843. Fixed TestMRKeyValueTextInputFormat to not leak files and thus avoid failing on Windows. Contributed by Varun Vasudev. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589533 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-23 22:54:26 +00:00
Jason Darrell Lowe
6957745c2c MAPREDUCE-5841. uber job doesn't terminate on getting mapred job kill. Contributed by Sangjin Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589524 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-23 21:53:06 +00:00
Vinod Kumar Vavilapalli
586c46acda MAPREDUCE-5832. Fixed TestJobClient to not fail on JDK7 or on Windows. Contributed by Jian He and Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589315 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-23 00:02:09 +00:00
Chris Nauroth
4a91b876db MAPREDUCE-5833. TestRMContainerAllocator fails ocassionally. Contributed by Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589248 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-22 18:44:54 +00:00
Chris Nauroth
bb4216abf8 MAPREDUCE-5827. Move attribution from 2.5.0 to 2.4.1 in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589238 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-22 18:23:27 +00:00
Chris Nauroth
1dfc9c39b6 MAPREDUCE-5827. TestSpeculativeExecutionWithMRApp fails. Contributed by Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589223 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-22 18:17:54 +00:00
Chris Nauroth
06c15b6a3e MAPREDUCE-5852. Prepare MapReduce codebase for JUnit 4.11. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589006 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-21 23:44:41 +00:00
Chris Nauroth
c482cb253c MAPREDUCE-5642. TestMiniMRChildTask fails on Windows. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588605 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-19 04:07:22 +00:00
Jason Darrell Lowe
8d569c2220 MAPREDUCE-4937. MR AM handles an oversized split metainfo file poorly. Contributed by Eric Payne 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588559 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-18 20:33:28 +00:00
Jonathan Turner Eagles
28d62bf75b MAPREDUCE-3191. docs for map output compression incorrectly reference SequenceFile (Chen He via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588009 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-16 18:14:53 +00:00
Devarajulu K
14fee881fd MAPREDUCE-5775. Remove unnecessary job.setNumReduceTasks in SleepJob.createJob. Contributed by jhanver chand sharma. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587831 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-16 08:32:44 +00:00
Jonathan Turner Eagles
161d97807f MAPREDUCE-5836. Fix typo in RandomTextWriter (Akira AJISAKA via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587716 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-15 20:33:28 +00:00
Vinod Kumar Vavilapalli
6351ee2a78 MAPREDUCE-5828. Fixed a test issue with TestMapReduceJobControl that was causing it to fail on Windows. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587089 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-13 19:55:32 +00:00
Vinod Kumar Vavilapalli
c1127d19c4 MAPREDUCE-5826. Fixed HistoryServerFileSystemStore to use right permissions on Windows for temporary files and thus also fix the test-issue with 
TestHistoryServerFileSystemStateStoreService. Contributed by Varun Vasudev.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586567 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-11 04:28:57 +00:00
Vinod Kumar Vavilapalli
8d41b363b8 MAPREDUCE-5815. Fixed test-failure of TestMRAppMaster by making MRAppMaster gracefully handle empty-queue names. Contributed by Akira Ajisaka. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586559 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-11 04:01:39 +00:00
Jason Darrell Lowe
26421dd7dc MAPREDUCE-5825. Provide diagnostics for reducers killed during ramp down. Contributed by Gera Shegalov 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586479 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-10 22:02:48 +00:00
Vinod Kumar Vavilapalli
05fd3bbe48 MAPREDUCE-5824. Fixed test-failure of TestPipesNonJavaInputFormat in Windows. Contributed by Xuan Gong. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586368 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-10 16:44:04 +00:00
Zhijie Shen
f9df4d7377 MAPREDUCE-5818. Added "hsadmin" command into mapred.cmd. Contributed by Jian He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1584378 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-03 20:23:51 +00:00
Aaron Myers
74e3a176c4 Move MAPREDUCE-5014 to the right section now that it's been merged to branch-2. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1584234 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-03 00:57:00 +00:00
Sanford Ryza
d28be56239 MAPREDUCE-5759. Remove unnecessary conf load in Limits (Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583497 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-01 00:16:45 +00:00
Arun Murthy
fa9eed2ed6 Preparing for hadoop-2.4.0 release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583245 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-31 07:36:13 +00:00
Arun Murthy
b7b3a7e011 MAPREDUCE-5813. Fix YarnChild to explicitly load job.xml from the local-filesystem, rather than rely on the classpath. Contributed by Gera Shegalov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583050 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-29 19:14:53 +00:00
Vinod Kumar Vavilapalli
86ef362a7d MAPREDUCE-5810. Removed the faulty and failing streaming test TestStreamingTaskLog. Contributed by Akira Ajisaka. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582896 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-28 22:16:55 +00:00
Vinod Kumar Vavilapalli
533675bfbb MAPREDUCE-5805. Fixed MapReduce JobHistory encoding of queue-name to escape hyphens and thus avoid parsing errors. Contributed by Akira Ajisaka. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582125 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-26 23:43:49 +00:00
Vinod Kumar Vavilapalli
6015e95941 MAPREDUCE-5795. Fixed MRAppMaster to record the correct job-state after it recovers from a commit during a previous attempt. Contributed by Xuan Gong. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581180 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-25 02:00:39 +00:00
Chris Nauroth
a90a5c2452 MAPREDUCE-5791. Shuffle phase is slow in Windows - FadviseFileRegion::transferTo does not read disks efficiently. Contributed by Nikola Vujic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580994 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-24 18:57:52 +00:00
Vinod Kumar Vavilapalli
8a06949df8 MAPREDUCE-5806. Fixed a bug in MRAppMaster so as to enable users to properly override HADOOP_ROOT_LOGGER or HADOOP_CLIENT_OPTS. Contributed by Varun Vasudev. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580100 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-22 00:32:57 +00:00
Vinod Kumar Vavilapalli
a5c08eed16 MAPREDUCE-5787. Added the ability to keep alive shuffle connections in the MapReduce shuffle-handler. Contributed by Rajesh Balamohan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580062 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-21 21:43:55 +00:00
Kihwal Lee
767a98aa92 MAPREDUCE-5804. TestMRJobsWithProfiler#testProfiler timesout. Contributed by Mit Desai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579995 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-21 17:57:09 +00:00
Vinod Kumar Vavilapalli
396c6c63a2 MAPREDUCE-2349. Modified FileInputFormat to be able to issue file and block location calls in parallel. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579515 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-20 02:46:23 +00:00
Vinod Kumar Vavilapalli
96e0ca2d27 YARN-1824. Improved NodeManager and clients to be able to handle cross platform application submissions. Contributed by Jian He. 
MAPREDUCE-4052. Improved MapReduce clients to use NodeManagers' ability to handle cross platform application submissions. Contributed by Jian He.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578135 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-16 18:32:05 +00:00
Jason Darrell Lowe
8a2a741595 MAPREDUCE-5570. Map task attempt with fetch failure has incorrect attempt finish time. Contributed by Rushabh S Shah 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577692 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-14 20:33:03 +00:00
Jason Darrell Lowe
d9f723ed74 MAPREDUCE-5769. Unregistration to RM should not be called if AM is crashed before registering with RM. Contributed by Rohith 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577647 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-14 18:15:50 +00:00
Jason Darrell Lowe
2a6e8610b1 Update CHANGES.txt to show MR-5688 pulled into 2.4.0 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577586 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-14 15:55:36 +00:00
Jason Darrell Lowe
0ab1f90d40 MAPREDUCE-5751. MR app master fails to start in some cases if mapreduce.job.classloader is true. Contributed by Sangjin Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577554 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-14 14:43:33 +00:00
Jonathan Turner Eagles
aab466558a MAPREDUCE-5456. TestFetcher.testCopyFromHostExtraBytes is missing (Jason Lowe via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577313 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-13 20:48:06 +00:00
Arpit Agarwal
763b8ebf46 MAPREDUCE-5794. SliveMapper always uses default FileSystem. (Contributed by szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577281 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-13 18:55:29 +00:00
Jonathan Turner Eagles
2c6ce77c5a MAPREDUCE-5713. InputFormat and JobConf JavaDoc Fixes (Chen He via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577239 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-13 16:49:27 +00:00
Jason Darrell Lowe
87866d4a56 MAPREDUCE-5789. Average Reduce time is incorrect on Job Overview page. Contributed by Rushabh S Shah 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577202 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-13 15:35:34 +00:00
Jonathan Turner Eagles
a8f302a1e6 MAPREDUCE-5765. Update hadoop-pipes examples README (Mit Desai via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577188 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-13 15:13:07 +00:00
Arun Murthy
3bbd67173e MAPREDUCE-5553. Allow users to easily access completed/pending/successful/failed tasks on MR AM web-ui. Contributed by Paul Han. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576946 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-12 22:04:48 +00:00
Jason Darrell Lowe
cbf1c72d1b MAPREDUCE-5778. JobSummary does not escape newlines in the job name. Contributed by Akira AJISAKA 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576940 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-12 21:57:34 +00:00
Vinod Kumar Vavilapalli
98ecd4ffef MAPREDUCE-5028. Fixed a bug in MapTask that was causing mappers to fail when a large value of io.sort.mb is set. Contributed by Karthik Kambatla. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576170 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-11 01:29:56 +00:00
Tsz-wo Sze
8d49acf0e9 MAPREDUCE-5780. SliveTest should use the specified path to get the particular FileSystem instead of using the default FileSystem. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575049 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-06 21:26:51 +00:00
Jason Darrell Lowe
a756de93ef MAPREDUCE-5773. Provide dedicated MRAppMaster syslog length limit. Contributed by Gera Shegalov 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573775 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-03 22:02:18 +00:00
Jason Darrell Lowe
77910d4fe3 MAPREDUCE-5768. TestMRJobs.testContainerRollingLog fails on trunk. Contributed by Gera Shegalov 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573035 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-28 19:22:01 +00:00
Karthik Kambatla
9bdd272fd7 MAPREDUCE-5665. Add audience annotations to MiniMRYarnCluster and MiniMRCluster. (Anubhav Dhoot via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572795 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-28 00:52:30 +00:00
Vinod Kumar Vavilapalli
94b29b3348 MAPREDUCE-5770. Fixed MapReduce ApplicationMaster to correctly redirect to the YARN's web-app proxy with the correct scheme prefix. Contributed by Jian He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572711 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-27 19:23:55 +00:00
Vinod Kumar Vavilapalli
cd67d5abcd MAPREDUCE-5766. Moved ping messages from TaskAttempts to be at DEBUG level inside the ApplicationMaster log. Contributed by Jian He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572380 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-27 01:29:28 +00:00
Jason Darrell Lowe
658b1bf561 MAPREDUCE-5754. Preserve Job diagnostics in history. Contributed by Gera Shegalov 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572269 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-26 21:32:34 +00:00
Vinod Kumar Vavilapalli
ae29d9ee04 MAPREDUCE-5761. Added a simple log message to denote when encrypted shuffle is on in the shuffle-handler. Contributed by Jian He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571514 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-25 01:24:26 +00:00
Jonathan Turner Eagles
19f870858e MAPREDUCE-5688. TestStagingCleanup fails intermittently with JDK7 (Mit Desai via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570631 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-21 16:43:11 +00:00
Jonathan Turner Eagles
aa4cbcfa79 MAPREDUCE-5671. NaN can be created by client and assign to Progress (Chen He via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570620 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-21 16:23:12 +00:00
Arun Murthy
1417803326 Branching for hadoop-2.5 releases. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569185 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-18 04:38:51 +00:00
Jason Darrell Lowe
08e6d312e8 MAPREDUCE-5757. ConcurrentModificationException in JobControl.toList. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569038 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-17 16:14:58 +00:00
Jason Darrell Lowe
c122ef9000 MAPREDUCE-5670. CombineFileRecordReader should report progress when moving to the next file. Contributed by Chen He 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568118 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-13 23:16:00 +00:00
Karthik Kambatla
308f5faf18 MAPREDUCE-5746. Job diagnostics can implicate wrong task for a failed job. (Jason Lowe via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567666 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 16:04:18 +00:00
Arun Murthy
c43c9dd7b5 Preparing to release hadoop-2.3.0 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567111 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 13:25:30 +00:00
Karthik Kambatla
914a9709b9 MAPREDUCE-5744. Job hangs because RMContainerAllocator.preemptReduce() violates the comparator contract (Gera Shegalov via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565478 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-06 23:27:57 +00:00
Vinod Kumar Vavilapalli
b527a975a4 MAPREDUCE-5743. Fixed CHANGES.txt to give credit to Ted too. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565401 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-06 19:07:18 +00:00
Karthik Kambatla
4594b74b85 MAPREDUCE-5699. Allow setting tags on MR jobs (kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565384 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-06 18:29:30 +00:00
Zhijie Shen
b36cc29073 MAPREDUCE-5743. Fixed the test failure in TestRMContainerAllocator. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565087 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-06 06:20:41 +00:00
Vinod Kumar Vavilapalli
10f0901764 Updating branch-2.3's YARN's CHANGES.txt to reflect the recent rebase of unreleased 2.3 to more latest branch-2. 
Fixing entry for MAPREDUCE-5732 in trunk and branch-2.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562949 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-30 20:30:12 +00:00
Vinod Kumar Vavilapalli
d0b4c7d6b1 Updating branch-2's MAPREDUCE CHANGES.txt to reflect the recent rebase of unreleased 2.3 to more latest branch-2. 
Updating trunk's MAPREDUCE CHANGES.txt to fix more differences with branch-2's CHANGES.txt
MAPREDUCE's CHANGES.txt is foobar'ed. There are still a bunch of misplaced CHANGES.txt entries - not fixing them now.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562945 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-30 20:16:56 +00:00