big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
946 Commits 2 Branches 2 Tags 264 MiB
24676e8c2e
Commit Graph

52 Commits

Author SHA1 Message Date
Arun Murthy
24676e8c2e MAPREDUCE-901. Efficient framework counters. Contributed by Luke Lu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157290 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 23:25:51 +00:00
Arun Murthy
989c5e90a5 MAPREDUCE-2037. Capture intermediate progress, CPU and memory usage for tasks. Contributed by Dick King. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157253 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 21:05:10 +00:00
Arun Murthy
ded6f225a5 MAPREDUCE-2837. Ported bug fixes from y-merge to prepare for MAPREDUCE-279 merge. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157249 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 21:00:17 +00:00
Arun Murthy
a9a4f25762 MAPREDUCE-2187 - Missed adding the file 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156962 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 04:14:41 +00:00
Mahadev Konar
3228351856 MAPREDUCE-2489. Jobsplits with random hostnames can make the queue unusable (jeffrey naisbit via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156821 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 20:42:28 +00:00
Tsz-wo Sze
5b7c0b6a45 MAPREDUCE-2805. Update RAID for HDFS-2241. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156513 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 07:09:27 +00:00
Tsz-wo Sze
2d653c994c MAPREDUCE-2797. Update mapreduce tests and RAID for HDFS-2239. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156215 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 15:10:20 +00:00
Devaraj Das
703b5f412c MAPREDUCE-2705. Permits parallel multiple task launches. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153720 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 01:31:05 +00:00
Devaraj Das
44b7e03114 MAPREDUCE-2705. Permits parallel multiple task launches. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153717 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 01:15:33 +00:00
Eli Collins
102b94d3a8 MAPREDUCE-2760. mapreduce.jobtracker.split.metainfo.maxsize typoed in mapred-default.xml. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153260 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 20:05:20 +00:00
Thomas White
44501d88e2 MAPREDUCE-2741. Make ant build system work with hadoop-common JAR generated by Maven. Contributed Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153209 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 17:26:09 +00:00
Arun Murthy
9bac807ced MAPREDUCE-2187. Reporter sends progress during sort/merge. Contributed by Anupam Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152964 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 22:53:08 +00:00
Todd Lipcon
22f232bce2 MAPREDUCE-2740. MultipleOutputs in new API creates needless TaskAttemptContexts. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152875 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 17:52:49 +00:00
Tsz-wo Sze
7e18c90d39 MAPREDUCE-2243. Close streams propely in a finally-block to avoid leakage in CompletedJobStatusStore, TaskLog, EventWriter and TotalOrderPartitioner. Contributed by Devaraj K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152787 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 14:11:19 +00:00
Eli Collins
0643a590d8 MAPREDUCE-2127. mapreduce trunk builds are filing on hudson. Contributed by Bruno Mahé 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152068 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-29 01:29:24 +00:00
Tsz-wo Sze
60c41c55e7 MAPREDUCE-2463. Job history files are not moved to done folder when job history location is hdfs. Contributed by Devaraj K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151722 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-28 04:08:34 +00:00
Tsz-wo Sze
4a535823a7 Fix a typo in CHANGE.txt: MAPREDUCE-2723 should be MAPREDUCE-2732. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151464 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 13:47:30 +00:00
Tsz-wo Sze
f3f9029577 Temporarily disable NameNodeRaidTestUtil.getDatanodeMap(..) for MAPREDUCE-2711. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151351 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 06:41:45 +00:00
Tsz-wo Sze
d356d64479 MAPREDUCE-2723. Remove directly accessing FSNamesystem.LOG from TestCopyFiles and TestDistCh. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151349 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 06:27:00 +00:00
Todd Lipcon
e8f12457c1 MAPREDUCE-2602. Allow setting of end-of-record delimiter for TextInputFormat for the old API. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150926 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-25 21:42:04 +00:00
Todd Lipcon
ef6110e94d MAPREDUCE-2622. Remove the last remaining reference to the deprecated configuration "io.sort.mb". Contributed by Harsh J Chouraria. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150921 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-25 21:29:38 +00:00
Mahadev Konar
00b526a146 MAPREDUCE-2575. TestMiniMRDFSCaching fails if test.build.dir is set to something other than build/test (Thomas Graves via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150533 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-25 04:18:23 +00:00
Owen O'Malley
c187bdc0a2 HDFS-2156. Make hdfs and mapreduce rpm only depend on the same major 
version for common and hdfs. (eyang via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1149323 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-21 19:16:09 +00:00
Christopher Douglas
3810266eae MAPREDUCE-2409. DistributedCache maps files and archives to the same path, 
despite semantic incompatibility. Contributed by Siddharth Seth


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1149004 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-21 01:59:14 +00:00
Tsz-wo Sze
54c5bf2b8c Correct way to temporarily disable TestBlockPlacementPolicyRaid for MAPREDUCE-2711. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148421 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-19 16:02:45 +00:00
Tsz-wo Sze
cabec474e0 Revert r1148400 for MAPREDUCE-2711. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148416 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-19 15:54:10 +00:00
Tsz-wo Sze
2614f6e66b Temporarily disable TestBlockPlacementPolicyRaid for MAPREDUCE-2711. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148400 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-19 15:33:36 +00:00
Tsz-wo Sze
f5690f57ed MAPREDUCE-2710. Update JobSubmitter.printTokens(..) for HDFS-2161. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148367 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-19 14:43:45 +00:00
Eli Collins
2a49e1a3a4 MAPREDUCE-2623. Update ClusterMapReduceTestCase to use MiniDFSCluster.Builder. Contributed by Harsh J Chouraria 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147981 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-18 17:27:37 +00:00
Arun Murthy
4ea4eeca75 MAPREDUCE-2365. Adding newer files. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1146517 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 23:50:30 +00:00
Arun Murthy
4796e1adcb MAPREDUCE-2365. Add counters to track bytes (read,written) via File(Input,Output)Format. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1146515 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 23:36:02 +00:00
Eli Collins
422608d53e MAPREDUCE-2670. Fixing spelling mistake in FairSchedulerServlet.java. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1146485 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 21:17:26 +00:00
Arun Murthy
654705b882 MAPREDUCE-2682. Add "mapred classpath" command to print classpath for MR applications. Contributed by vinodkv. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145889 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 07:17:53 +00:00
Arun Murthy
e2a53a37dd MAPREDUCE-2680. Display queue name in job client CLI. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145871 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 06:04:04 +00:00
Arun Murthy
f57eaf3989 MAPREDUCE-2679. Minor changes to sync trunk with MR-279 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145870 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 06:03:00 +00:00
Arun Murthy
fd5a762df0 MAPREDUCE-2400. Remove Cluster's dependency on JobTracker via a ServiceProvider for the actual implementation. Contributed by Tom White. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145679 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-12 17:10:59 +00:00
Eli Collins
12b8d9823d Fix missing close paragraph tag in previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145424 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-12 01:35:56 +00:00
Eli Collins
ad7cf36d5f MAPREDUCE-2606. Remove IsolationRunner. Contributed by Alejandro Abdelnur 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145413 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-12 00:54:48 +00:00
Amar Kamat
787dcfb8cd MAPREDUCE-2596. [Gridmix] Summarize Gridmix runs. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1144403 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-08 17:53:36 +00:00
Todd Lipcon
86236dd6c4 MAPREDUCE-2249. Check the reflexive property of Counters objects when comparing equality. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1144097 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-08 00:01:00 +00:00
Todd Lipcon
99f0b7d8cd MAPREDUCE-2323. Add metrics to the fair scheduler. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1143252 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-06 05:11:42 +00:00
Tsz-wo Sze
61fa4153dc MAPREDUCE-2624. Update RAID for HDFS-2107. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140942 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-29 01:51:34 +00:00
Tsz-wo Sze
d09e2475b6 MAPREDUCE-2620. Update RAID for HDFS-2087. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139400 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-24 18:21:55 +00:00
Amar Kamat
c7c8f2fe48 MAPREDUCE-2603. Disable High-Ram emulation in system tests. (Vinay Kumar Thota via amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1138301 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-22 04:48:53 +00:00
Todd Lipcon
5f81b0f421 MAPREDUCE-2550. Fix bin/mapred to work properly from within a source checkout. Contributed by Eric Yang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1137017 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-17 20:51:22 +00:00
Jakob Homan
c52787d287 MAPREDUCE-2576. Typo in comment in SimulatorLaunchTaskAction.java. Contributed by Tim Sell. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136261 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-16 01:13:34 +00:00
Amar Kamat
a732ab3804 MAPREDUCE-2107. [Gridmix] Total heap usage emulation in Gridmix. (Amar Kamat and Ravi Gummadi via amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136000 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-15 11:37:13 +00:00
Amar Kamat
7f0064e81b MAPREDUCE-2563. [Gridmix] Add High-Ram emulation system tests to Gridmix. (Vinay Kumar Thota via amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1135462 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-14 10:18:27 +00:00
Amar Kamat
3fd40ae8d0 MAPREDUCE-2106. [Gridmix] Cumulative CPU usage emulation in Gridmix. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1135396 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-14 07:44:16 +00:00
Tsz-wo Sze
87fee9cb2a MAPREDUCE-2588. Change raid to the new DataTransferProtocol API. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1135209 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-13 18:16:45 +00:00