big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,489 Commits 2 Branches 2 Tags 264 MiB
638801cce1
Commit Graph

1224 Commits

Author SHA1 Message Date
Suresh Srinivas
638801cce1 HADOOP-8952. Enhancements to support Hadoop on Windows Server and Windows Azure environments. Contributed by Ivan Mitic, Chuan Liu, Ramya Sunil, Bikas Saha, Kanna Karanam, John Gordon, Brandon Li, Chris Nauroth, David Lao, Sumadhur Reddy Bolli, Arpit Agarwal, Ahmed El Baz, Mike Liddell, Jing Zhao, Thejas Nair, Steve Maine, Ganeshan Iyer, Raja Aluri, Giridharan Kesavan, Ramya Bharathi Nimmagadda. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453486 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 19:15:18 +00:00
Arun Murthy
df68c56267 MAPREDUCE-3685. Fix bugs in MergeManager to ensure compression codec is appropriately used and that on-disk segments are correctly sorted on file-size. Contributed by Anty Rao and Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453365 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 15:02:45 +00:00
Jonathan Turner Eagles
e1062b8b78 MAPREDUCE-5027. Shuffle does not limit number of outstanding connections (Robert Parker via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453098 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 00:03:41 +00:00
Robert Joseph Evans
ec13f1eb3a MAPREDUCE-5043. Fetch failure processing can cause AM event queue to backup and eventually OOM (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452372 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-04 16:32:18 +00:00
Jonathan Turner Eagles
38c4e17ec1 MAPREDUCE-4794. DefaultSpeculator generates error messages on normal shutdown (Jason Lowe via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451826 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-02 03:30:58 +00:00
Alejandro Abdelnur
5d6eca08bd MAPREDUCE-4896. mapred queue -info spits out ugly exception when queue does not exist. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451452 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-01 01:28:18 +00:00
Alejandro Abdelnur
892e088773 HADOOP-9349. Confusing output when running hadoop version from one hadoop installation when HADOOP_HOME points to another. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451448 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-01 01:20:53 +00:00
Jonathan Turner Eagles
892846dc04 MAPREDUCE-4871. AM uses mapreduce.jobtracker.split.metainfo.maxsize but mapred-default has mapreduce.job.split.metainfo.maxsize (Jason Lowe via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451318 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-28 19:55:10 +00:00
Siddharth Seth
979fb054f8 MAPREDUCE-4693. Historyserver should provide counters for failed tasks. Contributed by Xuan Gong. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450956 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-27 21:03:19 +00:00
Vinod Kumar Vavilapalli
0b9ed2364a MAPREDUCE-4892. Modify CombineFileInputFormat to not skew input slits' allocation on small clusters. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450912 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-27 18:49:37 +00:00
Thomas White
14089f1e57 MAPREDUCE-5008. Merger progress miscounts with respect to EOF_MARKER. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450723 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-27 10:40:00 +00:00
Aaron Myers
42e987f11e MAPREDUCE-5033. mapred shell script should respect usage flags (--help -help -h). Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450584 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-27 02:42:38 +00:00
Suresh Srinivas
70b1c5ca75 HADOOP-9334. Upgrade netty version. Contributed by Nicolas Liochon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450463 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-26 21:54:25 +00:00
Thomas White
0b73dde6ce MAPREDUCE-4951. Container preemption interpreted as task failure. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448615 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 11:56:08 +00:00
Thomas White
87035a004c MAPREDUCE-5013. mapred.JobStatus compatibility: MR2 missing constructors from MR1. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448602 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 11:42:48 +00:00
Thomas White
7555b4df74 MAPREDUCE-4846. Some JobQueueInfo methods are public in MR1 but protected in MR2. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448597 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 11:34:09 +00:00
Jonathan Turner Eagles
c8f35bc3d2 MAPREDUCE-5009. Killing the Task Attempt slated for commit does not clear the value from the Task commitAttempt member (Robert Parker via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1447965 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-19 23:35:56 +00:00
Suresh Srinivas
1c49e77998 MAPREDUCE-5012. Typo in javadoc for IdentityMapper class. Contributed by Adam Monsen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1447865 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-19 18:45:22 +00:00
Alejandro Abdelnur
0a8cfa9016 HADOOP-9304. remove addition of avro genreated-sources dirs to build. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1446296 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-14 18:48:14 +00:00
Alejandro Abdelnur
ab330b33bb MAPREDUCE-4994. Addendum fixing testcases failures. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1446042 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-14 04:22:04 +00:00
Alejandro Abdelnur
6bcbf492a2 HADOOP-9117. replace protoc ant plugin exec with a maven plugin. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445956 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-13 22:13:44 +00:00
Siddharth Seth
43204f0c83 MAPREDUCE-5000. Fixes getCounters when speculating by fixing the selection of the best attempt for a task. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445871 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-13 19:20:31 +00:00
Jason Darrell Lowe
390d1fbef8 MAPREDUCE-4992. AM hangs in RecoveryService when recovering tasks with speculative attempts. Contributed by Robert Parker 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445456 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-13 02:11:36 +00:00
Jason Darrell Lowe
c2d6407070 MAPREDUCE-4989. JSONify DataTables input data for Attempts page. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445448 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-13 01:15:48 +00:00
Alejandro Abdelnur
7e615c7f75 MAPREDUCE-4994. -jt generic command line option does not work. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445330 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-12 20:16:08 +00:00
Siddharth Seth
35832053bf MAPREDUCE-4671. AM does not tell the RM about container requests which are no longer needed. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443323 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-07 07:07:11 +00:00
Jason Darrell Lowe
ea94b7b9dd MAPREDUCE-4822. Unnecessary conversions in History Events. Contributed by Chu Tong 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443257 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-06 22:47:10 +00:00
Alejandro Abdelnur
17e72be6d8 MAPREDUCE-4977. Documentation for pluggable shuffle and pluggable sort. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443168 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-06 19:52:25 +00:00
Robert Joseph Evans
79b12f6f4c MAPREDUCE-4905. test org.apache.hadoop.mapred.pipes (Aleksey Gorshkov via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443027 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-06 15:50:23 +00:00
Arun Murthy
7cc2050041 Preparing for hadoop-2.0.3-alpha release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442959 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-06 13:31:52 +00:00
Aaron Myers
bdb5342b2d MAPREDUCE-4953. HadoopPipes misuses fprintf. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442471 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-05 04:53:32 +00:00
Siddharth Seth
a04bee4567 MAPREDUCE-4971. Minor extensibility enhancements to Counters & FileOutputFormat. Contributed by Arun C Murthy 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441670 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-02 00:47:58 +00:00
Hitesh Shah
b1baf11fb2 YARN-372. Move InlineDispatcher from hadoop-yarn-server-resourcemanager to hadoop-yarn-common. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441668 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-02 00:43:54 +00:00
Suresh Srinivas
ac21e15a39 MAPREDUCE-4969. TestKeyValueTextInputFormat test fails with Open JDK 7. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441069 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 17:11:36 +00:00
Vinod Kumar Vavilapalli
28c308d5e8 MAPREDUCE-4893. Fixed MR ApplicationMaster to do optimal assignment of containers to get maximum locality. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440749 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 00:28:10 +00:00
Alejandro Abdelnur
0f430e53fd MAPREDUCE-2264. Job status exceeds 100% in some cases. (devaraj.k and sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440076 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 19:38:40 +00:00
Siddharth Seth
c163dc2fce MAPREDUCE-4838. Add additional fields like Locality, Avataar to the JobHistory logs. Contributed by Zhijie Shen 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439714 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 00:21:58 +00:00
Siddharth Seth
8a5fadc5a0 MAPREDUCE-4803. Remove duplicate copy of TestIndexCache. Contributed by Mariappan Asokan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439590 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-28 19:18:35 +00:00
Alejandro Abdelnur
da4cab1099 Revering MAPREDUCE-2264 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439561 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-28 18:58:34 +00:00
Alejandro Abdelnur
759a3fae86 Amending MR CHANGES.txt to reflect that MAPREDUCE-4049/4809/4807/4808 are in branch-2 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438799 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-26 00:44:56 +00:00
Alejandro Abdelnur
539153a679 MAPREDUCE-2264. Job status exceeds 100% in some cases. (devaraj.k and sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438277 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-25 00:25:59 +00:00
Siddharth Seth
74ffc7a74d MAPREDUCE-4946. Fix a performance problem for large jobs by reducing the number of map completion event type conversions. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437103 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-22 19:07:08 +00:00
Alejandro Abdelnur
bb81a17e0b MAPREDUCE-4949. Enable multiple pi jobs to run in parallel. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437029 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-22 16:26:29 +00:00
Alejandro Abdelnur
73fd247c76 MAPREDUCE-4808. Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations. (masokan via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1436936 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-22 14:10:42 +00:00
Jonathan Turner Eagles
88c7fdd065 MAPREDUCE-4458. Warn if java.library.path is used for AM or Task (Robert Parker via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435386 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-18 22:41:19 +00:00
Siddharth Seth
76f9af4ccf MAPREDUCE-4948. Fix a failing unit test - TestYARNRunner.testHistoryServerToken. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435312 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-18 19:30:00 +00:00
Alejandro Abdelnur
1c308188bb MAPREDUCE-4923. Add toString method to TaggedInputSplit. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434993 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-18 00:40:58 +00:00
Thomas Graves
f266efcd10 Preparing for release 0.23.6 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434030 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-16 16:43:12 +00:00
Alejandro Abdelnur
26275e5323 MAPREDUCE-4924. flakey test: org.apache.hadoop.mapred.TestClusterMRNotification.testMR. (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433753 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-16 00:08:25 +00:00
Siddharth Seth
6a2f2551fd YARN-135. Client tokens should be per app-attempt, and should be unregistered on App-finish. Contributed by Vinod Kumar Vavilapalli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433570 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 18:33:38 +00:00