big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,346 Commits 2 Branches 2 Tags 264 MiB
c78f6aa299
Commit Graph

655 Commits

Author SHA1 Message Date
Aaron Myers
60ab29759e Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291893 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-21 16:24:40 +00:00
Vinod Kumar Vavilapalli
b2172c394e MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291606 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-21 05:30:23 +00:00
Vinod Kumar Vavilapalli
5ee495e6f3 MAPREDUCE-3634. Fixed all daemons to crash instead of hanging around when their EventHandlers get exceptions. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291598 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-21 05:08:25 +00:00
Aaron Myers
f0db867292 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291400 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-20 18:33:37 +00:00
Steve Loughran
3d8907fdd6 MAPREDUCE-3877 Add a test to formalise the current state transitions of the yarn lifecycle 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245918 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 13:22:47 +00:00
Arun Murthy
566f0b5ad2 MAPREDUCE-3880. Changed LCE binary to be 32-bit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245867 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 06:36:00 +00:00
Arun Murthy
3c5eb01263 MAPREDUCE-3856. Committing to 0.23.1. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245840 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 02:18:00 +00:00
Todd Lipcon
ef5d7156db Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245834 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 01:27:51 +00:00
Tsz-wo Sze
b4c8567e1b MAPREDUCE-3583. Change pid to String and stime to BigInteger in order to handle integers larger than Long.MAX_VALUE. Contributed by Zhihong Yu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245828 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 01:12:18 +00:00
Robert Joseph Evans
ff33b38734 MAPREDUCE-3862 Nodemanager can appear to hang on shutdown due to lingering DeletionService threads (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245781 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 21:57:49 +00:00
Aaron Myers
53b7d6c6bc Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245690 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 18:19:31 +00:00
Ravi Gummadi
11c127bb51 MAPREDUCE-3757. [Rumen] Fixed Rumen Folder to adjust shuffleFinished and sortFinished times when needed. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245303 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 02:55:00 +00:00
Siddharth Seth
a64046d16f MAPREDUCE-3856. Instances of RunningJob class givs incorrect job tracking urls when mutiple jobs are submitted from same client jvm. (Contributed by Eric Payne) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245276 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 00:54:44 +00:00
Aaron Myers
833e96534f Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245117 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 18:35:32 +00:00
Robert Joseph Evans
cfc4ad76a3 MAPREDUCE-3849. Change TokenCache's reading of the binary token file (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245099 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 17:49:20 +00:00
Todd Lipcon
20816218f0 MAPREDUCE-3864. Fix cluster setup docs for correct SecondaryNameNode HTTPS parameters. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244852 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 05:53:25 +00:00
Aaron Myers
1fb0ab92f8 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244645 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 19:04:17 +00:00
Alejandro Abdelnur
89bd2210a7 MAPREDUCE-3736. Variable substitution depth too large for fs.default.name causes jobs to fail (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244264 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 23:09:05 +00:00
Mahadev Konar
83ab8f087b MAPREDUCE-3858. Task attempt failure during commit results in task never completing. (Tom White via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244254 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 22:49:00 +00:00
Vinod Kumar Vavilapalli
16a44b6fa5 MAPREDUCE-3854. Fixed and reenabled tests related to MR child JVM's environmental variables in TestMiniMRChildTask. (Tom White via vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244223 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 21:39:59 +00:00
Aaron Myers
011611c765 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244202 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 20:37:10 +00:00
Vinod Kumar Vavilapalli
1903e544a4 MAPREDUCE-3802. Added test to validate that AM can crash multiple times and still can recover successfully after MAPREDUCE-3846. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244178 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 19:24:00 +00:00
Vinod Kumar Vavilapalli
0515b3322f MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and then the recovery. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243752 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 00:06:37 +00:00
Konstantin Shvachko
ce778462ee MAPREDUCE-3837. Job tracker is not able to recover jobs after crash. Contributed by Mayank Bansal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243695 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 21:12:03 +00:00
Todd Lipcon
db187cf40e Merge trunk into HA branch. 
Some conflicts around TestBlockRecovery: mocking changed for new heartbeat types/responses


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243691 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 21:00:37 +00:00
Mahadev Konar
5c46ba4d48 MAPREDUCE-3852. Test TestLinuxResourceCalculatorPlugin failing. (Thomas Graves via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243418 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 05:37:11 +00:00
Thomas Graves
0bf146b0dd MAPREDUCE-3843. Job summary log file found missing on the RM host (Anupam Seth via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242976 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 23:24:08 +00:00
Vinod Kumar Vavilapalli
56b6f4a8fc Cleaning up hadoop-mapreduce-project/CHANGES.txt a bit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242902 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 19:55:15 +00:00
Aaron Myers
05d56e5e7e Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242871 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 18:01:01 +00:00
Thomas Graves
73a72e0ef9 MAPREDUCE-3680. FifoScheduler web service rest API can print out invalid JSON. (B Anil Kumar via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242790 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 14:30:00 +00:00
Todd Lipcon
c14bb61a82 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242635 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 01:49:08 +00:00
Tsz-wo Sze
03ee90b9eb HADOOP-7923. Automate the updating of version numbers in the doc system. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242485 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 19:47:11 +00:00
Robert Joseph Evans
b2d49acd08 MAPREDUCE-3840 JobEndNotifier doesn't use the proxyToUse during connecting (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241999 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 17:31:13 +00:00
Amar Kamat
e5060d3bbb MAPREDUCE-3770. Zombie.getJobConf() results into NPE. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241845 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 10:15:41 +00:00
Arun Murthy
647f374607 Preparing for release 0.23.1 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241795 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 07:27:58 +00:00
Arun Murthy
1de681b896 MAPREDUCE-3828. Ensure that urls in single-node mode are correct. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241791 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 07:12:24 +00:00
Arun Murthy
4018798d4b MAPREDUCE-3415. Moving to 0.23.1 section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241752 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 02:59:21 +00:00
Vinod Kumar Vavilapalli
7ae94c6678 MAPREDUCE-3834. Changed MR AM to not add the same rack entry multiple times into the container request table when multiple hosts for a split happen to be on the same rack. Contributed by Siddarth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241734 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 01:56:02 +00:00
Siddharth Seth
5fdfa2b4bd MAPREDUCE-3822. Changed FS counter computation to use all occurences of the same FS scheme, instead of randomly using one. (Contributed by Mahadev Konar) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241721 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 00:56:28 +00:00
Arun Murthy
04f685ea76 MAPREDUCE-3827. Changed Counters to use ConcurrentSkipListMap for performance. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241711 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 00:16:54 +00:00
Siddharth Seth
ccc2807d86 MAPREDUCE-3823. Ensure counters are calculated only once after a job finishes. (Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241692 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 23:07:03 +00:00
Arun Murthy
d8e9f84fb1 Fixed jira id in commit for MAPREDUCE-3826. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241688 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 23:04:29 +00:00
Arun Murthy
7dfe20d5a8 MAPREDUCE-3823. Fixed a bug in RM web-ui which broke sorting. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241685 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 22:59:58 +00:00
Arun Murthy
59b88655bc MAPREDUCE-3833. Fixed a bug in reinitiaziling of queues. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241659 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 22:08:55 +00:00
Vinod Kumar Vavilapalli
90bc439b66 MAPREDUCE-3815. Fixed MR AM to always use hostnames and never IPs when requesting containers so that scheduler can give off data local containers correctly. Contributed by Siddarth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241654 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 21:58:54 +00:00
Siddharth Seth
fb498926be MAPREDUCE-3436. JobHistory webapp address should use the host configured in the jobhistory address. (Contributed by Ahmed Radwan) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241620 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 20:55:10 +00:00
Mahadev Konar
aaace5e84e MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241325 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 01:53:54 +00:00
Arun Murthy
6e376a39a0 MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241323 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 01:49:50 +00:00
Arun Murthy
35f12b9556 MAPREDUCE-3697. Support binary compatibility for Counters after MAPREDUCE-901. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241319 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 01:41:28 +00:00
Mahadev Konar
59d1f07d6c MAPREDUCE-3794. Support mapred.Task.Counter and mapred.JobInProgress.Counter enums for compatibility (Tom White via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241299 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 00:53:36 +00:00