big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,072 Commits 2 Branches 2 Tags 264 MiB
b5a2dd19c4
Commit Graph

4072 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Robert Joseph Evans
e3806060ce MAPREDUCE-4159. Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328031 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 16:22:22 +00:00
Robert Joseph Evans
f6cadd8610 HADOOP-8288. Remove references of mapred.child.ulimit etc. since they are not being used any more (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328018 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 16:05:34 +00:00
Thomas Graves
97ae5b675f MAPREDUCE-4074. Client continuously retries to RM When RM goes down before launching Application Master (xieguiming via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327972 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 14:44:57 +00:00
Amar Kamat
3edc40e377 MAPREDUCE-4100. [Gridmix] Bug fixed in compression emulation feature for map only jobs. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327816 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 04:26:53 +00:00
Uma Maheswara Rao G
ba4ec5f0aa iHDFS-3282. Expose getFileLength API. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327790 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 02:41:32 +00:00
Uma Maheswara Rao G
c6d3537d33 HDFS-3282. Expose getFileLength API. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327788 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 02:34:44 +00:00
Eli Collins
4550627cab HDFS-3169. TestFsck should test multiple -move operations in a row. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327776 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 01:51:13 +00:00
Eli Collins
54e61ffdc0 HDFS-3206. Miscellaneous xml cleanups for OEV. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327768 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 01:31:53 +00:00
Eli Collins
0c16ec4d6e HDFS-891. DataNode no longer needs to check for dfs.network.script. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327762 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 01:09:12 +00:00
Todd Lipcon
ca49126e3d Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1327724 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 23:35:30 +00:00
Todd Lipcon
cc052d2a4a Move HADOOP-8117 from 3.0 to 2.0 in CHANGES.txt after commit to branch-2 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327707 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 22:22:49 +00:00
Tsz-wo Sze
2bf8be3c72 HDFS-3292. Remove the deprecated DiskStatus, getDiskStatus(), getRawCapacity() and getRawUsed() from DistributedFileSystem. Contributed by Arpit Gupta 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327664 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 20:21:08 +00:00
Alejandro Abdelnur
8bda086d04 HDFS-3263. HttpFS should read HDFS config from Hadoop site.xml files (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327627 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 18:51:22 +00:00
Robert Joseph Evans
32d511065a MAPREDUCE-4161. create sockets consistently (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327621 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 18:46:34 +00:00
Harsh J
4e4ba4cd90 HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327618 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 18:44:18 +00:00
Harsh J
6b69ba6ba1 Reverting all commit booboos made on HADOOP-8290. Resetting to state before that. Sorry for so much noise. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327616 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 18:42:09 +00:00
Harsh J
d34fee4aa3 HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh) (fixed commit after revert) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327615 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 18:36:35 +00:00
Harsh J
3ac28085a7 HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh) (fixed commit) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327611 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 18:33:57 +00:00
Harsh J
14c61e6504 HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327609 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 18:29:11 +00:00
Ravi Gummadi
2ada53f107 MAPREDUCE-4149. [Rumen] Rumen fails to parse certain counter strings. (ravigummadi) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327461 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 11:59:38 +00:00
Tsz-wo Sze
eeec4dc72a HDFS-3294. Fix code indentation in NamenodeWebHdfsMethods and DatanodeWebHdfsMethods. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327365 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 03:25:08 +00:00
Siddharth Seth
7d04a96027 MAPREDUCE-3972. Fix locking and exception issues in JobHistory server. (Contributed by Robert Joseph Evans) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327354 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 01:59:16 +00:00
Tsz-wo Sze
c80dbe5e09 HDFS-2652. Add support for host-based delegation tokens. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327309 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 22:21:33 +00:00
Robert Joseph Evans
a15e69cb9f MAPREDUCE-4134. Remove references of mapred.child.ulimit etc. since they are not being used any more (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327304 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 22:05:42 +00:00
Thomas Graves
ca9f62121e MAPREDUCE-4151. RM scheduler web page should filter apps to those that are relevant to scheduling (Jason Lowe via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327263 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 20:05:44 +00:00
Thomas Graves
b89b6bd75f MAPREDUCE-4160. some mrv1 ant tests fail with timeout - due to 4156 (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327233 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 19:21:34 +00:00
Siddharth Seth
fe7711df98 MAPREDUCE-3942. Randomize master key generation for ApplicationTokenSecretManager and roll it every so often. (Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327220 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 18:48:42 +00:00
Aaron Myers
c21bd72a2f HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327182 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 17:06:38 +00:00
Aaron Myers
1675c18ded Revert HADOOP-8280 so it can be recommitted using `svn mv' 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327179 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 16:49:04 +00:00
Robert Joseph Evans
c7fb5ad40e Pulled HADOOP-8108 into branch-0.23 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327140 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 15:23:04 +00:00
Robert Joseph Evans
e8eed2f62d HADOOP-8227. Allow RPC to limit ephemeral port range. (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327127 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 15:04:20 +00:00
Robert Joseph Evans
a98ba41092 HADOOP-8286. Simplify getting a socket address from conf (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327108 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 14:21:11 +00:00
Eli Collins
207a2ada0c HADOOP-8282. start-all.sh refers incorrectly start-dfs.sh existence for starting start-yarn.sh. Contributed by Devaraj K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326890 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 02:44:06 +00:00
Eli Collins
1d5861a8c4 HDFS-3165. HDFS Balancer scripts are refering to wrong path of hadoop-daemon.sh. Contributed by Amith D K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326848 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 00:50:40 +00:00
Todd Lipcon
574f99bd6b HDFS-3284. bootstrapStandby fails in secure cluster. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326813 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 21:51:52 +00:00
Todd Lipcon
2d370ef2ba HADOOP-8117. Upgrade test build to Surefire 2.12. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326802 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 21:14:23 +00:00
Thomas Graves
159646f2a4 MAPREDUCE-4156. ant build fails compiling JobInProgress (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326795 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 20:46:30 +00:00
Tsz-wo Sze
f1667dee14 HDFS-3279. Move the FSEditLog constructor with @VisibleForTesting to TestEditLog. Contributed by Arpit Gupta 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326762 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 19:31:34 +00:00
Todd Lipcon
258da66cc7 HDFS-3268. FileContext API mishandles token service and incompatible with HA. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326747 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 19:08:29 +00:00
Aaron Myers
551468385c HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326727 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 18:28:36 +00:00
Thomas Graves
24d6a8b29c MAPREDUCE-4008. ResourceManager throws MetricsException on start up saying QueueMetrics MBean already exists (Devaraj K via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326707 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 18:02:51 +00:00
Robert Joseph Evans
fccbc53357 HADOOP-8283. Allow tests to control token service value (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326668 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 16:08:44 +00:00
Aaron Myers
15fe3ae61b HDFS-2708. Stats for the # of blocks per DN. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326039 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-14 01:51:03 +00:00
Tsz-wo Sze
841fdc5628 HDFS-3273. Refactor BackupImage and FSEditLog, and rename JournalListener.rollLogs(..) to startLogSegment(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326016 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 23:41:01 +00:00
Tsz-wo Sze
f694ecdd93 Add .classpath, .project and .settings to svn:ignore. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326015 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 23:38:59 +00:00
Aaron Myers
d6533cc321 Move CHANGES.txt message for HDFS-2765 to be under 2.0.0 instead of trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326013 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 23:32:17 +00:00
Siddharth Seth
9a10b4e773 MAPREDUCE-4144. Fix a NPE in the ResourceManager when handling node updates. (Contributed by Jason Lowe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325991 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 22:24:16 +00:00
Eli Collins
5a20d446cf HDFS-2799. Trim fs.checkpoint.dir values. Contributed by Amith D K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325963 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 21:31:27 +00:00
Robert Joseph Evans
27ea3ab6ba MAPREDUCE-4128. AM Recovery expects all attempts of a completed task to also be completed. (Bikas Saha via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325765 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 13:45:03 +00:00
Thomas White
02db5b7ef7 MAPREDUCE-4147. YARN should not have a compile-time dependency on HDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325573 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 00:10:30 +00:00