big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,100 Commits 2 Branches 2 Tags 264 MiB
cbed126eec
Commit Graph

4100 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tsz-wo Sze
c80dbe5e09 HDFS-2652. Add support for host-based delegation tokens. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327309 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 22:21:33 +00:00
Robert Joseph Evans
a15e69cb9f MAPREDUCE-4134. Remove references of mapred.child.ulimit etc. since they are not being used any more (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327304 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 22:05:42 +00:00
Thomas Graves
ca9f62121e MAPREDUCE-4151. RM scheduler web page should filter apps to those that are relevant to scheduling (Jason Lowe via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327263 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 20:05:44 +00:00
Thomas Graves
b89b6bd75f MAPREDUCE-4160. some mrv1 ant tests fail with timeout - due to 4156 (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327233 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 19:21:34 +00:00
Siddharth Seth
fe7711df98 MAPREDUCE-3942. Randomize master key generation for ApplicationTokenSecretManager and roll it every so often. (Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327220 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 18:48:42 +00:00
Aaron Myers
c21bd72a2f HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327182 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 17:06:38 +00:00
Aaron Myers
1675c18ded Revert HADOOP-8280 so it can be recommitted using `svn mv' 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327179 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 16:49:04 +00:00
Robert Joseph Evans
c7fb5ad40e Pulled HADOOP-8108 into branch-0.23 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327140 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 15:23:04 +00:00
Robert Joseph Evans
e8eed2f62d HADOOP-8227. Allow RPC to limit ephemeral port range. (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327127 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 15:04:20 +00:00
Robert Joseph Evans
a98ba41092 HADOOP-8286. Simplify getting a socket address from conf (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327108 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 14:21:11 +00:00
Eli Collins
207a2ada0c HADOOP-8282. start-all.sh refers incorrectly start-dfs.sh existence for starting start-yarn.sh. Contributed by Devaraj K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326890 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 02:44:06 +00:00
Eli Collins
1d5861a8c4 HDFS-3165. HDFS Balancer scripts are refering to wrong path of hadoop-daemon.sh. Contributed by Amith D K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326848 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 00:50:40 +00:00
Todd Lipcon
574f99bd6b HDFS-3284. bootstrapStandby fails in secure cluster. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326813 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 21:51:52 +00:00
Todd Lipcon
2d370ef2ba HADOOP-8117. Upgrade test build to Surefire 2.12. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326802 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 21:14:23 +00:00
Thomas Graves
159646f2a4 MAPREDUCE-4156. ant build fails compiling JobInProgress (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326795 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 20:46:30 +00:00
Tsz-wo Sze
f1667dee14 HDFS-3279. Move the FSEditLog constructor with @VisibleForTesting to TestEditLog. Contributed by Arpit Gupta 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326762 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 19:31:34 +00:00
Todd Lipcon
258da66cc7 HDFS-3268. FileContext API mishandles token service and incompatible with HA. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326747 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 19:08:29 +00:00
Aaron Myers
551468385c HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326727 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 18:28:36 +00:00
Thomas Graves
24d6a8b29c MAPREDUCE-4008. ResourceManager throws MetricsException on start up saying QueueMetrics MBean already exists (Devaraj K via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326707 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 18:02:51 +00:00
Robert Joseph Evans
fccbc53357 HADOOP-8283. Allow tests to control token service value (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326668 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 16:08:44 +00:00
Aaron Myers
15fe3ae61b HDFS-2708. Stats for the # of blocks per DN. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326039 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-14 01:51:03 +00:00
Tsz-wo Sze
841fdc5628 HDFS-3273. Refactor BackupImage and FSEditLog, and rename JournalListener.rollLogs(..) to startLogSegment(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326016 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 23:41:01 +00:00
Tsz-wo Sze
f694ecdd93 Add .classpath, .project and .settings to svn:ignore. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326015 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 23:38:59 +00:00
Aaron Myers
d6533cc321 Move CHANGES.txt message for HDFS-2765 to be under 2.0.0 instead of trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326013 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 23:32:17 +00:00
Siddharth Seth
9a10b4e773 MAPREDUCE-4144. Fix a NPE in the ResourceManager when handling node updates. (Contributed by Jason Lowe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325991 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 22:24:16 +00:00
Eli Collins
5a20d446cf HDFS-2799. Trim fs.checkpoint.dir values. Contributed by Amith D K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325963 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 21:31:27 +00:00
Robert Joseph Evans
27ea3ab6ba MAPREDUCE-4128. AM Recovery expects all attempts of a completed task to also be completed. (Bikas Saha via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325765 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 13:45:03 +00:00
Thomas White
02db5b7ef7 MAPREDUCE-4147. YARN should not have a compile-time dependency on HDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325573 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 00:10:30 +00:00
Tsz-wo Sze
10a0fcb62d Add .classpath, .project and .settings to svn:ignore. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325569 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 23:18:37 +00:00
Todd Lipcon
2ed825e66c HDFS-3159. Document NN auto-failover setup and configuration. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1325539 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 21:53:42 +00:00
Aaron Myers
4f230adc13 HDFS-3256. HDFS considers blocks under-replicated if topology script is configured with only 1 rack. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325531 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 21:28:44 +00:00
Aaron Myers
07a4367445 HDFS-3259. NameNode#initializeSharedEdits should populate shared edits dir with edit log segments. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325518 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 21:11:32 +00:00
Robert Joseph Evans
047a7b276c HADOOP-7510. Tokens should use original hostname provided instead of ip (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325500 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 20:43:18 +00:00
Siddharth Seth
ecb30a48c4 MAPREDUCE-4050. For tasks without assigned containers, changes the node text on the UI to N/A instead of a link to null. (Contributed by Bhallamudi Venkata Siva Kamesh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325435 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 18:39:49 +00:00
Todd Lipcon
72406e940a HDFS-3255. HA DFS returns wrong token service. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325414 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 18:08:00 +00:00
Eli Collins
f01ede227f HADOOP-8144. pseudoSortByDistance in NetworkTopology doesn't work properly if no local node and first node is local rack node. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325367 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 16:37:15 +00:00
Thomas White
346d50782d MAPREDUCE-4140. mapreduce classes incorrectly importing "clover.org.apache.*" classes. Contributed by Patrick Hunt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325352 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 16:22:25 +00:00
Amar Kamat
d310c48ce4 MAPREDUCE-4083. [Gridmix] NPE in cpu emulation. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325145 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 07:17:34 +00:00
Todd Lipcon
989d65ab97 HDFS-3261. TestHASafeMode fails on HDFS-3042 branch. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1325140 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 07:05:36 +00:00
Aaron Myers
4ea042666c HDFS-3260. TestDatanodeRegistration should set minimum DN version in addition to minimum NN version. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325119 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 05:27:03 +00:00
Aaron Myers
7f427646df HDFS-2983. Relax the build version check to permit rolling upgrades within a release. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325110 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 03:36:13 +00:00
Eli Collins
b31d9d9d86 HADOOP-8270. hadoop-daemon.sh stop action should return 0 for an already stopped service. Contributed by Roman Shaposhnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325069 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 23:57:12 +00:00
Thomas Graves
aca6ca0059 MAPREDUCE-4107. Fix tests in org.apache.hadoop.ipc.TestSocketFactory (Devaraj K via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325010 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 21:13:49 +00:00
Siddharth Seth
7809acd67b MAPREDUCE-3932. Fix the TaskAttempt state machine to handle CONTIANER_LAUNCHED and CONTIANER_LAUNCH_FAILED events in additional states. (Contributed by Robert Joseph Evans) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324902 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 18:18:40 +00:00
Tsz-wo Sze
ed678e52ce HDFS-3179. Improve the exception message thrown by DataStreamer when it failed to add a datanode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324892 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 17:49:28 +00:00
Siddharth Seth
cfafd8c29d MAPREDUCE-4099 amendment. ApplicationMaster will remove staging directory after the history service is stopped. (Contributed by Jason Lowe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324866 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 17:09:54 +00:00
Thomas Graves
bc2340e8b5 HADOOP-8147. test-patch should run tests with -fn to avoid masking test failures (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324816 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 15:24:19 +00:00
Todd Lipcon
6f2aae046d Resolve trivial compilation error after previous merge 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324570 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:52:31 +00:00
Todd Lipcon
2bf19979b3 Merge trunk into auto-failover branch. 
Needs a few tweaks to fix compilation - will do in followup commit. This is just a straight merge


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324567 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:47:40 +00:00
Todd Lipcon
41a014c31b HADOOP-8247. Add a config to enable auto-HA, which disables manual FailoverController. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324566 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:40:26 +00:00