big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
5,097 Commits 2 Branches 2 Tags 264 MiB
8a4ff65b3c
Commit Graph

5097 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Todd Lipcon
789ed57e71 HDFS-2185. HDFS portion of ZK-based FailoverController. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1308637 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 00:59:02 +00:00
Suresh Srinivas
e449de0526 HDFS-3126. Journal stream from Namenode to BackupNode needs to have timeout. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308636 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 00:55:08 +00:00
Eli Collins
4f15b9dfed HDFS-3148. The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308617 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 23:20:34 +00:00
Eli Collins
f44ca78179 Previous commit was for HDFS-3120, fixing up CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308615 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 23:15:43 +00:00
Eli Collins
72b3f302dc HDFS-3148. The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308614 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 23:13:06 +00:00
Robert Joseph Evans
01ce7ba3a4 MAPREDUCE-4024. RM webservices can't query on finalStatus (Tom Graves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308566 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 21:06:16 +00:00
Thomas Graves
bb74427da2 MAPREDUCE-4089. Hung Tasks never time out. (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308531 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 20:20:41 +00:00
Eli Collins
354025b6e7 MAPREDUCE-4095. TestJobInProgress#testLocality uses a bogus topology. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308519 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 20:04:31 +00:00
Robert Joseph Evans
3a8d123ccb MAPREDUCE-4092. commitJob Exception does not fail job (Jon Eagles via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308507 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 19:51:06 +00:00
Eli Collins
9b1d2949ae HADOOP-8242. AbstractDelegationTokenIdentifier: add getter methods for owner and realuser. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308485 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 19:22:10 +00:00
Robert Joseph Evans
57af34b776 Preping for 0.23.3 stabilization. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308473 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 19:13:53 +00:00
Eli Collins
950273bde4 HADOOP-8210. Common side of HDFS-3148: The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308457 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 18:49:06 +00:00
Tsz-wo Sze
bc13dfb142 HDFS-3130. Move fsdataset implementation to a package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308437 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 17:38:56 +00:00
Todd Lipcon
2fd05aa597 Merge trunk into auto-failover branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1308260 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 07:28:42 +00:00
Todd Lipcon
a4ccb8f504 HADOOP-8236. haadmin should have configurable timeouts for failover commands. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308235 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 03:48:28 +00:00
Eli Collins
be8a0d1e62 HDFS-3174. Fix assert in TestPendingDataNodeMessages. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308226 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 01:45:11 +00:00
Eli Collins
ad0c49ec31 Fixup CHANGES.txt for HDFS-3144. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308206 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 22:14:14 +00:00
Eli Collins
be7dd8333a HDFS-3144. Refactor DatanodeID#getName by use. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308205 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 22:12:12 +00:00
Eli Collins
78e3568340 HADOOP-8238. NetUtils#getHostNameOfIP blows up if given ip:port string w/o port. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308192 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 20:07:03 +00:00
Uma Maheswara Rao G
2c47463cba HADOOP-8199. Fix issues in start-all.sh and stop-all.sh Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308180 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 19:00:38 +00:00
Eli Collins
43afa4ee51 HDFS-2995. start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configured. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308174 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 18:41:58 +00:00
Aaron Myers
a232d5c791 HDFS-3167. CLI-based driver for MiniDFSCluster. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308159 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 17:27:54 +00:00
Eli Collins
0663dbaac0 HDFS-3171. The DatanodeID "name" field is overloaded. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308014 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 03:41:41 +00:00
Eli Collins
eacd9abf50 HADOOP-8211. Update commons-net version to 3.1. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308006 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 02:52:15 +00:00
Eli Collins
8bd825bb6f HDFS-3164. Move DatanodeInfo#hostName to DatanodeID. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307890 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-31 19:58:51 +00:00
Eli Collins
eeb687daa7 HDFS-3172. dfs.upgrade.permission is dead code. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307888 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-31 19:56:23 +00:00
Aaron Myers
ff897e75c9 HDFS-3070. HDFS balancer doesn't ensure that hdfs-site.xml is loaded. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307841 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-31 16:20:54 +00:00
Ravi Gummadi
170ff8d81c MAPREDUCE-4087. [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases (ravigummadi) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307740 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-31 08:24:15 +00:00
Alejandro Abdelnur
c4c7ee5b8c MAPREDUCE-4091. tools testcases failing because of MAPREDUCE-4082 (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307623 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 21:30:11 +00:00
Todd Lipcon
543701387f HADOOP-8228. Auto HA: Refactor tests and add stress tests. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307599 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 20:30:47 +00:00
Todd Lipcon
6693167028 HADOOP-8220. ZKFailoverController doesn't handle failure to become active correctly. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307596 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 20:23:59 +00:00
Eli Collins
a8cbf19548 HDFS-3138. Move DatanodeInfo#ipcPort to DatanodeID. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307553 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 17:50:05 +00:00
Alejandro Abdelnur
d1893c8f5b MAPREDUCE-3916. various issues with running yarn proxyserver (devaraj via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307413 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 13:40:48 +00:00
Eli Collins
c5c476ed6a Move HDFS-3137 to the right place in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307174 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 00:13:50 +00:00
Eli Collins
64641c28b5 HDFS-3137. Bump LAST_UPGRADABLE_LAYOUT_VERSION to -16. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307173 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 00:11:14 +00:00
Aaron Myers
51908783be HDFS-3142. TestHDFSCLI.testAll is failing. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307134 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 22:00:39 +00:00
Todd Lipcon
04416861eb Amend HADOOP-8212 (Improve ActiveStandbyElector's behavior when session expires) 
Amendment patch incorporates following feedback from Bikas Saha:
- adds a new functional test for session expiration while in the standby state
- adds a safety check in the StatCallback for session expiration
- improves some comments


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307128 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 21:49:37 +00:00
Alejandro Abdelnur
57e175fddf hadoop-mapreduce-client-app's mrapp-generated-classpath file should not be in the module JAR (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307124 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 21:43:50 +00:00
Eli Collins
9b588ed924 HADOOP-8149. Cap space usage of default log4j rolling policy. Contributed by Patrick Hunt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307106 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 21:00:35 +00:00
Eli Collins
d05cc8e5cd MAPREDUCE-3989. Cap space usage of default log4j rolling policy. Contributed by Patrick Hunt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307102 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 20:53:44 +00:00
Eli Collins
da58921cf5 HDFS-3066. Cap space usage of default log4j rolling policy. Contributed by Patrick Hunt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307100 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 20:51:29 +00:00
Eli Collins
978404d1a8 HADOOP-8208. Disallow self failover. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306935 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 15:48:58 +00:00
Robert Joseph Evans
f11a5dc5f6 MAPREDUCE-4081. TestMROutputFormat.java does not compile (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306901 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 15:18:41 +00:00
Arun Murthy
9bb6a025de MAPREDUCE-3377. Added a unit test to ensure OutputCommitter.checkOutputSpecs is called prior to copying job.xml. Contributed by Jane Chen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306736 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 07:45:45 +00:00
Siddharth Seth
db3e592df0 REDUCE-3955. Change MR to use ProtobufRpcEngine from hadoop-common instead of ProtoOverHadoopRpcEngine. (Contributed by Jitendra Nath Pandey) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306689 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 02:02:17 +00:00
Eli Collins
e7444b2a07 HDFS-3160. httpfs should exec catalina instead of forking it. Contributed by Roman Shaposhnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306665 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 01:16:02 +00:00
Aaron Myers
17d22e6dc4 HDFS-3158. LiveNodes member of NameNodeMXBean should list non-DFS used space and capacity per DN. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306635 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 22:59:52 +00:00
Todd Lipcon
a9471b97c1 Merge trunk into HDFS-3042 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1306587 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 20:45:13 +00:00
Tsz-wo Sze
99a68a1423 HDFS-3155. Clean up FSDataset implemenation related code. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306582 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 20:37:34 +00:00
Eli Collins
0475795066 HDFS-3139. Minor Datanode logging improvement. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306549 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 19:33:22 +00:00