big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,416 Commits 2 Branches 2 Tags 264 MiB
5690b51ef7
Commit Graph

15416 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Thomas Graves
d99c2958dd MAPREDUCE-3672. Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS. (Anupam Seth via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309401 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 14:17:22 +00:00
Todd Lipcon
dae6daba8c HADOOP-8007. Use substitution tokens for fencing argument. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309285 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 08:27:16 +00:00
Aaron Myers
7525ee5b67 HDFS-3000. Add a public API for setting quotas. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309227 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 03:18:49 +00:00
Tsz-wo Sze
8c0366bf10 HDFS-3168. Remove unnecessary "throw IOException" and change fields to final in FSNamesystem and BlockManager. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309218 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 02:51:34 +00:00
Todd Lipcon
30e1b3bba8 HADOOP-8215. Security support for ZK Failover controller. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309185 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 23:37:15 +00:00
Todd Lipcon
9972a9633d HDFS-3187. Upgrade guava to 11.0.2. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309181 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 22:30:29 +00:00
Todd Lipcon
39a5fd5c71 Merge trunk into auto-failover branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309164 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 21:48:23 +00:00
Todd Lipcon
84ff2d6d06 HADOOP-8243. Security support broken in CLI (manual) failover controller. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309135 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 20:41:26 +00:00
Thomas Graves
1f4197984c MAPREDUCE-4020. Web services returns incorrect JSON for deep queue tree (Anupam Seth via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309133 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 20:39:08 +00:00
Tsz-wo Sze
e561cb9e78 HDFS-3176. Use MD5MD5CRC32FileChecksum.readFields() in JsonUtil . Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309114 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 19:44:53 +00:00
Robert Joseph Evans
7b387f55c3 MAPREDUCE-3999. Tracking link gives an error if the AppMaster hasn't started yet (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309108 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 19:37:46 +00:00
Tsz-wo Sze
0db8003e2e HDFS-3166. Add timeout to Hftp connections. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309103 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 19:26:57 +00:00
Robert Joseph Evans
b45c450026 MAPREDUCE-3988. mapreduce.job.local.dir doesn't point to a single directory on a node. (Eric Payne via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309086 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 18:29:40 +00:00
Robert Joseph Evans
20184e7ddc MAPREDUCE-4072. User set java.library.path seems to overwrite default creating problems native lib loading (Anupam Seth via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309077 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 18:01:43 +00:00
Robert Joseph Evans
949b34e722 Missed a test file as part of MAPREDUCE-4062 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309043 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 17:03:10 +00:00
Robert Joseph Evans
2b5c36b695 MAPREDUCE-4062. AM Launcher thread can hang forever (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309037 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 16:59:26 +00:00
Thomas Graves
00eb28d927 MAPREDUCE-4012 Hadoop Job setup error leaves no useful info to users. (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308976 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 15:27:46 +00:00
Robert Joseph Evans
8c8dbba8a6 MAPREDUCE-3983. TestTTResourceReporting can fail, and should just be deleted (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308957 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 14:47:35 +00:00
Robert Joseph Evans
4d876c7800 MAPREDUCE-4060. Multiple SLF4J binding warning (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308925 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 14:19:29 +00:00
Todd Lipcon
789ed57e71 HDFS-2185. HDFS portion of ZK-based FailoverController. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1308637 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 00:59:02 +00:00
Suresh Srinivas
e449de0526 HDFS-3126. Journal stream from Namenode to BackupNode needs to have timeout. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308636 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 00:55:08 +00:00
Eli Collins
4f15b9dfed HDFS-3148. The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308617 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 23:20:34 +00:00
Eli Collins
f44ca78179 Previous commit was for HDFS-3120, fixing up CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308615 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 23:15:43 +00:00
Eli Collins
72b3f302dc HDFS-3148. The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308614 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 23:13:06 +00:00
Robert Joseph Evans
01ce7ba3a4 MAPREDUCE-4024. RM webservices can't query on finalStatus (Tom Graves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308566 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 21:06:16 +00:00
Thomas Graves
bb74427da2 MAPREDUCE-4089. Hung Tasks never time out. (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308531 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 20:20:41 +00:00
Eli Collins
354025b6e7 MAPREDUCE-4095. TestJobInProgress#testLocality uses a bogus topology. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308519 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 20:04:31 +00:00
Robert Joseph Evans
3a8d123ccb MAPREDUCE-4092. commitJob Exception does not fail job (Jon Eagles via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308507 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 19:51:06 +00:00
Eli Collins
9b1d2949ae HADOOP-8242. AbstractDelegationTokenIdentifier: add getter methods for owner and realuser. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308485 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 19:22:10 +00:00
Robert Joseph Evans
57af34b776 Preping for 0.23.3 stabilization. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308473 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 19:13:53 +00:00
Eli Collins
950273bde4 HADOOP-8210. Common side of HDFS-3148: The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308457 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 18:49:06 +00:00
Tsz-wo Sze
bc13dfb142 HDFS-3130. Move fsdataset implementation to a package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308437 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 17:38:56 +00:00
Todd Lipcon
2fd05aa597 Merge trunk into auto-failover branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1308260 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 07:28:42 +00:00
Todd Lipcon
a4ccb8f504 HADOOP-8236. haadmin should have configurable timeouts for failover commands. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308235 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 03:48:28 +00:00
Eli Collins
be8a0d1e62 HDFS-3174. Fix assert in TestPendingDataNodeMessages. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308226 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 01:45:11 +00:00
Eli Collins
ad0c49ec31 Fixup CHANGES.txt for HDFS-3144. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308206 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 22:14:14 +00:00
Eli Collins
be7dd8333a HDFS-3144. Refactor DatanodeID#getName by use. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308205 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 22:12:12 +00:00
Eli Collins
78e3568340 HADOOP-8238. NetUtils#getHostNameOfIP blows up if given ip:port string w/o port. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308192 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 20:07:03 +00:00
Uma Maheswara Rao G
2c47463cba HADOOP-8199. Fix issues in start-all.sh and stop-all.sh Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308180 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 19:00:38 +00:00
Eli Collins
43afa4ee51 HDFS-2995. start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configured. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308174 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 18:41:58 +00:00
Aaron Myers
a232d5c791 HDFS-3167. CLI-based driver for MiniDFSCluster. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308159 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 17:27:54 +00:00
Eli Collins
0663dbaac0 HDFS-3171. The DatanodeID "name" field is overloaded. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308014 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 03:41:41 +00:00
Eli Collins
eacd9abf50 HADOOP-8211. Update commons-net version to 3.1. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308006 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 02:52:15 +00:00
Eli Collins
8bd825bb6f HDFS-3164. Move DatanodeInfo#hostName to DatanodeID. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307890 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-31 19:58:51 +00:00
Eli Collins
eeb687daa7 HDFS-3172. dfs.upgrade.permission is dead code. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307888 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-31 19:56:23 +00:00
Aaron Myers
ff897e75c9 HDFS-3070. HDFS balancer doesn't ensure that hdfs-site.xml is loaded. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307841 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-31 16:20:54 +00:00
Ravi Gummadi
170ff8d81c MAPREDUCE-4087. [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases (ravigummadi) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307740 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-31 08:24:15 +00:00
Alejandro Abdelnur
c4c7ee5b8c MAPREDUCE-4091. tools testcases failing because of MAPREDUCE-4082 (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307623 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 21:30:11 +00:00
Todd Lipcon
543701387f HADOOP-8228. Auto HA: Refactor tests and add stress tests. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307599 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 20:30:47 +00:00
Todd Lipcon
6693167028 HADOOP-8220. ZKFailoverController doesn't handle failure to become active correctly. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307596 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 20:23:59 +00:00