big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,659 Commits 2 Branches 2 Tags 264 MiB
547d2b0bac
Commit Graph

4659 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Robert Joseph Evans
c156906c73 MAPREDUCE-4051. Remove the empty hadoop-mapreduce-project/assembly/all.xml file (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310528 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 18:09:09 +00:00
Tsz-wo Sze
58e920d1a0 HDFS-2505. Add a test to verify getFileChecksum(..) with ViewFS. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310522 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 18:04:05 +00:00
Robert Joseph Evans
534591697c HADOOP-8014. ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310507 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 17:54:40 +00:00
Suresh Srinivas
b3ac25048c HDFS-3136. Remove SLF4J dependency as HDFS does not need it to fix unnecessary warnings. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310476 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 16:50:31 +00:00
Robert Joseph Evans
2bb3407af9 MAPREDUCE-4111. Fix tests in org.apache.hadoop.mapred.TestJobName (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310431 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 16:04:40 +00:00
Robert Joseph Evans
b447d94094 MAPREDUCE-4112. Fix tests org.apache.hadoop.mapred.TestClusterMapReduceTestCase (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310418 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 15:57:39 +00:00
Robert Joseph Evans
adeef5ec8f MAPREDUCE-4113. Fix tests org.apache.hadoop.mapred.TestClusterMRNotification (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310409 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 15:49:52 +00:00
Alejandro Abdelnur
90d9cab02e HADOOP-8249. invalid hadoop-auth cookies should trigger authentication if info is avail before returning HTTP 401 (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310235 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 08:45:36 +00:00
Alejandro Abdelnur
31aee4aa2a HADOOP-8086. KerberosName silently sets defaultRealm to empty if the Kerberos config is not found, it should log a WARN (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310233 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 08:42:37 +00:00
Todd Lipcon
d166bd184d HDFS-3110. Use directRead API to reduce the number of buffer copies in libhdfs. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310185 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 06:31:10 +00:00
Todd Lipcon
b455e54749 Fix trivial mistake in test code in previous merge - tests were failing due to misuse of NodeFencer.create 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310176 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 05:32:02 +00:00
Todd Lipcon
30068a1d83 Merge trunk into auto-failover branch. 
Addressed two semantic conflicts after the commit of HADOOP-8077 -- test code was referencing the old constant for the fencing methods config key.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310174 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 05:07:33 +00:00
Todd Lipcon
d483b6f3fc HADOOP-8077. HA: fencing method should be able to be configured on a per-NN or per-NS basis. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310173 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 04:56:26 +00:00
Todd Lipcon
04cc1d614d HADOOP-8251. Fix SecurityUtil.fetchServiceTicket after HADOOP-6941. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310168 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 04:47:05 +00:00
Todd Lipcon
844faefd08 HDFS-3200. Scope all ZKFC configurations by nameservice. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310165 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 04:27:44 +00:00
Eli Collins
e505b7e704 HDFS-3208. Bogus entries in hosts files are incorrectly displayed in the report. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310138 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 00:20:55 +00:00
Eli Collins
112c324151 HDFS-3210. JsonUtil#toJsonMap for for a DatanodeInfo should use "ipAddr" instead of "name". Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310135 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 00:10:54 +00:00
Suresh Srinivas
861c872541 HDFS-3204. Minor modification to JournalProtocol.proto to make it generic. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310134 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 00:08:19 +00:00
Tsz-wo Sze
80bbefafaf HDFS-3178. Add states and state handler for journal synchronization in JournalService. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310115 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 22:35:53 +00:00
Robert Joseph Evans
c76b264196 MAPREDUCE-4073. CS assigns multiple off-switch containers when using multi-level-queues (Siddharth Seth via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310056 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 20:27:55 +00:00
Thomas Graves
98df316058 MAPREDUCE-3621. TestDBJob and TestDataDrivenDBInputFormat ant tests fail (Ravi Prakash via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310043 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 20:11:52 +00:00
Thomas Graves
f843f590f1 HADOOP-8180. Remove hsqldb since its not needed from pom.xml (Ravi Prakash via tgraves 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310036 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 19:38:45 +00:00
Robert Joseph Evans
76ec7a1c6b Moved HADOOP-6963 to 0.23.3 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310022 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 19:18:16 +00:00
Tsz-wo Sze
bf5b508074 HADOOP-6963. In FileUtil.getDU(..), neither include the size of directories nor follow symbolic links. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309994 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 18:28:34 +00:00
Suresh Srinivas
4c908d0987 HDFS-3109. Remove hsqldf exclusions from pom.xml. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309971 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 17:42:46 +00:00
Aaron Myers
8e739ff01e HDFS-3202. NamespaceInfo PB translation drops build version. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309955 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 17:18:26 +00:00
Robert Joseph Evans
85a76eb319 HADOOP-7757. Test file reference count is at least 3x actual value (Jon Eagles via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309864 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 13:57:09 +00:00
Eli Collins
663fbd46a8 HDFS-3199. TestValidateConfigurationSettings is failing. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309641 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 03:31:03 +00:00
Eli Collins
4f6e0a5a65 HDFS-3050. rework OEV to share more code with the NameNode. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309629 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 00:02:11 +00:00
Aaron Myers
8a109ebebb HADOOP-8244. Improve comments on ByteBufferReadable.read. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309625 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 23:36:29 +00:00
Alejandro Abdelnur
1d6038ecfb MAPREDUCE-4097. tools testcases fail because missing mrapp-generated-classpath file in classpath (rvs via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309583 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 20:24:01 +00:00
Aaron Myers
ba688e11c1 HDFS-3102. Add CLI tool to initialize the shared-edits dir. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309580 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 20:15:08 +00:00
Todd Lipcon
00a1548005 Merge trunk into auto-HA branch 
Resolved some trivial conflicts in NNHAServiceTarget


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309576 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 20:00:15 +00:00
Robert Joseph Evans
fcacb14a1e HADOOP-8179. risk of NPE in CopyCommands processArguments() (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309572 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 19:53:09 +00:00
Todd Lipcon
b74d742785 HADOOP-8245. Fix flakiness in TestZKFailoverController. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309554 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 19:21:01 +00:00
Todd Lipcon
1b93f8e5c3 MAPREDUCE-4103. Fix HA docs for changes to shell command fencer args. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309533 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 18:46:22 +00:00
Todd Lipcon
a7d6bdc63b HDFS-3084. FenceMethod.tryFence() and ShellCommandFencer should pass namenodeId as well as host:port. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309526 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 18:40:43 +00:00
Eli Collins
4f7f58fa8b Updated CHANGES.txt to reflect HDFS-2564 merge 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309488 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 16:40:08 +00:00
Robert Joseph Evans
db075f93ae MAPREDUCE-3650. testGetTokensForHftpFS() fails (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309481 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 16:23:29 +00:00
Robert Joseph Evans
594dd9eb25 MAPREDUCE-3082. Archive command take wrong path for input file with current directory (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309453 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 15:28:17 +00:00
Thomas Graves
4e44259cbd MAPREDUCE-3682 Tracker URL says AM tasks run on localhost. (Ravi Prakash via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309440 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 15:08:39 +00:00
Robert Joseph Evans
b518a98169 moved HADOOP-8088 to 0.23.3 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309436 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 14:59:40 +00:00
Alejandro Abdelnur
da1b01c9e3 MAPREDUCE-4098. TestMRApps testSetClasspath fails (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309432 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 14:56:13 +00:00
Thomas Graves
d99c2958dd MAPREDUCE-3672. Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS. (Anupam Seth via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309401 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 14:17:22 +00:00
Todd Lipcon
dae6daba8c HADOOP-8007. Use substitution tokens for fencing argument. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309285 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 08:27:16 +00:00
Aaron Myers
7525ee5b67 HDFS-3000. Add a public API for setting quotas. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309227 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 03:18:49 +00:00
Tsz-wo Sze
8c0366bf10 HDFS-3168. Remove unnecessary "throw IOException" and change fields to final in FSNamesystem and BlockManager. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309218 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 02:51:34 +00:00
Todd Lipcon
30e1b3bba8 HADOOP-8215. Security support for ZK Failover controller. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309185 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 23:37:15 +00:00
Todd Lipcon
9972a9633d HDFS-3187. Upgrade guava to 11.0.2. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309181 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 22:30:29 +00:00
Todd Lipcon
39a5fd5c71 Merge trunk into auto-failover branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309164 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 21:48:23 +00:00