big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
7,685 Commits 2 Branches 2 Tags 264 MiB
3671a5e16f
Commit Graph

7685 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tsz-wo Sze
5b7c0b6a45 MAPREDUCE-2805. Update RAID for HDFS-2241. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156513 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 07:09:27 +00:00
Tsz-wo Sze
6a7c0306bd HDFS-2245. Fix a NullPointerException in BlockManager.chooseTarget(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156490 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 05:24:55 +00:00
Tsz-wo Sze
cde987996a HDFS-2237. Change UnderReplicatedBlocks from public to package private. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156424 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 01:05:45 +00:00
Suresh Srinivas
95ecc91463 Ignore CHANGES.HDFS-1623.txt from release audit warnings 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1156421 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 00:48:16 +00:00
Suresh Srinivas
ef223e8e8e HDFS-2241. Remove implementing FSConstants interface to just get the constants from the interface. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156420 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 00:46:31 +00:00
Suresh Srinivas
73f2092b73 HDFS-1974. Introduce active and standy states to the namenode. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1156418 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 00:44:05 +00:00
Suresh Srinivas
2a990ed646 HADOOP-7472. RPC client should deal with IP address change. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156350 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 20:22:55 +00:00
Tsz-wo Sze
2d653c994c MAPREDUCE-2797. Update mapreduce tests and RAID for HDFS-2239. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156215 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 15:10:20 +00:00
Tsz-wo Sze
5d5b1c6c10 HDFS-2239. Reduce access levels of the fields and methods in FSNamesystem. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155998 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 01:50:51 +00:00
Todd Lipcon
eb6e44b1ba HDFS-2227. getRemoteEditLogManifest should pull its information from FileJournalManager during checkpoint process. Contributed by Ivan Kelly and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155977 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 00:01:39 +00:00
Thomas White
27b66e2bba HADOOP-7525. Make arguments to test-patch optional. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155551 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-09 20:28:48 +00:00
Thomas White
0a2b40fad5 HADOOP-7528. Maven build fails in Windows. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155448 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-09 18:03:00 +00:00
Giridharan Kesavan
a523fbdb6c HDFS-2230. Fix ivy conf to resolve/retrieve latest common-tests jar published by hadoop common maven build. (gkesavan) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155123 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-08 22:09:28 +00:00
Tsz-wo Sze
498e290103 HDFS-2238. In NamenodeFsck.toString(), uses StringBuilder.(..) instead of string concatenation. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154973 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-08 14:27:53 +00:00
Tsz-wo Sze
371f4a5905 HDFS-2228. Move block and datanode code from FSNamesystem to BlockManager and DatanodeManager. (szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154899 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-08 10:06:45 +00:00
Thomas White
8dc420ba36 HADOOP-7523. Test org.apache.hadoop.fs.TestFilterFileSystem fails due to java.lang.NoSuchMethodException. Contributed by John Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154817 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-08 04:36:46 +00:00
Todd Lipcon
62f27b5729 Edit change log entry for HDFS-2225 by request of Nicholas 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154414 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 23:42:09 +00:00
Suresh Srinivas
f0ecbd0043 Create CHANGES.HDFS-1623.txt for HDFS-1623 branch changes and move one change from CHANGES.txt into it. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1154410 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 23:04:24 +00:00
Giridharan Kesavan
3864369a58 HADOOP-7520. Fix to add distribution management info to hadoop-main. Contributed by Alejandro Abdelnur 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154350 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 18:47:53 +00:00
Thomas White
ca4b2f108a HADOOP-7515. test-patch reports the wrong number of javadoc warnings. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154240 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 14:28:30 +00:00
Todd Lipcon
a61b24a6da HDFS-2226. Clean up counting of operations in FSEditLogLoader. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154098 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 06:03:19 +00:00
Suresh Srinivas
9145ab5887 HADOOP-7455. HA: Introduce HA Service Protocol Interface. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1154063 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 01:34:32 +00:00
Thomas White
acd3ab521f Fix svn:ignore properties following HADOOP-6671. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154052 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 00:37:57 +00:00
Todd Lipcon
e639c3357b HADOOP-7445. Implement bulk checksum verification using efficient native code. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154043 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 22:57:01 +00:00
Tsz-wo Sze
7fac946ac9 HDFS-2108. Move datanode heartbeat handling from namenode package to blockmanagement package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154042 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 22:55:48 +00:00
Todd Lipcon
23762da4fa HDFS-2225. Refactor file management so it's not in classes which should be generic. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154029 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 21:56:17 +00:00
Todd Lipcon
53190cfa1d HDFS-2187. Make EditLogInputStream act like an iterator over FSEditLogOps. Contributed by Ivan Kelly and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153996 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 20:22:13 +00:00
Todd Lipcon
bed3495263 Add another license header missing from HDFS-2179 commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1153969 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 18:58:44 +00:00
Todd Lipcon
3f85da7aa9 Add Apache license header to StreamPumper.java missing in HDFS-2179 commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1153940 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 17:26:12 +00:00
Todd Lipcon
05c24937cf HDFS-2179. Add fencing framework and mechanisms for NameNode HA. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1153939 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 17:24:57 +00:00
Todd Lipcon
57213dbcb5 Add a CHANGES.txt file for HDFS-1623 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1153937 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 17:23:57 +00:00
Todd Lipcon
218e96a4bf Merge trunk into HA branch after mavenization of hadoop-common 
(no conflicts, straight SVN merge)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1153931 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 17:09:14 +00:00
Thomas White
924ed13664 HDFS-2196. Make ant build system work with hadoop-common JAR generated by Maven. Fix for fusedfs contributed by szetszwo 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153928 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 17:01:41 +00:00
Devaraj Das
703b5f412c MAPREDUCE-2705. Permits parallel multiple task launches. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153720 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 01:31:05 +00:00
Devaraj Das
44b7e03114 MAPREDUCE-2705. Permits parallel multiple task launches. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153717 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 01:15:33 +00:00
Thomas White
2025d4e032 HADOOP-7508. Compiled nativelib is in wrong directory and it is not picked up by surefire setup. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153689 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-03 22:22:49 +00:00
Thomas White
2db9aab9d7 HADOOP-7501. Publish Hadoop Common artifacts (post HADOOP-6671) to Apache SNAPSHOTs repo. Contributed by Alejandro Abdelnur 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153597 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-03 17:52:00 +00:00
Luke Lu
12e09b229f HADOOP-7502. Make generated sources IDE friendly. (Alejandro Abdelnur via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153586 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-03 17:13:24 +00:00
Eli Collins
102b94d3a8 MAPREDUCE-2760. mapreduce.jobtracker.split.metainfo.maxsize typoed in mapred-default.xml. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153260 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 20:05:20 +00:00
Thomas White
44501d88e2 MAPREDUCE-2741. Make ant build system work with hadoop-common JAR generated by Maven. Contributed Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153209 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 17:26:09 +00:00
Thomas White
b71b47079e HDFS-2196. Make ant build system work with hadoop-common JAR generated by Maven. Contributed by Alejandro Abdelnur 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153207 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 17:16:59 +00:00
Thomas White
ddc3f5d105 Reinstate common/src/test/bin (used by externals) which was mistakenly deleted in HADOOP-6671 commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153197 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 17:02:47 +00:00
Thomas White
0f6dfeeacb HADOOP-6671. Use maven for hadoop common builds. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153184 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 16:37:57 +00:00
Arun Murthy
9bac807ced MAPREDUCE-2187. Reporter sends progress during sort/merge. Contributed by Anupam Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152964 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 22:53:08 +00:00
Todd Lipcon
22f232bce2 MAPREDUCE-2740. MultipleOutputs in new API creates needless TaskAttemptContexts. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152875 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 17:52:49 +00:00
Tsz-wo Sze
54860d86ab HADOOP-7178. Add a parameter, useRawLocalFileSystem, to copyToLocalFile(..) in FileSystem. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152791 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 14:20:24 +00:00
Tsz-wo Sze
7e18c90d39 MAPREDUCE-2243. Close streams propely in a finally-block to avoid leakage in CompletedJobStatusStore, TaskLog, EventWriter and TotalOrderPartitioner. Contributed by Devaraj K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152787 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 14:11:19 +00:00
Tsz-wo Sze
d68e38b78d HDFS-2199. Move blockTokenSecretManager from FSNamesystem to BlockManager. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152776 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 13:57:00 +00:00
Aaron Myers
4435aad09d Branching for HDFS-1623 - High Availability Framework for HDFS NN 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1152502 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-30 19:25:24 +00:00
Tsz-wo Sze
8390152d08 HDFS-2202. Add a new DFSAdmin command to set balancer bandwidth of datanodes without restarting. Contributed by Eric Payne 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152401 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-30 00:10:39 +00:00