big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,213 Commits 2 Branches 2 Tags 264 MiB
e90a5b4043
Commit Graph

1213 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tsz-wo Sze
371f4a5905 HDFS-2228. Move block and datanode code from FSNamesystem to BlockManager and DatanodeManager. (szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154899 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-08 10:06:45 +00:00
Thomas White
8dc420ba36 HADOOP-7523. Test org.apache.hadoop.fs.TestFilterFileSystem fails due to java.lang.NoSuchMethodException. Contributed by John Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154817 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-08 04:36:46 +00:00
Todd Lipcon
62f27b5729 Edit change log entry for HDFS-2225 by request of Nicholas 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154414 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 23:42:09 +00:00
Giridharan Kesavan
3864369a58 HADOOP-7520. Fix to add distribution management info to hadoop-main. Contributed by Alejandro Abdelnur 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154350 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 18:47:53 +00:00
Thomas White
ca4b2f108a HADOOP-7515. test-patch reports the wrong number of javadoc warnings. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154240 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 14:28:30 +00:00
Todd Lipcon
a61b24a6da HDFS-2226. Clean up counting of operations in FSEditLogLoader. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154098 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 06:03:19 +00:00
Thomas White
acd3ab521f Fix svn:ignore properties following HADOOP-6671. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154052 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 00:37:57 +00:00
Todd Lipcon
e639c3357b HADOOP-7445. Implement bulk checksum verification using efficient native code. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154043 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 22:57:01 +00:00
Tsz-wo Sze
7fac946ac9 HDFS-2108. Move datanode heartbeat handling from namenode package to blockmanagement package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154042 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 22:55:48 +00:00
Todd Lipcon
23762da4fa HDFS-2225. Refactor file management so it's not in classes which should be generic. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154029 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 21:56:17 +00:00
Todd Lipcon
53190cfa1d HDFS-2187. Make EditLogInputStream act like an iterator over FSEditLogOps. Contributed by Ivan Kelly and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153996 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 20:22:13 +00:00
Thomas White
924ed13664 HDFS-2196. Make ant build system work with hadoop-common JAR generated by Maven. Fix for fusedfs contributed by szetszwo 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153928 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 17:01:41 +00:00
Devaraj Das
703b5f412c MAPREDUCE-2705. Permits parallel multiple task launches. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153720 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 01:31:05 +00:00
Devaraj Das
44b7e03114 MAPREDUCE-2705. Permits parallel multiple task launches. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153717 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 01:15:33 +00:00
Thomas White
2025d4e032 HADOOP-7508. Compiled nativelib is in wrong directory and it is not picked up by surefire setup. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153689 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-03 22:22:49 +00:00
Thomas White
2db9aab9d7 HADOOP-7501. Publish Hadoop Common artifacts (post HADOOP-6671) to Apache SNAPSHOTs repo. Contributed by Alejandro Abdelnur 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153597 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-03 17:52:00 +00:00
Luke Lu
12e09b229f HADOOP-7502. Make generated sources IDE friendly. (Alejandro Abdelnur via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153586 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-03 17:13:24 +00:00
Eli Collins
102b94d3a8 MAPREDUCE-2760. mapreduce.jobtracker.split.metainfo.maxsize typoed in mapred-default.xml. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153260 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 20:05:20 +00:00
Thomas White
44501d88e2 MAPREDUCE-2741. Make ant build system work with hadoop-common JAR generated by Maven. Contributed Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153209 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 17:26:09 +00:00
Thomas White
b71b47079e HDFS-2196. Make ant build system work with hadoop-common JAR generated by Maven. Contributed by Alejandro Abdelnur 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153207 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 17:16:59 +00:00
Thomas White
ddc3f5d105 Reinstate common/src/test/bin (used by externals) which was mistakenly deleted in HADOOP-6671 commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153197 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 17:02:47 +00:00
Thomas White
0f6dfeeacb HADOOP-6671. Use maven for hadoop common builds. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153184 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 16:37:57 +00:00
Arun Murthy
9bac807ced MAPREDUCE-2187. Reporter sends progress during sort/merge. Contributed by Anupam Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152964 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 22:53:08 +00:00
Todd Lipcon
22f232bce2 MAPREDUCE-2740. MultipleOutputs in new API creates needless TaskAttemptContexts. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152875 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 17:52:49 +00:00
Tsz-wo Sze
54860d86ab HADOOP-7178. Add a parameter, useRawLocalFileSystem, to copyToLocalFile(..) in FileSystem. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152791 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 14:20:24 +00:00
Tsz-wo Sze
7e18c90d39 MAPREDUCE-2243. Close streams propely in a finally-block to avoid leakage in CompletedJobStatusStore, TaskLog, EventWriter and TotalOrderPartitioner. Contributed by Devaraj K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152787 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 14:11:19 +00:00
Tsz-wo Sze
d68e38b78d HDFS-2199. Move blockTokenSecretManager from FSNamesystem to BlockManager. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152776 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 13:57:00 +00:00
Tsz-wo Sze
8390152d08 HDFS-2202. Add a new DFSAdmin command to set balancer bandwidth of datanodes without restarting. Contributed by Eric Payne 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152401 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-30 00:10:39 +00:00
Eli Collins
8830af00ee HADOOP-7491. hadoop command should respect HADOOP_OPTS when given a class name. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152389 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-29 22:13:15 +00:00
Todd Lipcon
28e6a4e44a HDFS-1073. Redesign the NameNode's storage layout for image checkpoints and edit logs to introduce transaction IDs and be more robust. Contributed by Todd Lipcon and Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152295 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-29 16:28:45 +00:00
Steve Loughran
c58366acd1 HADOOP-7468 hadoop-core JAR contains a log4j.properties file. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152219 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-29 13:44:05 +00:00
Eli Collins
0643a590d8 MAPREDUCE-2127. mapreduce trunk builds are filing on hudson. Contributed by Bruno Mahé 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152068 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-29 01:29:24 +00:00
Jitendra Nath Pandey
817df4d5d3 HADOOP-7474. Refactor ClientCache out of WritableRpcEngine. Contributed by jitendra. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151978 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-28 19:28:18 +00:00
Eli Collins
44320eed17 HDFS-2212. Refactor double-buffering code out of EditLogOutputStreams. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151736 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-28 05:46:28 +00:00
Tsz-wo Sze
60c41c55e7 MAPREDUCE-2463. Job history files are not moved to done folder when job history location is hdfs. Contributed by Devaraj K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151722 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-28 04:08:34 +00:00
Eli Collins
ffbe9e5972 HDFS-2195. Refactor StorageDirectory to not be an non-static inner class. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151707 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-28 03:19:31 +00:00
Konstantin Shvachko
6f1ef980de HDFS-1981. NameNode does not saveNamespace() when editsNew is empty. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151666 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 23:28:16 +00:00
Suresh Srinivas
0850205088 HADOOP-7378. Add -d option to ls to not expand directories. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151594 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 19:09:55 +00:00
Eli Collins
c4f7d2f015 HDFS-2210. Remove hdfsproxy. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151592 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 19:08:52 +00:00
Suresh Srinivas
5dbd26f2c7 HADOOP-7485. Add -h option to ls to list file sizes in human readable format. Contributed by XieXianshan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151505 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 15:35:58 +00:00
Suresh Srinivas
b60772c47d HDFS-2198. Remove hardcoded configuration keys. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151501 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 15:29:50 +00:00
Tsz-wo Sze
4a535823a7 Fix a typo in CHANGE.txt: MAPREDUCE-2723 should be MAPREDUCE-2732. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151464 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 13:47:30 +00:00
Tsz-wo Sze
f3f9029577 Temporarily disable NameNodeRaidTestUtil.getDatanodeMap(..) for MAPREDUCE-2711. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151351 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 06:41:45 +00:00
Tsz-wo Sze
d356d64479 MAPREDUCE-2723. Remove directly accessing FSNamesystem.LOG from TestCopyFiles and TestDistCh. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151349 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 06:27:00 +00:00
Tsz-wo Sze
0b12cc822d HDFS-2200. Change FSNamesystem.LOG to package private. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151344 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 05:59:50 +00:00
Tsz-wo Sze
969a263188 HDFS-2191. Move datanodeMap from FSNamesystem to DatanodeManager. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151339 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 05:46:52 +00:00
Todd Lipcon
438c32aaf9 HDFS-2149. Move EditLogOp serialization formats into FsEditLogOp implementations. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151238 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-26 20:46:58 +00:00
Matthew Foley
60e4947cc7 HADOOP-6385. dfs should support -rmdir (was HDFS-639). Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150987 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-26 04:57:09 +00:00
Todd Lipcon
01cd616d17 HDFS-2180. Refactor NameNode HTTP server into new class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150960 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-26 00:04:30 +00:00
Aaron Myers
d2b31fe25f HDFS-2144. If SNN shuts down during initialization it does not log the cause. (Ravi Prakash via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150927 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-25 21:44:00 +00:00