big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
955 Commits 2 Branches 2 Tags 264 MiB
b094465168
Commit Graph

96 Commits

Author SHA1 Message Date
Tsz-wo Sze
b094465168 HDFS-2265. Remove unnecessary BlockTokenSecretManager fields/methods from BlockManager. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158743 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-17 14:34:29 +00:00
Eli Collins
2ab3433e0e HDFS-2233. Add WebUI tests with URI reserved chars. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158025 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-15 21:47:00 +00:00
Eli Collins
504b801ca0 HDFS-73. DFSOutputStream does not close all the sockets. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157232 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 19:57:15 +00:00
Tsz-wo Sze
d5ef72e8c1 HDFS-2240. Fix a deadlock in LeaseRenewer by enforcing lock acquisition ordering. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156977 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 06:26:35 +00:00
Eli Collins
1c2ab728f5 HDFS-2186. DN volume failures on startup are not counted. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156974 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 06:09:35 +00:00
Eli Collins
4673ab17b0 HDFS-2235. Encode servlet paths. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156967 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 05:03:05 +00:00
Tsz-wo Sze
1dd48b1aee HDFS-2229. Fix a deadlock in namenode by enforcing lock acquisition ordering. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156847 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 22:16:16 +00:00
Tsz-wo Sze
6a7c0306bd HDFS-2245. Fix a NullPointerException in BlockManager.chooseTarget(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156490 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 05:24:55 +00:00
Tsz-wo Sze
cde987996a HDFS-2237. Change UnderReplicatedBlocks from public to package private. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156424 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 01:05:45 +00:00
Suresh Srinivas
ef223e8e8e HDFS-2241. Remove implementing FSConstants interface to just get the constants from the interface. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156420 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 00:46:31 +00:00
Tsz-wo Sze
5d5b1c6c10 HDFS-2239. Reduce access levels of the fields and methods in FSNamesystem. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155998 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 01:50:51 +00:00
Todd Lipcon
eb6e44b1ba HDFS-2227. getRemoteEditLogManifest should pull its information from FileJournalManager during checkpoint process. Contributed by Ivan Kelly and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155977 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 00:01:39 +00:00
Giridharan Kesavan
a523fbdb6c HDFS-2230. Fix ivy conf to resolve/retrieve latest common-tests jar published by hadoop common maven build. (gkesavan) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155123 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-08 22:09:28 +00:00
Tsz-wo Sze
498e290103 HDFS-2238. In NamenodeFsck.toString(), uses StringBuilder.(..) instead of string concatenation. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154973 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-08 14:27:53 +00:00
Tsz-wo Sze
371f4a5905 HDFS-2228. Move block and datanode code from FSNamesystem to BlockManager and DatanodeManager. (szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154899 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-08 10:06:45 +00:00
Todd Lipcon
62f27b5729 Edit change log entry for HDFS-2225 by request of Nicholas 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154414 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 23:42:09 +00:00
Todd Lipcon
a61b24a6da HDFS-2226. Clean up counting of operations in FSEditLogLoader. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154098 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 06:03:19 +00:00
Tsz-wo Sze
7fac946ac9 HDFS-2108. Move datanode heartbeat handling from namenode package to blockmanagement package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154042 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 22:55:48 +00:00
Todd Lipcon
23762da4fa HDFS-2225. Refactor file management so it's not in classes which should be generic. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154029 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 21:56:17 +00:00
Todd Lipcon
53190cfa1d HDFS-2187. Make EditLogInputStream act like an iterator over FSEditLogOps. Contributed by Ivan Kelly and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153996 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-04 20:22:13 +00:00
Thomas White
b71b47079e HDFS-2196. Make ant build system work with hadoop-common JAR generated by Maven. Contributed by Alejandro Abdelnur 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153207 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 17:16:59 +00:00
Tsz-wo Sze
d68e38b78d HDFS-2199. Move blockTokenSecretManager from FSNamesystem to BlockManager. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152776 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 13:57:00 +00:00
Tsz-wo Sze
8390152d08 HDFS-2202. Add a new DFSAdmin command to set balancer bandwidth of datanodes without restarting. Contributed by Eric Payne 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152401 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-30 00:10:39 +00:00
Todd Lipcon
28e6a4e44a HDFS-1073. Redesign the NameNode's storage layout for image checkpoints and edit logs to introduce transaction IDs and be more robust. Contributed by Todd Lipcon and Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1152295 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-29 16:28:45 +00:00
Eli Collins
44320eed17 HDFS-2212. Refactor double-buffering code out of EditLogOutputStreams. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151736 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-28 05:46:28 +00:00
Eli Collins
ffbe9e5972 HDFS-2195. Refactor StorageDirectory to not be an non-static inner class. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151707 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-28 03:19:31 +00:00
Konstantin Shvachko
6f1ef980de HDFS-1981. NameNode does not saveNamespace() when editsNew is empty. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151666 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 23:28:16 +00:00
Eli Collins
c4f7d2f015 HDFS-2210. Remove hdfsproxy. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151592 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 19:08:52 +00:00
Suresh Srinivas
b60772c47d HDFS-2198. Remove hardcoded configuration keys. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151501 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 15:29:50 +00:00
Tsz-wo Sze
0b12cc822d HDFS-2200. Change FSNamesystem.LOG to package private. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151344 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 05:59:50 +00:00
Tsz-wo Sze
969a263188 HDFS-2191. Move datanodeMap from FSNamesystem to DatanodeManager. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151339 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-27 05:46:52 +00:00
Todd Lipcon
438c32aaf9 HDFS-2149. Move EditLogOp serialization formats into FsEditLogOp implementations. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1151238 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-26 20:46:58 +00:00
Todd Lipcon
01cd616d17 HDFS-2180. Refactor NameNode HTTP server into new class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150960 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-26 00:04:30 +00:00
Aaron Myers
d2b31fe25f HDFS-2144. If SNN shuts down during initialization it does not log the cause. (Ravi Prakash via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150927 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-25 21:44:00 +00:00
Dmytro Molkov
c316d43a0a HDFS-1776 Bug in Bug in Concat code. Contributed by Bharath Mundlapudi 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150247 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-24 01:43:05 +00:00
Tsz-wo Sze
598b85c9e2 HDFS-1739. Add available volume size to the error message when datanode throws DiskOutOfSpaceException. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1150067 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-23 08:45:55 +00:00
Tsz-wo Sze
89537b7710 HDFS-2112. Move ReplicationMonitor to block management. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1149771 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-23 01:01:58 +00:00
Konstantin Shvachko
ad3f694261 HDFS-2116. Use Mokito in TestStreamFile and TestByteRangeInputStream. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1149770 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-23 00:22:08 +00:00
Tsz-wo Sze
233a7aa34f HDFS-2167. Move dnsToSwitchMapping and hostsReader from FSNamesystem to DatanodeManager. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1149455 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 04:20:21 +00:00
Owen O'Malley
c187bdc0a2 HDFS-2156. Make hdfs and mapreduce rpm only depend on the same major 
version for common and hdfs. (eyang via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1149323 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-21 19:16:09 +00:00
Matthew Foley
08928d067b HDFS-2114. re-commission of a decommissioned node does not delete excess replicas. Contributed by John George. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148981 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-20 23:35:50 +00:00
Eli Collins
cda43d71be HDFS-1774. Small optimization to FSDataset. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148894 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-20 18:52:57 +00:00
Tsz-wo Sze
710e5a960e HDFS-2161. Move createNamenode(..), createClientDatanodeProtocolProxy(..) and Random object creation to DFSUtil; move DFSClient.stringifyToken(..) to DelegationTokenIdentifier. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148348 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-19 14:23:50 +00:00
Suresh Srinivas
6c0cb4d151 HDFS-2141. Remove NameNode roles Active and Standby (they become states of the namenode). Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148125 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-19 01:32:59 +00:00
Tsz-wo Sze
c3f6575ca4 HDFS-2147. Move cluster network topology to block management and fix some javac warnings. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148112 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-19 00:26:21 +00:00
Eli Collins
81001b87c1 HDFS-2157. Improve header comment in o.a.h.hdfs.server.namenode.NameNode. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147980 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-18 17:23:25 +00:00
Suresh Srinivas
8a77d0b289 HDFS-2143. Federation: In cluster web console, add link to namenode page that displays live and dead datanodes. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147964 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-18 16:45:28 +00:00
Aaron Myers
eaa0638c12 HDFS-2152. TestWriteConfigurationToDFS causing the random failures. (Uma Maheswara Rao G via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147762 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-18 07:07:58 +00:00
Tsz-wo Sze
c163455df4 HDFS-2159. Deprecate DistributedFileSystem.getClient() and fixed the deprecated warnings in DFSAdmin. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147359 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-16 05:12:40 +00:00
Tsz-wo Sze
c093580824 HDFS-2153. Move DFSClientAdapter to test and fix some javac warnings in OfflineEditsViewerHelper. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147340 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-15 22:46:43 +00:00