big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,975 Commits 2 Branches 2 Tags 264 MiB
52ecdb751e
Commit Graph

781 Commits

Author SHA1 Message Date
Uma Maheswara Rao G
d28b982428 HDFS-3222. DFSInputStream#openInfo should not silently get the length as 0 when locations length is zero for last partial block. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331061 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 20:18:01 +00:00
Eli Collins
2b254dad2e HDFS-3258. Test for HADOOP-8144 (pseudoSortByDistance in NetworkTopology for first rack local node). Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330613 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 00:47:16 +00:00
Tsz-wo Sze
3b773da036 HDFS-3319. Change DFSOutputStream to not to start a thread in constructors. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330535 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 20:17:20 +00:00
Tsz-wo Sze
2584779166 HDFS-3321. Fix safe mode turn off tip message. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330506 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 19:34:36 +00:00
Tsz-wo Sze
f86352c2df HDFS-3318. Use BoundedInputStream in ByteRangeInputStream, otherwise, it hangs on transfers >2 GB. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330500 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 19:24:00 +00:00
Tsz-wo Sze
8e99d9a764 Move HDFS-3282 and HDFS-3298 to 2.0.0 in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330443 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 17:57:28 +00:00
Tsz-wo Sze
ea32198db4 HDFS-3298. Add HdfsDataOutputStream as a public API. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330064 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 23:39:43 +00:00
Alejandro Abdelnur
706e861a85 HADOOP-7549. Use JDK ServiceLoader mechanism to find FileSystem implementations. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329994 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 20:33:05 +00:00
Alejandro Abdelnur
f4711ef3ab HDFS-3314. HttpFS operation for getHomeDirectory is incorrect. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329715 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 13:46:25 +00:00
Tsz-wo Sze
93c5585d31 HDFS-3312. In HftpFileSystem, the namenode URI is non-secure but the delegation tokens have to use secure URI. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329462 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 21:27:01 +00:00
Sanjay Radia
589c68ae09 HADOOP-8285 Use ProtoBuf for RpcPayLoadHeader (sanjay radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329319 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 16:34:21 +00:00
Tsz-wo Sze
cdbe15ccdc HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328541 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-20 23:59:19 +00:00
Tsz-wo Sze
201af20406 Revert r1328482 for HDFS-3308. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328487 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-20 19:32:23 +00:00
Tsz-wo Sze
ab8f458742 HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328482 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-20 19:16:58 +00:00
Aaron Myers
49ed783a3a HDFS-3305. GetImageServlet should consider SBN a valid requestor in a secure HA setup. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328115 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 20:43:03 +00:00
Uma Maheswara Rao G
ba4ec5f0aa iHDFS-3282. Expose getFileLength API. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327790 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 02:41:32 +00:00
Uma Maheswara Rao G
c6d3537d33 HDFS-3282. Expose getFileLength API. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327788 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 02:34:44 +00:00
Eli Collins
4550627cab HDFS-3169. TestFsck should test multiple -move operations in a row. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327776 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 01:51:13 +00:00
Eli Collins
54e61ffdc0 HDFS-3206. Miscellaneous xml cleanups for OEV. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327768 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 01:31:53 +00:00
Eli Collins
0c16ec4d6e HDFS-891. DataNode no longer needs to check for dfs.network.script. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327762 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 01:09:12 +00:00
Todd Lipcon
ca49126e3d Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1327724 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 23:35:30 +00:00
Tsz-wo Sze
2bf8be3c72 HDFS-3292. Remove the deprecated DiskStatus, getDiskStatus(), getRawCapacity() and getRawUsed() from DistributedFileSystem. Contributed by Arpit Gupta 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327664 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 20:21:08 +00:00
Alejandro Abdelnur
8bda086d04 HDFS-3263. HttpFS should read HDFS config from Hadoop site.xml files (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327627 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 18:51:22 +00:00
Tsz-wo Sze
eeec4dc72a HDFS-3294. Fix code indentation in NamenodeWebHdfsMethods and DatanodeWebHdfsMethods. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327365 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 03:25:08 +00:00
Tsz-wo Sze
c80dbe5e09 HDFS-2652. Add support for host-based delegation tokens. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327309 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 22:21:33 +00:00
Aaron Myers
c21bd72a2f HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327182 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 17:06:38 +00:00
Aaron Myers
1675c18ded Revert HADOOP-8280 so it can be recommitted using `svn mv' 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327179 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 16:49:04 +00:00
Eli Collins
1d5861a8c4 HDFS-3165. HDFS Balancer scripts are refering to wrong path of hadoop-daemon.sh. Contributed by Amith D K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326848 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 00:50:40 +00:00
Todd Lipcon
574f99bd6b HDFS-3284. bootstrapStandby fails in secure cluster. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326813 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 21:51:52 +00:00
Tsz-wo Sze
f1667dee14 HDFS-3279. Move the FSEditLog constructor with @VisibleForTesting to TestEditLog. Contributed by Arpit Gupta 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326762 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 19:31:34 +00:00
Todd Lipcon
258da66cc7 HDFS-3268. FileContext API mishandles token service and incompatible with HA. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326747 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 19:08:29 +00:00
Aaron Myers
551468385c HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326727 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 18:28:36 +00:00
Aaron Myers
15fe3ae61b HDFS-2708. Stats for the # of blocks per DN. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326039 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-14 01:51:03 +00:00
Tsz-wo Sze
841fdc5628 HDFS-3273. Refactor BackupImage and FSEditLog, and rename JournalListener.rollLogs(..) to startLogSegment(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326016 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 23:41:01 +00:00
Aaron Myers
d6533cc321 Move CHANGES.txt message for HDFS-2765 to be under 2.0.0 instead of trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326013 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 23:32:17 +00:00
Eli Collins
5a20d446cf HDFS-2799. Trim fs.checkpoint.dir values. Contributed by Amith D K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325963 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 21:31:27 +00:00
Todd Lipcon
2ed825e66c HDFS-3159. Document NN auto-failover setup and configuration. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1325539 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 21:53:42 +00:00
Aaron Myers
4f230adc13 HDFS-3256. HDFS considers blocks under-replicated if topology script is configured with only 1 rack. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325531 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 21:28:44 +00:00
Aaron Myers
07a4367445 HDFS-3259. NameNode#initializeSharedEdits should populate shared edits dir with edit log segments. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325518 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 21:11:32 +00:00
Todd Lipcon
72406e940a HDFS-3255. HA DFS returns wrong token service. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325414 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 18:08:00 +00:00
Todd Lipcon
989d65ab97 HDFS-3261. TestHASafeMode fails on HDFS-3042 branch. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1325140 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 07:05:36 +00:00
Aaron Myers
4ea042666c HDFS-3260. TestDatanodeRegistration should set minimum DN version in addition to minimum NN version. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325119 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 05:27:03 +00:00
Aaron Myers
7f427646df HDFS-2983. Relax the build version check to permit rolling upgrades within a release. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325110 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 03:36:13 +00:00
Tsz-wo Sze
ed678e52ce HDFS-3179. Improve the exception message thrown by DataStreamer when it failed to add a datanode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324892 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 17:49:28 +00:00
Todd Lipcon
6f2aae046d Resolve trivial compilation error after previous merge 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324570 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:52:31 +00:00
Todd Lipcon
2bf19979b3 Merge trunk into auto-failover branch. 
Needs a few tweaks to fix compilation - will do in followup commit. This is just a straight merge


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324567 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:47:40 +00:00
Todd Lipcon
41a014c31b HADOOP-8247. Add a config to enable auto-HA, which disables manual FailoverController. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324566 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:40:26 +00:00
Todd Lipcon
dab66bee55 HDFS-3249. Use ToolRunner.confirmPrompt in NameNode. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324564 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:28:58 +00:00
Todd Lipcon
21824d8232 HDFS-3247. Improve bootstrapStandby behavior when original NN is not active. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324558 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:16:06 +00:00
Eli Collins
e235dd3760 HDFS-2696. Fix the fuse-fds build. Contributed by Bruno Mahé 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312068 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 01:55:05 +00:00
Eli Collins
80447bd35a HDFS-3244. Remove dead writable code from hdfs/protocol. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312061 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 01:10:38 +00:00
Todd Lipcon
58228e4e7b HDFS-3243. TestParallelRead timing out on jenkins. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312029 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 22:31:18 +00:00
Todd Lipcon
7c2e10e0cd HDFS-3248. bootstrapStandby repeated twice in hdfs namenode usage message. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312028 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 22:28:25 +00:00
Todd Lipcon
3ffdb9152e HDFS-3094. add -nonInteractive and -force option to namenode -format command. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312025 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 22:22:38 +00:00
Eli Collins
926f0a5ae0 HDFS-3238. ServerCommand and friends don't need to be writables. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311774 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 15:03:17 +00:00
Todd Lipcon
df3e1a3158 HDFS-3240. Drop log level of "heartbeat: ..." in BPServiceActor to DEBUG. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311577 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 05:12:00 +00:00
Aaron Myers
53dc8546d4 HDFS-3235. MiniDFSClusterManager doesn't correctly support -format option. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311556 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 02:25:40 +00:00
Aaron Myers
9597c81f35 HDFS-3236. NameNode does not initialize generic conf keys when started with -initializeSharedEditsDir. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311554 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 02:17:17 +00:00
Todd Lipcon
91528ce9ed HDFS-3234. Accidentally left log message in GetConf after HDFS-3226. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311541 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 00:59:38 +00:00
Eli Collins
706394d039 HDFS-3004. Implement Recovery Mode. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311394 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 19:39:58 +00:00
Uma Maheswara Rao G
3ced5ea066 HDFS-3119. Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file. Contributed by Ashish Singhi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311380 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 19:11:58 +00:00
Aaron Myers
909176c1fc HADOOP-8261. Har file system doesn't deal with FS URIs with a host but no port. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311133 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 05:56:22 +00:00
Todd Lipcon
ee5daee1b7 HDFS-3214. InterDatanodeProtocolServerSideTranslatorPB doesn't handle null response from initReplicaRecovery. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311125 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 03:22:41 +00:00
Todd Lipcon
693ec453d2 HADOOP-8246. Auto-HA: automatically scope znode by nameservice ID. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310919 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 23:24:57 +00:00
Todd Lipcon
ca6f0940fd Merge trunk into auto-failover branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310905 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 22:53:55 +00:00
Tsz-wo Sze
74b4b45651 HDFS-3211. Add fence(..) and replace NamenodeRegistration with JournalInfo and epoch in JournalProtocol. Contributed by suresh 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310649 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 00:52:12 +00:00
Todd Lipcon
2ab67dce11 HDFS-3226. Allow GetConf tool to print arbitrary keys. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310648 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 00:15:30 +00:00
Suresh Srinivas
02f5e43686 HDFS-3121. Add HDFS tests for HADOOP-8014 change. Contributed by John George. Missed adding the file in the earlier commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310631 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 23:03:54 +00:00
Suresh Srinivas
de3fb5c23a HDFS-3121. Add HDFS tests for HADOOP-8014 change. Contributed by John George. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310630 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 23:03:00 +00:00
Todd Lipcon
97804bacd0 HDFS-3223. add zkfc to hadoop-daemon.sh script. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310620 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 22:27:28 +00:00
Tsz-wo Sze
58e920d1a0 HDFS-2505. Add a test to verify getFileChecksum(..) with ViewFS. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310522 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 18:04:05 +00:00
Suresh Srinivas
b3ac25048c HDFS-3136. Remove SLF4J dependency as HDFS does not need it to fix unnecessary warnings. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310476 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 16:50:31 +00:00
Todd Lipcon
d166bd184d HDFS-3110. Use directRead API to reduce the number of buffer copies in libhdfs. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310185 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 06:31:10 +00:00
Todd Lipcon
30068a1d83 Merge trunk into auto-failover branch. 
Addressed two semantic conflicts after the commit of HADOOP-8077 -- test code was referencing the old constant for the fencing methods config key.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310174 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 05:07:33 +00:00
Todd Lipcon
d483b6f3fc HADOOP-8077. HA: fencing method should be able to be configured on a per-NN or per-NS basis. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310173 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 04:56:26 +00:00
Todd Lipcon
844faefd08 HDFS-3200. Scope all ZKFC configurations by nameservice. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310165 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 04:27:44 +00:00
Eli Collins
e505b7e704 HDFS-3208. Bogus entries in hosts files are incorrectly displayed in the report. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310138 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 00:20:55 +00:00
Eli Collins
112c324151 HDFS-3210. JsonUtil#toJsonMap for for a DatanodeInfo should use "ipAddr" instead of "name". Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310135 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 00:10:54 +00:00
Suresh Srinivas
861c872541 HDFS-3204. Minor modification to JournalProtocol.proto to make it generic. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310134 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 00:08:19 +00:00
Tsz-wo Sze
80bbefafaf HDFS-3178. Add states and state handler for journal synchronization in JournalService. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310115 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 22:35:53 +00:00
Suresh Srinivas
4c908d0987 HDFS-3109. Remove hsqldf exclusions from pom.xml. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309971 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 17:42:46 +00:00
Aaron Myers
8e739ff01e HDFS-3202. NamespaceInfo PB translation drops build version. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309955 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 17:18:26 +00:00
Eli Collins
663fbd46a8 HDFS-3199. TestValidateConfigurationSettings is failing. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309641 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 03:31:03 +00:00
Eli Collins
4f6e0a5a65 HDFS-3050. rework OEV to share more code with the NameNode. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309629 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 00:02:11 +00:00
Aaron Myers
ba688e11c1 HDFS-3102. Add CLI tool to initialize the shared-edits dir. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309580 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 20:15:08 +00:00
Todd Lipcon
00a1548005 Merge trunk into auto-HA branch 
Resolved some trivial conflicts in NNHAServiceTarget


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309576 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 20:00:15 +00:00
Todd Lipcon
b74d742785 HADOOP-8245. Fix flakiness in TestZKFailoverController. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309554 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 19:21:01 +00:00
Todd Lipcon
a7d6bdc63b HDFS-3084. FenceMethod.tryFence() and ShellCommandFencer should pass namenodeId as well as host:port. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309526 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 18:40:43 +00:00
Eli Collins
4f7f58fa8b Updated CHANGES.txt to reflect HDFS-2564 merge 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309488 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 16:40:08 +00:00
Aaron Myers
7525ee5b67 HDFS-3000. Add a public API for setting quotas. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309227 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 03:18:49 +00:00
Tsz-wo Sze
8c0366bf10 HDFS-3168. Remove unnecessary "throw IOException" and change fields to final in FSNamesystem and BlockManager. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309218 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 02:51:34 +00:00
Todd Lipcon
30e1b3bba8 HADOOP-8215. Security support for ZK Failover controller. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309185 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 23:37:15 +00:00
Todd Lipcon
9972a9633d HDFS-3187. Upgrade guava to 11.0.2. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309181 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 22:30:29 +00:00
Todd Lipcon
39a5fd5c71 Merge trunk into auto-failover branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309164 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 21:48:23 +00:00
Tsz-wo Sze
e561cb9e78 HDFS-3176. Use MD5MD5CRC32FileChecksum.readFields() in JsonUtil . Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309114 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 19:44:53 +00:00
Tsz-wo Sze
0db8003e2e HDFS-3166. Add timeout to Hftp connections. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309103 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 19:26:57 +00:00
Todd Lipcon
789ed57e71 HDFS-2185. HDFS portion of ZK-based FailoverController. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1308637 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 00:59:02 +00:00
Suresh Srinivas
e449de0526 HDFS-3126. Journal stream from Namenode to BackupNode needs to have timeout. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308636 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 00:55:08 +00:00
Eli Collins
4f15b9dfed HDFS-3148. The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308617 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 23:20:34 +00:00
Eli Collins
f44ca78179 Previous commit was for HDFS-3120, fixing up CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308615 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 23:15:43 +00:00