big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,557 Commits 2 Branches 2 Tags 264 MiB
76817c28a2
Commit Graph

589 Commits

Author SHA1 Message Date
Tsz-wo Sze
0c4acdc176 HDFS-3100. In BlockSender, throw an exception when it needs to verify checksum but the meta data does not exist. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303628 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 00:10:20 +00:00
Todd Lipcon
2f820dde17 HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303485 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 18:14:09 +00:00
Todd Lipcon
f55a1c0876 HDFS-2834. Add a ByteBuffer-based read API to DFSInputStream. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303474 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 17:30:37 +00:00
Tsz-wo Sze
9e108e61fb HDFS-3086. Change Datanode not to send storage list in registration. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303318 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 09:07:33 +00:00
Aaron Myers
4ceca97606 HDFS-3083. Cannot run an MR job with HA and security enabled when second-listed NN active. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303098 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 19:00:56 +00:00
Aaron Myers
21426e6e42 HADOOP-8121. Active Directory Group Mapping Service. Contributed by Jonathan Natkins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302740 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 01:00:14 +00:00
Tsz-wo Sze
6326605acb HDFS-3105. Add DatanodeStorage information to block recovery. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302683 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-19 22:09:14 +00:00
Uma Maheswara Rao G
f77b1a63ec HDFS-3091. Update the usage limitations of ReplaceDatanodeOnFailure policy in the config description for the smaller clusters. Contributed by Nicholas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302624 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-19 19:54:13 +00:00
Uma Maheswara Rao G
875080ce10 HDFS-3111. Missing license headers in trunk. Deleted this file from svn repositiry as this file was already empty. (Contributed by Uma MAheswara Rao G). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301876 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-17 07:06:42 +00:00
Uma Maheswara Rao G
3573d504e4 HDFS-3111. Missing license headers in trunk. (Contributed by Uma Maheswara Rao G). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301871 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-17 06:50:36 +00:00
Tsz-wo Sze
2a0024403a HDFS-3104. Add tests for HADOOP-8175. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301665 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 17:48:33 +00:00
Tsz-wo Sze
662b1887af HDFS-3088. Move FSDatasetInterface inner classes to a package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301661 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 17:32:57 +00:00
Tsz-wo Sze
9b2a324ba5 HDFS-3098. Update and add tests for HADOOP-8173. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301295 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 00:27:40 +00:00
Tsz-wo Sze
7e5b60116e HDFS-3101. Cannot read empty file using WebHDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301287 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 00:01:23 +00:00
Todd Lipcon
49619e8997 HDFS-3062. Fix bug which prevented MR job submission from creating delegation tokens on an HA cluster. Contributed by Mingjie Lai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301285 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 00:00:29 +00:00
Aaron Myers
65425b0961 HDFS-3099. SecondaryNameNode does not properly initialize metrics system. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301222 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 21:51:23 +00:00
Aaron Myers
6d96a28a08 HDFS-3067. NPE in DFSInputStream.readBuffer if read is repeated on corrupted block. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301182 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 20:26:29 +00:00
Tsz-wo Sze
1177d4edc2 HDFS-3005. FSVolume.decDfsUsed(..) should be synchronized. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301127 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 18:24:40 +00:00
Todd Lipcon
59eb544744 HDFS-3093. Fix bug where namenode -format interpreted the -force flag in reverse. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300814 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 05:36:03 +00:00
Alejandro Abdelnur
a0ee9adfd3 HDFS-3057. httpfs and hdfs launcher scripts should honor CATALINA_HOME and HADOOP_LIBEXEC_DIR (rvs via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300637 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-14 17:01:34 +00:00
Tsz-wo Sze
3e582c690c HDFS-3082. Clean up FSDatasetInterface and change DataNode.data to package private. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300392 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 22:52:17 +00:00
Eli Collins
ab20dae519 HDFS-2303. Unbundle jsvc. Contributed by Roman Shaposhnik and Mingjie Lai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299963 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 03:38:57 +00:00
Todd Lipcon
1a75ec8288 HDFS-2731. Add command to bootstrap the Standby Node's name directories from the Active NameNode. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299807 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-12 19:41:21 +00:00
Suresh Srinivas
46a88ded0d Moving HDFS-1623 and HADOOP-7454 to 0.23.3 section in CHANGES.txt files 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299417 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-11 18:11:43 +00:00
Tsz-wo Sze
c8f2889bde HDFS-3056: add the new file for the previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299144 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-10 01:58:29 +00:00
Tsz-wo Sze
501a283986 HDFS-3056. Add a new interface RollingLogs for DataBlockScanner logging. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299139 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-10 01:52:17 +00:00
Steve Loughran
381a9b2d58 HDFS-2966 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298820 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 13:17:04 +00:00
Uma Maheswara Rao G
069fb57f4e HDFS-2976 removed the unused imports that were missed in previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298508 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 18:56:43 +00:00
Uma Maheswara Rao G
6c0c140350 HDFS-2976 corrected the previous wrong commit for this issue. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298507 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 18:51:46 +00:00
Uma Maheswara Rao G
b19d1186ab HDFS-2976. Remove unnecessary method (tokenRefetchNeeded) in DFSClient. 
(Contributed by Uma Maheswara Rao G)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298495 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 18:31:33 +00:00
Suresh Srinivas
b874d06133 Moving HDFS-3036, HDFS-3014, HDFS-3003, HDFS-2878, HDFS-208, HDFS-2764, HDFS-2410, HDFS-2285, HDFS-2507 to 0.23.3 section 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298274 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 05:23:50 +00:00
Tsz-wo Sze
22738ae1d0 HDFS-2038. Update TestHDFSCLI to handle relative paths with globs. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298066 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-07 19:44:47 +00:00
Eli Collins
0a2b413dff HDFS-3060. Bump TestDistributedUpgrade#testDistributedUpgrade timeout. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298044 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-07 19:16:03 +00:00
Suresh Srinivas
6f8d347b83 Moving HDFS-2158, HDFS-2188, HDFS-2334, HDFS-2477, HDFS-2495, HDFS-2476, HDFS-1580, HDFS-1765 to 0.23.3 section in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297903 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-07 09:15:30 +00:00
Tsz-wo Sze
0ee71adeb4 HDFS-3032. Change DFSClient.renewLease() so that it only retries up to the lease soft-limit. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297328 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 02:42:46 +00:00
Aaron Myers
8e303014bc Fix up CHANGES.txt files post commit of HDFS-1623 and HADOOP-7454. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296540 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-03 00:50:04 +00:00
Todd Lipcon
87d1c67944 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296025 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 01:48:32 +00:00
Aaron Myers
8a99218853 HDFS-3038. Add FSEditLog.metrics to findbugs exclude list. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296019 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 01:37:02 +00:00
Aaron Myers
7be4e5bd22 HDFS-3039. Address findbugs and javadoc warnings on branch. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296017 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 01:32:49 +00:00
Aaron Myers
6da670ce6a HDFS-3037. TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296016 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 01:26:54 +00:00
Tsz-wo Sze
b2f67b4704 HADOOP-8124, HDFS-3034, MAPREDUCE-3956. Remove the deprecated Syncable.sync(). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295999 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 23:51:19 +00:00
Aaron Myers
f22677ef8e HDFS-3036. Remove unused method DFSUtil#isDefaultNamenodeAddress. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295961 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 22:52:05 +00:00
Tsz-wo Sze
9e31bf675d HDFS-3021. Use generic type to declare FSDatasetInterface. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295929 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 21:58:39 +00:00
Todd Lipcon
55832c6c96 HDFS-3035. Fix failure of TestFileAppendRestart due to OP_UPDATE_BLOCKS. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295740 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 18:57:58 +00:00
Todd Lipcon
6e5e1e54bc Amend HDFS-3023. Add new layout version number to ImageLoaderCurrent to fix TestOfflineImageViewer. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295721 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 18:23:19 +00:00
Aaron Myers
0d7de507a5 HDFS-2979. Balancer should use logical uri for creating failover proxy with HA enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295473 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 08:50:10 +00:00
Aaron Myers
9318ff4250 Revert commit of HDFS-2979. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295435 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 07:03:40 +00:00
Todd Lipcon
30cffeb388 HDFS-3023. Optimize entries in edits log for persistBlocks call. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295356 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 00:37:09 +00:00
Todd Lipcon
1ba357553a Merge trunk into HA branch. 
Resolved some semantic conflicts in TestFileAppendRestart - we now log more OP_ADDs in the HA branch than we did in trunk.
Resolved some conflicts around removal of VersionedProtocol, etc.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295342 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 23:47:49 +00:00
Aaron Myers
01b17c40cf HDFS-2979. Balancer should use logical uri for creating failover proxy with HA enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295340 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 23:42:52 +00:00