big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,568 Commits 2 Branches 2 Tags 264 MiB
4cb809bf04
Commit Graph

356 Commits

Author SHA1 Message Date
Todd Lipcon
4cb809bf04 HDFS-3132. Fix findbugs warning on HDFS trunk. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304681 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 00:21:52 +00:00
Todd Lipcon
b795c65f49 HDFS-3071. haadmin failover command does not provide enough detail when target NN is not ready to be active. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304203 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 06:29:40 +00:00
Eli Collins
4feef86372 HDFS-3044. fsck move should be non-destructive by default. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304063 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 21:11:18 +00:00
Tsz-wo Sze
0c4acdc176 HDFS-3100. In BlockSender, throw an exception when it needs to verify checksum but the meta data does not exist. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303628 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 00:10:20 +00:00
Todd Lipcon
2f820dde17 HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303485 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 18:14:09 +00:00
Todd Lipcon
f55a1c0876 HDFS-2834. Add a ByteBuffer-based read API to DFSInputStream. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303474 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 17:30:37 +00:00
Tsz-wo Sze
9e108e61fb HDFS-3086. Change Datanode not to send storage list in registration. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303318 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 09:07:33 +00:00
Aaron Myers
4ceca97606 HDFS-3083. Cannot run an MR job with HA and security enabled when second-listed NN active. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303098 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 19:00:56 +00:00
Tsz-wo Sze
6326605acb HDFS-3105. Add DatanodeStorage information to block recovery. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302683 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-19 22:09:14 +00:00
Uma Maheswara Rao G
f77b1a63ec HDFS-3091. Update the usage limitations of ReplaceDatanodeOnFailure policy in the config description for the smaller clusters. Contributed by Nicholas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302624 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-19 19:54:13 +00:00
Uma Maheswara Rao G
3573d504e4 HDFS-3111. Missing license headers in trunk. (Contributed by Uma Maheswara Rao G). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301871 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-17 06:50:36 +00:00
Tsz-wo Sze
2a0024403a HDFS-3104. Add tests for HADOOP-8175. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301665 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 17:48:33 +00:00
Tsz-wo Sze
662b1887af HDFS-3088. Move FSDatasetInterface inner classes to a package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301661 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 17:32:57 +00:00
Tsz-wo Sze
9b2a324ba5 HDFS-3098. Update and add tests for HADOOP-8173. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301295 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 00:27:40 +00:00
Tsz-wo Sze
7e5b60116e HDFS-3101. Cannot read empty file using WebHDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301287 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 00:01:23 +00:00
Todd Lipcon
49619e8997 HDFS-3062. Fix bug which prevented MR job submission from creating delegation tokens on an HA cluster. Contributed by Mingjie Lai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301285 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 00:00:29 +00:00
Aaron Myers
65425b0961 HDFS-3099. SecondaryNameNode does not properly initialize metrics system. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301222 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 21:51:23 +00:00
Aaron Myers
6d96a28a08 HDFS-3067. NPE in DFSInputStream.readBuffer if read is repeated on corrupted block. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301182 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 20:26:29 +00:00
Tsz-wo Sze
1177d4edc2 HDFS-3005. FSVolume.decDfsUsed(..) should be synchronized. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301127 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 18:24:40 +00:00
Todd Lipcon
59eb544744 HDFS-3093. Fix bug where namenode -format interpreted the -force flag in reverse. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300814 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 05:36:03 +00:00
Alejandro Abdelnur
a0ee9adfd3 HDFS-3057. httpfs and hdfs launcher scripts should honor CATALINA_HOME and HADOOP_LIBEXEC_DIR (rvs via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300637 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-14 17:01:34 +00:00
Tsz-wo Sze
3e582c690c HDFS-3082. Clean up FSDatasetInterface and change DataNode.data to package private. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300392 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 22:52:17 +00:00
Eli Collins
ab20dae519 HDFS-2303. Unbundle jsvc. Contributed by Roman Shaposhnik and Mingjie Lai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299963 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 03:38:57 +00:00
Todd Lipcon
1a75ec8288 HDFS-2731. Add command to bootstrap the Standby Node's name directories from the Active NameNode. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299807 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-12 19:41:21 +00:00
Suresh Srinivas
46a88ded0d Moving HDFS-1623 and HADOOP-7454 to 0.23.3 section in CHANGES.txt files 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299417 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-11 18:11:43 +00:00
Tsz-wo Sze
501a283986 HDFS-3056. Add a new interface RollingLogs for DataBlockScanner logging. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299139 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-10 01:52:17 +00:00
Steve Loughran
381a9b2d58 HDFS-2966 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298820 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 13:17:04 +00:00
Uma Maheswara Rao G
b19d1186ab HDFS-2976. Remove unnecessary method (tokenRefetchNeeded) in DFSClient. 
(Contributed by Uma Maheswara Rao G)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298495 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 18:31:33 +00:00
Suresh Srinivas
b874d06133 Moving HDFS-3036, HDFS-3014, HDFS-3003, HDFS-2878, HDFS-208, HDFS-2764, HDFS-2410, HDFS-2285, HDFS-2507 to 0.23.3 section 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298274 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 05:23:50 +00:00
Tsz-wo Sze
22738ae1d0 HDFS-2038. Update TestHDFSCLI to handle relative paths with globs. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298066 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-07 19:44:47 +00:00
Eli Collins
0a2b413dff HDFS-3060. Bump TestDistributedUpgrade#testDistributedUpgrade timeout. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298044 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-07 19:16:03 +00:00
Suresh Srinivas
6f8d347b83 Moving HDFS-2158, HDFS-2188, HDFS-2334, HDFS-2477, HDFS-2495, HDFS-2476, HDFS-1580, HDFS-1765 to 0.23.3 section in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297903 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-07 09:15:30 +00:00
Tsz-wo Sze
0ee71adeb4 HDFS-3032. Change DFSClient.renewLease() so that it only retries up to the lease soft-limit. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297328 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 02:42:46 +00:00
Aaron Myers
8e303014bc Fix up CHANGES.txt files post commit of HDFS-1623 and HADOOP-7454. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296540 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-03 00:50:04 +00:00
Aaron Myers
8a99218853 HDFS-3038. Add FSEditLog.metrics to findbugs exclude list. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296019 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 01:37:02 +00:00
Aaron Myers
6da670ce6a HDFS-3037. TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296016 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 01:26:54 +00:00
Tsz-wo Sze
b2f67b4704 HADOOP-8124, HDFS-3034, MAPREDUCE-3956. Remove the deprecated Syncable.sync(). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295999 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 23:51:19 +00:00
Aaron Myers
f22677ef8e HDFS-3036. Remove unused method DFSUtil#isDefaultNamenodeAddress. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295961 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 22:52:05 +00:00
Tsz-wo Sze
9e31bf675d HDFS-3021. Use generic type to declare FSDatasetInterface. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295929 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 21:58:39 +00:00
Arun Murthy
753c2ba66c HDFS-3012. Moving to hadoop-0.23.2. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295310 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 22:07:03 +00:00
Todd Lipcon
28de3628f5 HDFS-3020. Fix editlog to automatically sync when buffer is full. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295239 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 19:57:18 +00:00
Jitendra Nath Pandey
ca9b4de772 HDFS-3012. Exception while renewing delegation token. Contributed by Bobby Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295232 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 19:36:17 +00:00
Eli Collins
fbf3a9ee3d HDFS-2992. Edit log failure trace should include transaction ID of error. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295227 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 19:31:36 +00:00
Todd Lipcon
34c73db5e1 HDFS-2991. Fix case where OP_ADD would not be logged in append(). Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295214 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 18:52:00 +00:00
Jitendra Nath Pandey
e57fd85fd4 HDFS-3030. Remove getProtocolVersion and getProtocolSignature from translators. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295017 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 08:52:45 +00:00
Aaron Myers
e58b7e202b HDFS-3014. FSEditLogOp and its subclasses should have toString() method. Contributed by Sho Shimauchi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294926 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 01:17:37 +00:00
Jitendra Nath Pandey
daf782ca7e HDFS-3016. Security in unit tests. Contributed by Jaimin Jetly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294773 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 18:41:25 +00:00
Todd Lipcon
7decf112c0 HDFS-3024. Improve performance of stringification in addStoredBlock. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294754 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 18:04:13 +00:00
Tsz-wo Sze
12b3ce7205 Move entries to 0.23.3 in CHANGES.txt for the 0.23-PB merge. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294431 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 01:10:53 +00:00
Aaron Myers
b57260f848 HDFS-2978. The NameNode should expose name dir statuses via JMX. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293707 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-25 22:14:53 +00:00