big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,544 Commits 2 Branches 2 Tags 264 MiB
807e08334e
Commit Graph

1317 Commits

Author SHA1 Message Date
Suresh Srinivas
7e56bfe405 HDFS-4200. Reduce the size of synchronized sections in PacketResponder. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413826 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-26 20:47:58 +00:00
Tsz-wo Sze
0f1899ee19 HDFS-4216. Do not ignore QuotaExceededException when adding symlinks. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412237 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 19:27:48 +00:00
Thomas White
d6af507199 HADOOP-9049. DelegationTokenRenewer needs to be Singleton and FileSystems should register/deregister to/from. Contributed by Karthik Kambatla. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412077 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 12:29:37 +00:00
Tsz-wo Sze
506938f0b3 HDFS-4215. Remove locking from addToParent(..) since it is used in image loading, and add INode.isFile(). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411947 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 00:13:53 +00:00
Eli Collins
c3f13a7fef HADOOP-9042. Add a test for umask in FileSystemContractBaseTest. Contributed by Colin McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411879 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-20 21:13:48 +00:00
Konstantin Shvachko
573c41c266 HDFS-4179. BackupNode: allow reads, fix checkpointing, safeMode. (shv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411508 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-20 02:00:20 +00:00
Daryn Sharp
c944d0666c HDFS-4178. Shell scripts should not close stderr (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411229 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-19 15:04:28 +00:00
Tsz-wo Sze
d66f9e8269 HDFS-4206. Change the fields in INode and its subclasses to private. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410996 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 22:03:11 +00:00
Alejandro Abdelnur
6f80a2a76c HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410824 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 04:10:29 +00:00
Eli Collins
ecbb41923c HDFS-4156. Seeking to a negative position should throw an IOE. Contributed by Eli Reisman 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410812 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 02:11:50 +00:00
Jitendra Nath Pandey
1cbc38a878 HDFS-4105. The SPNEGO user for secondary namenode should use the web keytab. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410691 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-17 03:30:48 +00:00
Aaron Myers
320c32a289 HDFS-3507. DFS#isInSafeMode needs to execute only on Active NameNode. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410587 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-16 21:51:39 +00:00
Todd Lipcon
51ca2fd3e9 HDFS-3935. Add JournalNode to the start/stop scripts. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410584 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-16 21:45:48 +00:00
Eli Collins
96f28d878e HDFS-4100. Fix all findbug security warings. Contributed by Liang Xie 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409995 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 20:37:41 +00:00
Daryn Sharp
298eb42657 HDFS-4186. logSync() is called with the write lock held while releasing lease (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409988 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 20:33:30 +00:00
Uma Maheswara Rao G
8a2de21315 HDFS-3623. BKJM: zkLatchWaitTimeout hard coded to 6000. Make use of ZKSessionTimeout instead. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409905 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 18:25:55 +00:00
Daryn Sharp
97e52dd71e HDFS-4104. dfs -test -d prints inappropriate error on nonexistent directory (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409848 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 15:51:03 +00:00
Robert Joseph Evans
59e4199d84 HDFS-4182. SecondaryNameNode leaks NameCache entries (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409311 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 19:21:25 +00:00
Robert Joseph Evans
b2456ca3b8 svn merge -r 1409087:1409086 reverting HDFS-4171 until test failures can be fixed. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409266 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 17:32:55 +00:00
Eli Collins
a780f0ac33 HDFS-4139. fuse-dfs RO mode still allows file truncation. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409088 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 06:17:19 +00:00
Alejandro Abdelnur
368f628ce5 HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409087 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 06:12:03 +00:00
Uma Maheswara Rao G
0800aa90dd HDFS-4038. Override toString() for BookKeeperEditLogInputStream. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409071 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 03:10:10 +00:00
Daryn Sharp
4741064250 HDFS-4181. LeaseManager tries to double remove and prints extra messages (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408779 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 15:29:04 +00:00
Eli Collins
3492ab6de0 HDFS-1322. Document umask in DistributedFileSystem#mkdirs javadocs. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408532 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 01:28:33 +00:00
Aaron Myers
b3e42a1ed5 HDFS-3921. NN will prematurely consider blocks missing when entering active state while still in safe mode. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408531 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 01:26:20 +00:00
Eli Collins
c1a2098304 HDFS-4164. fuse_dfs: add -lrt to the compiler command line on Linux. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408477 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 22:20:43 +00:00
Robert Joseph Evans
7ff7f67a82 HDFS-4172. namenode does not URI-encode parameters when building URI for datanode request (Derek Dagit via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408401 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 18:51:27 +00:00
Thomas White
42f4691ead Add new files missed from HADOOP-8860 commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408288 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 13:54:27 +00:00
Alejandro Abdelnur
9d5205aadd HADOOP-8860. Split MapReduce and YARN sections in documentation navigation. (tomwhite via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407658 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 21:44:00 +00:00
Suresh Srinivas
db71de2e11 HDFS-4080. Add a separate logger for block state change logs to enable turning off those logs. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407566 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 18:07:04 +00:00
Suresh Srinivas
c7ab9779d2 HDFS-4162. Some malformed and unquoted HTML strings are returned from datanode web ui. Contributed by Darek Dagit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407556 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 17:39:20 +00:00
Eli Collins
312eb23598 HDFS-4048. Use ERROR instead of INFO for volume failure logs. Contributed by Stephen Chu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407345 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 02:57:05 +00:00
Daryn Sharp
be94bf6b57 HDFS-3990. NN's health report has severe performance problems (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407333 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 00:53:11 +00:00
Suresh Srinivas
0f7a4337ac HDFS-4165. Faulty sanity check in FsDirectory.unprotectedSetQuota. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407245 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-08 19:54:55 +00:00
Uma Maheswara Rao G
f1fe91ec95 HDFS-3810. Implement format() for BKJM. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407182 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-08 17:45:46 +00:00
Konstantin Shvachko
1ab97373de HDFS-4138. BackupNode startup fails due to uninitialized edit log. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406734 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 17:45:01 +00:00
Aaron Myers
817a26b6c8 HDFS-4153. Add START_MSG/SHUTDOWN_MSG for JournalNode. Contributed by liang xie. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406473 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 06:29:37 +00:00
Suresh Srinivas
c013142a12 HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406413 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 00:48:17 +00:00
Tsz-wo Sze
1e7010cf38 HDFS-3979. For hsync, datanode should wait for the local sync to complete before sending ack. Contributed by Lars Hofhansl 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406382 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 22:34:29 +00:00
Suresh Srinivas
251230a126 HADOOP-9004. Reverting the commit r1406202 to address patch issue 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406379 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 22:23:51 +00:00
Todd Lipcon
a3f3a6c5a3 HDFS-4155. libhdfs implementation of hsync API. Contributed by Liang Xie. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406372 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 22:05:34 +00:00
Tsz-wo Sze
1734215a10 HDFS-4152. Add a new class BlocksMapUpdateInfo for the parameter in INode.collectSubtreeBlocksAndClear(..). Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406326 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 21:04:32 +00:00
Daryn Sharp
54b70db347 HDFS-4075. Reduce recommissioning overhead (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406278 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 19:27:47 +00:00
Suresh Srinivas
b13a5cdcb7 HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406202 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 16:12:43 +00:00
Daryn Sharp
3a698e6aea HDFS-1331. dfs -test should work like /bin/test (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406198 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 15:57:58 +00:00
Suresh Srinivas
159e507995 HDFS-4046. Adding the missed file in revision 1406011 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406012 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 23:50:29 +00:00
Suresh Srinivas
e0ce1b2475 HDFS-4046. Rename ChecksumTypeProto enum NULL since it is illegal in C/C++. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406011 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 23:49:33 +00:00
Tsz-wo Sze
7ee5ce3176 HDFS-4151. Change the methods in FSDirectory to pass INodesInPath instead of INode[] as a parameter. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406006 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 23:26:34 +00:00
Tsz-wo Sze
d174f574ba HDFS-4143. Change blocks to private in INodeFile and renames isLink() to isSymlink() in INode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405237 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-03 00:20:03 +00:00
Todd Lipcon
a9e4b08f2b HDFS-4132. When libwebhdfs is not enabled, nativeMiniDfsClient frees uninitialized memory. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405149 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-02 20:35:51 +00:00
Daryn Sharp
19befa0748 HDFS-3804. TestHftpFileSystem fails intermittently with JDK7 (Trevor Robinson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404985 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-02 14:56:22 +00:00
Suresh Srinivas
07e0d7730d HDFS-4129. Add utility methods to dump NameNode in memory tree for testing. Contributed by Tsz Wo (Nicholas), SZE. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403956 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 02:33:44 +00:00
Suresh Srinivas
cd0d206bb8 HDFS-3916. libwebhdfs testing code cleanup. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403922 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 23:12:12 +00:00
Daryn Sharp
deef03c5d6 HADOOP-8994. TestDFSShell creates file named "noFileHere", making further tests hard to understand (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403714 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 14:21:00 +00:00
Suresh Srinivas
7604a276a7 HDFS-4127. Log message is not correct in case of short of replica. Contributed by Junping Du. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403616 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 05:48:58 +00:00
Suresh Srinivas
1b3b09d947 HDFS-4124. Refactor INodeDirectory#getExistingPathINodes() to enable returningmore than INode array. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403304 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 14:11:04 +00:00
Suresh Srinivas
4bcf516d0e HDFS-3920. libwebdhfs string processing and using strerror consistently to handle all errors. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403173 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 05:10:29 +00:00
Suresh Srinivas
cea7bbc630 HDFS-4122. Cleanup HDFS logs and reduce the size of logged messages. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403120 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-28 23:10:53 +00:00
Suresh Srinivas
fd7de4c4eb HDFS-4106. BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be volatile. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403075 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-28 19:03:57 +00:00
Suresh Srinivas
abe3676e50 HDFS-4115. TestHDFSCLI.testAll fails one test due to number format. Contributed by Trevor Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403074 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-28 18:59:11 +00:00
Suresh Srinivas
cd2e9d2fce HDFS-4121. Add namespace declarations in hdfs .proto files for languages other than java. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402836 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-27 18:25:02 +00:00
Tsz-wo Sze
3335e50244 HDFS-3616. Fix a ConcurrentModificationException bug that BP actor threads may not be shutdown properly in DataNode. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402608 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 18:22:49 +00:00
Tsz-wo Sze
0e796b61e8 HDFS-4112. A few improvements on INodeDirectory include adding a utility method for casting; avoiding creation of new empty lists; cleaning up some code and rewriting some javadoc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402599 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 18:08:38 +00:00
Tsz-wo Sze
2d74f68054 HDFS-3948. Do not use hflush in TestWebHDFS.testNamenodeRestart() since the out stream returned by WebHdfsFileSystem does not support it. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402270 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 18:53:25 +00:00
Tsz-wo Sze
ba2ee1d7fb HDFS-4107. Add utility methods for casting INode to INodeFile and INodeFileUnderConstruction. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402265 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 18:44:46 +00:00
Suresh Srinivas
163577f905 HDFS-4067. TestUnderReplicatedBlocks intermittently fails due to ReplicaAlreadyExistsException. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402261 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 18:32:41 +00:00
Suresh Srinivas
611684e2e5 HDFS-4110. Refine a log printed in JNStorage. Contributed by Liang Xie. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402203 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 16:15:59 +00:00
Suresh Srinivas
aa42e2161d HDFS-2434. TestNameNodeMetrics.testCorruptBlock fails intermittently. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401423 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 20:02:09 +00:00
Daryn Sharp
a92313f7bd HDFS-4090. getFileChecksum() result incompatible when called against zero-byte files. (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401309 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 15:03:53 +00:00
Tsz-wo Sze
75cdb5bb49 HDFS-4099. Clean up replication code and add more javadoc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400986 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-22 18:30:16 +00:00
Uma Maheswara Rao G
35ec20b7c6 HDFS-4022. Replication not happening for appended block. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400578 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-21 06:31:31 +00:00
Tsz-wo Sze
661a8d176a HDFS-4088. Remove "throws QuotaExceededException" from an INodeDirectoryWithQuota constructor. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400345 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-20 00:06:12 +00:00
Suresh Srinivas
0603447f2a HDFS-4072. On file deletion remove corresponding blocks pending replications. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399965 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 04:55:11 +00:00
Eli Collins
7da5d03c35 HDFS-4053. Increase the default block size. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399908 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-18 22:56:30 +00:00
Eli Collins
57ee22e589 HADOOP-8925. Remove the packaging. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399889 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-18 22:30:11 +00:00
Tsz-wo Sze
4af8761e4c HDFS-4074. Remove the unused default constructor from INode. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399866 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-18 21:29:12 +00:00
Tsz-wo Sze
c1bd54daa3 HDFS-4073. Two minor improvements to FSDirectory. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399861 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-18 21:18:25 +00:00
Eli Collins
4d5600f6c7 HDFS-4068. DatanodeID and DatanodeInfo member should be private. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399443 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 21:34:48 +00:00
Eli Collins
a258263ecf HDFS-4029. GenerationStamp should use an AtomicLong. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399096 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 04:58:24 +00:00
Eli Collins
24015b7684 HDFS-4055. TestAuditLogs is flaky. Contributed by Binglin Chang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399093 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 04:39:07 +00:00
Aaron Myers
402836479f HDFS-3997. OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED element. Contributed by Mithun Radhakrishnan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399062 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 01:10:55 +00:00
Eli Collins
e074b5816a HDFS-4061. TestBalancer and TestUnderReplicatedBlocks need timeouts. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399010 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 21:59:15 +00:00
Suresh Srinivas
0ef9c6f71a HDFS-4059. Add number of stale DataNodes to metrics. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398949 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 19:39:50 +00:00
Eli Collins
b245adb163 HDFS-3985. Add timeouts to TestMulitipleNNDataBlockScanner. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398874 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 16:29:21 +00:00
Suresh Srinivas
b7887f31fb HDFS-4052. BlockManager#invalidateWork should print log outside the lock. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398631 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 03:37:49 +00:00
Eli Collins
a75673cbd8 HDFS-4058. DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398612 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 02:12:59 +00:00
Aaron Myers
557ffe2101 HDFS-2946. HA: Put a cap on the number of completed edits files retained by the NN. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398609 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 01:59:46 +00:00
Todd Lipcon
ded304e6a6 HDFS-4049. Fix hflush performance regression due to nagling delays. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398591 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 00:55:29 +00:00
Tsz-wo Sze
698fa5077a HDFS-4036. Remove "throw UnresolvedLinkException" from FSDirectory.unprotectedAddFile(..). Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398293 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-15 14:05:31 +00:00
Tsz-wo Sze
ad06a08713 HDFS-4037. Rename the getReplication() method in BlockCollection to getBlockReplication(). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398288 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-15 13:48:56 +00:00
Jason Darrell Lowe
f8bdac0a1b HADOOP-8906. paths with multiple globs are unreliable. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397704 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 19:49:40 +00:00
Suresh Srinivas
89b66da42c HDFS-4044. Duplicate ChecksumType definition in HDFS .proto files. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397580 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 14:32:16 +00:00
Suresh Srinivas
94ed14c48c HADOOP-8911. CRLF characters in source and text files. Contributed Raja Aluri. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397432 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 04:35:42 +00:00
Suresh Srinivas
4e64e6f860 HDFS-4041. Hadoop HDFS Maven protoc calls must not depend on external sh script. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397362 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 23:10:47 +00:00
Suresh Srinivas
2887bbb33c HDFS-3912. Detect and avoid stale datanodes for writes. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397211 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 18:08:27 +00:00
Todd Lipcon
ff8f84ccf6 Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1396918 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 06:14:26 +00:00
Suresh Srinivas
33c16f2a24 HADOOP-8913. hadoop-metrics2.properties should give units in comment for sampling period. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396904 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 05:17:03 +00:00
Aaron Myers
8078e16015 HDFS-4021. Misleading error message when resources are low on the NameNode. Contributed by Christopher Conner. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396881 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 00:32:46 +00:00
Jason Darrell Lowe
08f35a04c6 HDFS-3224. Bug in check for DN re-registration with different storage ID. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396798 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 21:15:06 +00:00
Eli Collins
c9a1d4dc33 HDFS-4020. TestRBWBlockInvalidation may time out. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396725 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 18:42:54 +00:00
Thomas Graves
a0a96eb142 HDFS-3824. TestHftpDelegationToken fails intermittently with JDK7 (Trevor Robinson via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396705 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 17:35:18 +00:00
Eli Collins
03c96ef29e HDFS-4018. TestDataNodeMultipleRegistrations#testMiniDFSClusterWithMultipleNN is missing some cluster cleanup. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395821 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 00:18:27 +00:00
Todd Lipcon
17b32bb2de HDFS-4007. Rehabilitate bit-rotted unit tests under hadoop-hdfs-project/hadoop-hdfs/src/test/unit/. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395731 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 19:19:21 +00:00
Todd Lipcon
70fc5cf01c HDFS-4017. Unclosed FileInputStream in GetJournalEditServlet. Contributed by Chao Shi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1395727 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 19:11:48 +00:00
Eli Collins
5dcdc8aa58 HDFS-4003. test-patch should build the common native libs before running hdfs tests. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395708 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 18:34:14 +00:00
Eli Collins
3a4cf1c064 HDFS-4008. TestBalancerWithEncryptedTransfer needs a timeout. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395700 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 18:11:53 +00:00
Eli Collins
5a5473b29f HDFS-4006. TestCheckpoint#testSecondaryHasVeryOutOfDateImage occasionally fails due to unexpected exit. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395387 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-07 21:35:51 +00:00
Eli Collins
e32af6034b HDFS-3682. MiniDFSCluster#init should provide more info when it fails. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395385 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-07 21:16:08 +00:00
Aaron Myers
353958dccc HDFS-3483. Better error message when hdfs fsck is run against a ViewFS config. Contributed by Stephen Fritz. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394864 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-06 00:13:28 +00:00
Thomas Graves
d35169d9ba HDFS-3829. TestHftpURLTimeouts fails intermittently with JDK7 (Trevor Robinson via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394609 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 15:51:10 +00:00
Suresh Srinivas
dfb8369c29 HDFS-3735. NameNode WebUI should allow sorting live datanode list by fields Block Pool Used, Block Pool Used(%) and Failed Volumes. Contributed by Brahma Reddy Battula. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394385 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 07:02:52 +00:00
Suresh Srinivas
a41f808c3c HDFS-3995. Use DFSTestUtil.createFile() for file creation and writing in test cases. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394376 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 06:22:26 +00:00
Aaron Myers
6582da034b HDFS-3813. Log error message if security and WebHDFS are enabled but principal/keytab are not configured. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394340 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 00:54:05 +00:00
Eli Collins
ee13fb4f69 HDFS-3916. libwebhdfs (C client) code cleanups. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393890 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 02:53:28 +00:00
Eli Collins
38943644e0 HDFS-4000. TestParallelLocalRead fails with "input ByteBuffers must be direct buffers". Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393884 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 02:41:04 +00:00
Eli Collins
2c66a9f5ae HDFS-2127. Add a test that ensure AccessControlExceptions contain a full path. Contributed by Stephen Chu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393878 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 02:06:56 +00:00
Todd Lipcon
10a0eaaf0a HDFS-4004. TestJournalNode#testJournal fails because of test case execution order. Contributed by Chao Shi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1393870 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 01:40:12 +00:00
Eli Collins
5c19b6b7b6 Amend HDFS-3753 to ignore TestHdfsNativeCodeLoader. To be fixed in HDFS-4003. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393830 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 23:38:08 +00:00
Eli Collins
43ae84761f HDFS-3996. Add debug log removed in HDFS-3873 back. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393777 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 21:30:45 +00:00
Eli Collins
f8f79a02aa HDFS-3753. Tests don't run with native libraries. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393113 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-02 19:13:53 +00:00
Harsh J
34becbb019 HADOOP-8386. hadoop script doesn't work if 'cd' prints to stdout (default behavior in Ubuntu). Contributed by Christopher Berner and Andy Isaacson. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391780 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 10:57:53 +00:00
Aaron Myers
648ba4a36b HDFS-3992. Method org.apache.hadoop.hdfs.TestHftpFileSystem.tearDown() sometimes throws NPEs. Contributed by Ivan A. Veselovsky. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391763 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 07:30:45 +00:00
Aaron Myers
e8dc3b3a8a HDFS-3896. Add descriptions for dfs.namenode.rpc-address and dfs.namenode.servicerpc-address to hdfs-default.xml. Contributed by Jeff Lord. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391708 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 00:51:48 +00:00
Todd Lipcon
802ccafcd9 Fix some spurious whitespace changes in branch (per Suresh's review) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1391247 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 22:37:58 +00:00
Robert Joseph Evans
01c0dc98bb HDFS-3831. Failure to renew tokens due to test-sources left in classpath (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391121 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 17:31:48 +00:00
Eli Collins
a33ae4020d HADOOP-8855. SSL-based image transfer does not work when Kerberos is disabled. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390841 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 05:03:42 +00:00
Eli Collins
47dfcf45af HDFS-3972. Trash emptier fails in secure HA cluster. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390729 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 21:25:04 +00:00
Tsz-wo Sze
a7bcdcc051 HDFS-3373. Change DFSClient input stream socket cache to global static and add a thread to cleanup expired cache entries. Contributed by John George 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390466 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 13:23:21 +00:00
Todd Lipcon
b1ceaac3e6 Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1390199 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 22:43:04 +00:00
Harsh J
9c9b3f09ed HADOOP-8158. Interrupting hadoop fs -put from the command line causes a LeaseExpiredException. Contributed by Daryn Sharp. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389010 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-23 10:50:44 +00:00
Harsh J
bd76d9a827 HADOOP-8833. fs -text should make sure to call inputstream.seek(0) before using input stream. Contributed by Tom White and Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388869 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-22 18:56:07 +00:00
Eli Collins
fa6d519657 HDFS-3964. Make NN log of fs.defaultFS debug rather than info. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388335 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 06:17:29 +00:00
Eli Collins
3ea3508319 HDFS-3931. TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388331 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 05:48:42 +00:00
Eli Collins
7dee7f11f6 HDFS-3932. NameNode Web UI broken if the rpc-address is set to the wildcard. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388321 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 04:51:43 +00:00
Eli Collins
d26f05b7f5 HDFS-3949. NameNodeRpcServer#join should join on both client and server RPC servers. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387838 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-20 01:33:13 +00:00
Todd Lipcon
8a3e64c77f HDFS-3956. QJM: purge temporary files when no longer within retention period. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387817 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 23:40:59 +00:00
Todd Lipcon
f26c63df21 Amend HFDS-3955. Forgot an import of ImmutableList in previous patch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387740 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 20:24:12 +00:00
Todd Lipcon
3ccd905d8a HDFS-3955. QJM: Make acceptRecovery() atomic. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387706 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 18:57:11 +00:00
Todd Lipcon
663e7484c0 HDFS-3950. QJM: misc TODO cleanup, improved log messages, etc. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387704 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 18:52:15 +00:00
Alejandro Abdelnur
8bf6b80f2b Reverting HADOOP-8805 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387697 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 18:06:42 +00:00
Alejandro Abdelnur
7fb42f8f4b HDFS-3951. datanode web ui does not work over HTTPS when datanode is started in secure mode. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387688 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 17:39:46 +00:00
Todd Lipcon
e9f4de5ced Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387449 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 04:34:55 +00:00
Alejandro Abdelnur
9f6cfe32e4 HADOOP-8805. Move protocol buffer implementation of GetUserMappingProtocol from HDFS to Common. (bowang via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387298 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 18:15:37 +00:00
Eli Collins
a8e4bb81b2 HDFS-3939. NN RPC address cleanup. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387278 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 17:42:09 +00:00
Eli Collins
ea6a36e2e7 HADOOP-8812. ExitUtil#terminate should print Exception#toString. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387273 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 17:32:01 +00:00
Eli Collins
7e3776ca6e HDFS-3936. MiniDFSCluster shutdown races with BlocksMap usage. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387255 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 16:59:47 +00:00
Todd Lipcon
83c14fbd24 HDFS-3943. QJM: remove currently-unused md5sum field. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1386863 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 21:51:40 +00:00
Eli Collins
4d2e77bc1c Revert previous commit - accidentally included two changes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386783 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 19:28:14 +00:00
Eli Collins
8a9debd0ef HADOOP-8806. libhadoop.so: dlopen should be better at locating libsnappy.so, etc. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386780 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 19:25:05 +00:00
Thomas White
d89828573d HADOOP-8780. Update DeprecatedProperties apt file. Contributed by Ahmed Radwan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384833 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-14 16:05:30 +00:00
Aaron Myers
86635168fe HDFS-3924. Multi-byte id in HdfsVolumeId. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384602 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-13 23:48:25 +00:00
Todd Lipcon
40d56f1741 HDFS-3894. QJM: testRecoverAfterDoubleFailures can be flaky due to IPC client caching. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1384592 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-13 23:00:22 +00:00
Suresh Srinivas
d543140089 HDFS-3703. Datanodes are marked stale if heartbeat is not received in configured timeout and are selected as the last location to read from. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384209 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-13 05:46:18 +00:00
Eli Collins
4f312cfa70 HDFS-3928. MiniDFSCluster should reset the first ExitException on shutdown. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384092 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 19:15:38 +00:00
Eli Collins
2ba149f85c HDFS-3902. TestDatanodeBlockScanner#testBlockCorruptionPolicy is broken. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384081 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 18:36:01 +00:00
Todd Lipcon
80a8d57ffc HDFS-3925. Prettify PipelineAck#toString() for printing to a log. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384078 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 18:32:57 +00:00
Eli Collins
f0c3ed79dd HDFS-3919. MiniDFSCluster:waitClusterUp can hang forever. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383759 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 04:21:31 +00:00
Eli Collins
414abe6918 HDFS-3664. BlockManager race when stopping active services. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383753 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 04:10:58 +00:00
Eli Collins
dc1fd84bd1 HDFS-3910. DFSTestUtil#waitReplication should timeout. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383618 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 21:24:12 +00:00
Todd Lipcon
a93ba1648a HDFS-3840. JournalNodes log JournalNotFormattedException backtrace error before being formatted. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383252 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 06:33:47 +00:00
Todd Lipcon
8a8c9c18d3 HDFS-3906. QJM: quorum timeout on failover with large log segment. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383251 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 06:31:42 +00:00
Todd Lipcon
c859e87d1e HDFS-3915. QJM: Failover fails with auth error in secure cluster. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383242 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 04:53:08 +00:00
Todd Lipcon
c5199cace6 HDFS-3914. QJM: acceptRecovery should abort current segment. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383148 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 23:20:49 +00:00
Todd Lipcon
729ec86907 HDFS-3899. Add client side metrics for QJM. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383139 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 22:39:46 +00:00
Todd Lipcon
959afc0fd3 HDFS-3901. QJM: send 'heartbeat' messages to JNs even when they are out-of-sync. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383137 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 22:30:52 +00:00
Todd Lipcon
60c20e559b HDFS-3900. QJM: avoid validating log segments on log rolls. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383041 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:53:41 +00:00
Todd Lipcon
ca4582222e HDFS-3885. QJM: optimize log sync when JN is lagging behind. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383039 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:51:15 +00:00
Todd Lipcon
aa65777ef0 HDFS-3898. QJM: enable TCP_NODELAY for IPC. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383033 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:46:58 +00:00
Eli Collins
e1ffefa860 HDFS-3907. Allow multiple users for local block readers. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383031 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:46:13 +00:00
Todd Lipcon
1cea56d6ef Merge trunk into QJM branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383030 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:45:45 +00:00
Tsz-wo Sze
009235f4a9 HDFS-2656. Add libwebhdfs, a pure C client based on WebHDFS. Contributed by Jaimin D Jetly and Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382836 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 13:43:28 +00:00
Eli Collins
3a4dcfba57 HDFS-2757. Cannot read a local block that's being written to when using the local read short circuit. Contributed by Jean-Daniel Cryans 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382409 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-09 06:37:31 +00:00
Aaron Myers
16234cbd5f HDFS-3897. QJM: TestBlockToken fails after HDFS-3893. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381842 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 02:01:21 +00:00
Aaron Myers
df801074c9 HDFS-3893. QJM: Make QJM work with security enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381770 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 21:42:14 +00:00
Uma Maheswara Rao G
0654590853 Removed unnecessary .org files added in previous commit HDFS-3809 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381700 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 18:05:30 +00:00
Uma Maheswara Rao G
6fd7df77a5 HDFS-3809. Make BKJM use protobufs for all serialization with ZK. Contributed by Ivan Kelly 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381699 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 18:03:16 +00:00
Todd Lipcon
8b88542f60 Amend HDFS-3726. Add previously missing file JournalOutOfSyncException.java 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381681 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 16:59:51 +00:00
Daryn Sharp
82b981cca4 HDFS-3890. filecontext mkdirs doesn't apply umask as expected (Tom Graves via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381606 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 14:06:58 +00:00
Todd Lipcon
cae8116a14 HDFS-3726. If a logger misses an RPC, don't retry that logger until next segment. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381482 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 07:03:57 +00:00
Todd Lipcon
437948ea1c HDFS-3891. Make selectInputStreams throw IOE instead of RTE. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381481 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 06:57:18 +00:00
Eli Collins
01db4d2bb2 HDFS-3828. Block Scanner rescans blocks too frequently. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381472 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 06:19:30 +00:00
Eli Collins
91e832e7b4 HADOOP-8770. NN should not RPC to self to find trash defaults. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381319 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 19:42:09 +00:00
Todd Lipcon
99ec5bd8d3 Merge trunk into QJM branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380990 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:57:47 +00:00
Todd Lipcon
31142aa892 HDFS-1490. TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380988 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:53:15 +00:00
Todd Lipcon
c334cc89a8 HDFS-2793. Add an admin command to trigger an edit log roll. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380982 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:40:23 +00:00
Todd Lipcon
13daca1ef6 HDFS-3870. Add metrics to JournalNode. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380980 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:30:51 +00:00
Todd Lipcon
f6b7f067c3 HDFS-3884. Journal format() should reset cached values. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380979 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:27:49 +00:00
Todd Lipcon
72485f3112 HDFS-3869. Expose non-file journal manager details in web UI. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380978 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:16:02 +00:00
Todd Lipcon
8021d9199f HDFS-3863. Track last "committed" txid in QJM. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380976 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:13:19 +00:00
Tsz-wo Sze
658e7b5818 HDFS-3888. Clean up BlockPlacementPolicyDefault. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380939 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-04 23:56:10 +00:00
Tsz-wo Sze
f3927595cc HDFS-3887. Remove redundant chooseTarget methods in BlockPlacementPolicy. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380934 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-04 23:48:01 +00:00
Uma Maheswara Rao G
3969bcb7c9 HDFS-3469. start-dfs.sh will start zkfc, but stop-dfs.sh will not stop zkfc similarly. Contributed by Vinay 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380003 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-02 16:20:13 +00:00
Suresh Srinivas
da3bd67138 HDFS-3880. Use Builder to build RPC server in HDFS. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379917 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-02 06:20:41 +00:00
Harsh J
54e612bfb9 HDFS-2580. NameNode#main(...) can make use of GenericOptionsParser. Contributed by harsh. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379828 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-01 19:22:11 +00:00
Tsz-wo Sze
50222ff529 HDFS-3871. Change NameNodeProxies to use RetryUtils. Contributed by Arun C Murthy 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379743 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-01 11:41:15 +00:00
Eli Collins
6f5ae49063 HDFS-3877. QJM: Provide defaults for dfs.journalnode.*address. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1379681 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-01 00:35:19 +00:00
Owen O'Malley
c76a7893f9 HDFS-3466. Get HTTP kerberos principal from the web authentication keytab. 
(omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379646 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 22:31:03 +00:00
Daryn Sharp
94c69f2c82 HDFS-3852. TestHftpDelegationToken is broken after HADOOP-8225 (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379623 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 21:31:55 +00:00
Daryn Sharp
3819c964fa HDFS-3873. Hftp assumes security is disabled if token fetch fails (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379615 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 21:24:48 +00:00
Suresh Srinivas
2fd49f5a57 HDFS-3833. TestDFSShell fails on windows due to concurrent file read/write. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379525 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 17:43:35 +00:00