big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
7,188 Commits 2 Branches 2 Tags 264 MiB
12711177d3
Commit Graph

2405 Commits

Author SHA1 Message Date
Kihwal Lee
2499a86664 HDFS-4994. Audit log getContentSummary() calls. Contributed by Robert Parker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516237 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-21 18:15:26 +00:00
Luke Lu
782191f1ba HADOOP-9784. Add a builder for HttpServer. (Junping Du via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516128 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-21 10:12:13 +00:00
Chris Nauroth
5e68bc4cd6 HDFS-4594. WebHDFS open sets Content-Length header to what is specified by length parameter rather than how much data is actually returned. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515989 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-20 22:15:22 +00:00
Andrew Wang
b7a6c5ebb4 HADOOP-9877. Fix listing of snapshot directories in globStatus. (Binglin Chang via Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515955 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-20 20:19:07 +00:00
Andrew Wang
67f86baab0 HDFS-4953. Enable HDFS local reads via mmap. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1515906 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-20 18:07:47 +00:00
Arpit Agarwal
3015429368 HDFS-2933. Improve DataNode Web UI Index Page. (Vivek Ganesan via Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515890 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-20 17:18:53 +00:00
Brandon Li
214d4377fc HDFS-5104 Support dotdot name in NFS LOOKUP operation. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515042 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-17 21:16:50 +00:00
Jing Zhao
52f0259502 HADOOP-9880. SASL changes from HADOOP-9421 breaks Secure HA NN. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514913 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-16 22:35:19 +00:00
Chris Nauroth
9ba95136e2 HDFS-5106. TestDatanodeBlockScanner fails on Windows due to incorrect path format. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514911 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-16 22:28:41 +00:00
Arpit Agarwal
218ea7380c HDFS-5105. TestFsck fails on Windows. (Contributed by Chuan Liu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514852 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-16 19:04:43 +00:00
Jing Zhao
8d21926c26 HDFS-5102. Snapshot names should not be allowed to contain slash characters. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514797 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-16 17:14:34 +00:00
Chris Nauroth
d9de6a928d HDFS-5103. TestDirectoryScanner fails on Windows. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514576 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-16 04:38:03 +00:00
Chris Nauroth
99064ec905 HDFS-5100. TestNamenodeRetryCache fails on Windows due to incorrect cleanup. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514573 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-16 04:17:08 +00:00
Colin McCabe
8df7e7deec HADOOP-9865. FileContext#globStatus has a regression with respect to relative path. (Contributed by Chaun Lin) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514531 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 23:05:41 +00:00
Konstantin Shvachko
10ec8a248e HDFS-2994. If lease soft limit is recovered successfully the append can fail. Contributed by Tao Luo. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514500 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 21:21:10 +00:00
Chris Nauroth
2fc7e14e39 HDFS-5099. Namenode#copyEditLogSegmentsToSharedDir should close EditLogInputStreams upon finishing. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514481 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 20:43:46 +00:00
Jing Zhao
02b19e0738 HDFS-5076. Add MXBean methods to query NN's transaction information and JournalNode's journal status. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514422 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 18:22:52 +00:00
Jing Zhao
8172215e56 HDFS-5080. BootstrapStandby not working with QJM when the existing NN is active. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514386 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 17:19:52 +00:00
Chris Nauroth
26c5a490e5 HDFS-5093. TestGlobPaths should re-use the MiniDFSCluster to avoid failure on Windows. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514366 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 16:51:07 +00:00
Chris Nauroth
97d04ae132 HDFS-4632. globStatus using backslash for escaping does not work on Windows. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514168 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 06:03:07 +00:00
Tsz-wo Sze
0182ea16d3 HDFS-4898. BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514156 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 04:52:52 +00:00
Konstantin Shvachko
4c8db60092 HDFS-5079. Cleaning up NNHAStatusHeartbeat.State from DatanodeProtocolProtos. Contributed by Tao Luo. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514118 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 01:29:16 +00:00
Konstantin Shvachko
9cf82b6a7b HDFS-5068. Convert NNThroughputBenchmark to a Tool to allow generic options. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514114 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 01:12:21 +00:00
Suresh Srinivas
b32ace11f1 HDFS-5051. nn fails to download checkpointed image from snn in some setups. Contributed by Vinay and Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514110 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 00:45:48 +00:00
Andrew Wang
dd00bb71aa merge trunk into HDFS-4949 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1514105 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 00:15:11 +00:00
Andrew Wang
49a892056d HDFS-4816. transitionToActive blocks if the SBN is doing checkpoint image transfer. (Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514095 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-14 23:32:29 +00:00
Alejandro Abdelnur
8451ab5c01 HADOOP-9872. Improve protoc version handling and detection. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514068 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-14 22:15:04 +00:00
Jing Zhao
2bea314456 HDFS-5091. Support for spnego keytab separate from the JournalNode keytab for secure HA. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1513700 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-14 00:19:35 +00:00
Doug Cutting
36cedca874 HADOOP-9740. Fix FsShell '-text' command to be able to read Avro files stored in HDFS. Contributed by Allan Yan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1513684 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-13 23:04:55 +00:00
Colin McCabe
70527c8754 merge trunk into HDFS-4949 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1513658 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-13 21:19:53 +00:00
Colin McCabe
52ccc6c6d5 HDFS-5051. Propagate cache status information from the DataNode to the NameNode (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1513653 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-13 21:05:09 +00:00
Alejandro Abdelnur
19b36f0900 HADOOP-9845. Update protobuf to 2.5 from 2.4.x. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1513281 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-12 22:15:10 +00:00
Andrew Wang
d748123e2c TestGlobPath symlink tests fail to cleanup properly. (cmccabe via wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1513251 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-12 20:44:23 +00:00
Ivan Mitic
5726834cae HDFS-5065. TestSymlinkHdfsDisable fails on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1512870 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-11 04:38:19 +00:00
Kihwal Lee
2f988135e3 HDFS-4993. Fsck can fail if a file is renamed or deleted. Contributed by Robert Parker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1512451 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-09 19:13:22 +00:00
Colin McCabe
2a4031940c HDFS-5049. Add JNI mlock support. (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1512427 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-09 18:14:07 +00:00
Kihwal Lee
81f9786ae6 HDFS-5047. Supress logging of full stack trace of quota and lease exceptions. Contributed by Robert Parker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1512057 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-08 21:46:34 +00:00
Brandon Li
6c65076e8e HDFS-4763 Add script changes/utility for starting NFS gateway 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1511519 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-07 22:21:42 +00:00
Jing Zhao
54e144059e HDFS-4926. namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link. Contributed by Vivek Ganesan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1511477 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-07 20:34:39 +00:00
Andrew Wang
95f9a515aa HADOOP-9817. FileSystem#globStatus and FileContext#globStatus need to work with symlinks. (Colin Patrick McCabe via Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510807 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-05 23:28:14 +00:00
Chris Nauroth
ed2c62012a HDFS-4905. Add appendToFile command to "hdfs dfs". Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510773 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-05 22:05:10 +00:00
Kihwal Lee
ccdb978603 HDFS-4366. Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks. Contributed by Derek Dagit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510724 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-05 20:48:59 +00:00
Suresh Srinivas
390d689816 HDFS-5061. Make FSNameSystem#auditLoggers an unmodifiable list. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510611 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-05 17:08:09 +00:00
Colin McCabe
f216f22915 HADOOP-9761. ViewFileSystem#rename fails when using DistributedFileSystem (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509874 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-02 21:42:38 +00:00
Tsz-wo Sze
c04a7d974a HDFS-5028. LeaseRenewer throws ConcurrentModificationException when timeout. Contributed by zhaoyunjiong 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509565 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-02 07:08:35 +00:00
Tsz-wo Sze
1f2d08fbe5 HDFS-4513. Clarify in the WebHDFS REST API that all JSON respsonses may contain additional properties. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509075 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-01 03:47:39 +00:00
Tsz-wo Sze
134557da47 HADOOP-9803. Add a generic type parameter to RetryInvocationHandler. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509070 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-01 02:20:33 +00:00
Colin McCabe
9ad19eec6f HADOOP-9758. Provide configuration option for FS/FC symlink resolution. (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509064 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-01 01:04:29 +00:00
Brandon Li
4f68aa0600 HDFS-5043. For HdfsFileStatus, set default value of childrenNum to -1 instead of 0 to avoid confusing applications. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1508694 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-31 00:49:47 +00:00
Suresh Srinivas
8c7a7e6196 HDFS-5025. Record ClientId and CallId in EditLog to enable rebuilding retry cache in case of HA failover. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1508332 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-30 07:51:38 +00:00
Aaron Myers
215d6331d6 HDFS-5027. On startup, DN should scan volumes in parallel. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1508165 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-29 18:28:07 +00:00
Konstantin Boudnik
dc17bda4b6 HDFS-5004. Add additional JMX bean for NameNode status data. Contributed by Trevor Lorimer. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507530 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 23:59:37 +00:00
Colin McCabe
02d5830a00 HDFS-5035. getFileLinkStatus and rename do not correctly check permissions of symlinks (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507525 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 23:54:17 +00:00
Colin McCabe
07b076917e HDFS-5034. Remove debug prints from GetFileLinkInfo (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507406 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 19:21:31 +00:00
Colin McCabe
55dfadec80 reverting HDFS-5034 because jenkins did not run on it 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507373 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 17:20:18 +00:00
Colin McCabe
569e609c38 HDFS-5034. Remove debug prints from GetFileLinkInfo (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507369 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 17:13:11 +00:00
Tsz-wo Sze
a690a215db HADOOP-9756. Remove the deprecated getServer(..) methods from RPC. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507259 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 10:59:20 +00:00
Suresh Srinivas
7723b139d5 HDFS-5016. Deadlock in pipeline recovery causes Datanode to be marked dead. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507189 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 04:42:41 +00:00
Suresh Srinivas
1b531c1dbb HDFS-4979. Implement retry cache on Namenode. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507170 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 01:09:27 +00:00
Jing Zhao
f138ae68f9 HDFS-5024. Make DatanodeProtocol#commitBlockSynchronization idempotent. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1506789 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-25 00:32:40 +00:00
Jing Zhao
538653d94c HDFS-5020. Make DatanodeProtocol#blockReceivedAndDeleted idempotent. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1506421 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-24 07:18:11 +00:00
Suresh Srinivas
d35f66f3f0 HDFS-4974. Add Idempotent and AtMostOnce annotations to namenode protocol methods. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505911 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-23 06:40:33 +00:00
Suresh Srinivas
9dbd2e7efc HADOOP-9760. Move GSet and related classes to common from HDFS. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505875 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-23 01:40:58 +00:00
Jing Zhao
11c073134a HDFS-5008. Make ClientProtocol#abandonBlock() idempotent. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505761 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-22 18:22:38 +00:00
Colin McCabe
c1314eb2a3 HDFS-4817. Make HDFS advisory caching configurable on a per-file basis. (Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505753 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-22 18:15:18 +00:00
Colin McCabe
74906216fe HADOOP-9435. Support building the JNI code against the IBM JVM. (Tian Hong Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505744 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-22 17:52:03 +00:00
Tsz-wo Sze
3eb61be352 HADOOP-9754. Remove unnecessary "throws IOException/InterruptedException", and fix generic and other javac warnings. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505610 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-22 07:22:14 +00:00
Jing Zhao
febcf4d669 HDFS-5018. Misspelled DFSConfigKeys#DFS_NAMENODE_STALE_DATANODE_INTERVAL_DEFAULT in javadoc of DatanodeInfo#isStale(). Contributed by Ted Yu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505603 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-22 05:28:36 +00:00
Uma Maheswara Rao G
731a583c2b HDFS-4602. TestBookKeeperHACheckpoints fails. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505362 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-21 12:27:38 +00:00
Kihwal Lee
313dd02505 HDFS-5010. Reduce the frequency of getCurrentUser() calls from namenode. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505160 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-20 16:22:11 +00:00
Harsh J
0dc5824a83 HDFS-4278. Log an ERROR when DFS_BLOCK_ACCESS_TOKEN_ENABLE config is disabled but security is turned on. Contributed by Kousuke Saruta. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504784 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-19 07:00:40 +00:00
Jing Zhao
7e2aba0ab5 HDFS-5007. Replace hard-coded property keys with DFSConfigKeys fields. Contributed by Kousuke Saruta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504764 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-19 05:41:33 +00:00
Chris Nauroth
e2efe52ac8 HDFS-4996. ClientProtocol#metaSave can be made idempotent by overwriting the output file instead of appending to it. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504679 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 21:57:24 +00:00
Chris Nauroth
a5cd4b9bee HDFS-5003. TestNNThroughputBenchmark failed caused by existing directories. Contributed by Xi Fang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504352 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 03:28:19 +00:00
Jing Zhao
68faa67f1b HDFS-5005. Move SnapshotException and SnapshotAccessControlException to o.a.h.hdfs.protocol. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504326 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 00:04:28 +00:00
Kihwal Lee
d26334b410 HDFS-4998. TestUnderReplicatedBlocks fails intermittently. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503971 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-17 01:57:35 +00:00
Jason Darrell Lowe
febc5040b9 HADOOP-9734. Common protobuf definitions for GetUserMappingsProtocol, RefreshAuthorizationPolicyProtocol and RefreshUserMappingsProtocol. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503954 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-17 00:06:48 +00:00
Colin McCabe
badab7ed5e HDFS-4657. Limit the number of blocks logged by the NN after a block report to a configurable value. (Aaron Twinning Meyers via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503862 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 20:07:42 +00:00
Colin McCabe
32076136f7 HADOOP-9618. thread which detects GC pauses (Todd Lipcon via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503806 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 17:48:24 +00:00
Tsz-wo Sze
2d6049f1d6 HDFS-4992. Make balancer's mover thread count and dispatcher thread count configurable. Contributed by Max Lapan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503720 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 14:04:33 +00:00
Suresh Srinivas
afaec5f52d HDFS-4903. Print trash configuration and trash emptier state in namenode log. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503570 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 06:33:40 +00:00
Todd Lipcon
0880be20ac HDFS-4982. JournalNode should relogin from keytab before fetching logs from other JNs. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502682 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-12 20:44:45 +00:00
Suresh Srinivas
b47df4e3b9 HDFS-4912. Cleanup FSNamesystem#startFileInternal. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502634 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-12 17:44:00 +00:00
Jing Zhao
3630a23c55 HDFS-4978. Make disallowSnapshot idempotent. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502400 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-12 00:11:31 +00:00
Colin McCabe
8767e4cde1 HADOOP-9418. Add symlink support to DistributedFileSystem (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502373 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-11 21:31:04 +00:00
Chris Nauroth
2409882a47 HDFS-4374. Display NameNode startup progress in UI. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502331 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-11 19:20:38 +00:00
Chris Nauroth
19346d8ca6 HDFS-4373. Add HTTP API for querying NameNode startup progress. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502328 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-11 19:04:26 +00:00
Chris Nauroth
da8e962e39 HDFS-4372. Track NameNode startup progress. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502120 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-11 05:35:29 +00:00
Alejandro Abdelnur
c6eaa8b37f HDFS-4969. WebhdfsFileSystem expects non-standard WEBHDFS Json element. (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501868 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-10 17:32:05 +00:00
Kihwal Lee
3a3109f8bf HDFS-4887. TestNNThroughputBenchmark exits abruptly. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501841 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-10 16:39:37 +00:00
Tsz-wo Sze
6770de7ec4 HDFS-4645. Move from randomly generated block ID to sequentially generated block ID. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1500580 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-08 05:29:10 +00:00
Harsh J
81620ca1c9 HADOOP-8844. Add a plaintext fs -text test-case. Contributed by Akira AJISAKA. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1500190 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-06 02:16:27 +00:00
Konstantin Boudnik
ed70fb1608 HDFS-4860. Add additional attributes to JMX beans. Contributed by Trevor Lorimer 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1500139 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-05 21:36:20 +00:00
Aaron Myers
5428bfbf53 HDFS-4465. Optimize datanode ReplicasMap and ReplicaInfo. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1499659 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-04 05:52:13 +00:00
Tsz-wo Sze
05fd0a706a HDFS-4943. WebHdfsFileSystem does not work when original file path has encoded chars. Contributed by Jerry He 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498962 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-02 14:58:35 +00:00
Colin McCabe
6735b70b4a HADOOP-9414. Refactor out FSLinkResolver and relevant helper methods. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498720 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-01 22:09:52 +00:00
Kihwal Lee
ead7fa0413 HDFS-4888. Refactor and fix FSNamesystem.getTurnOffTip. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498665 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-01 20:20:27 +00:00
Tsz-wo Sze
feb5b9641d HDFS-4797. BlockScanInfo does not override equals(..) and hashCode() consistently. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498202 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-01 01:28:22 +00:00
Chris Nauroth
750442812c HDFS-4944. WebHDFS cannot create a file path containing characters that must be URI-encoded, such as space. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498055 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-30 03:38:09 +00:00
Colin McCabe
b6c7de68bc HADOOP-9673. NetworkTopology: When a node cannot be added, print out its location for diagnostic purposes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1497176 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-27 01:22:43 +00:00
Chris Nauroth
ca1058b27a HDFS-4932. Avoid a wide line on the name node webUI if we have more Journal nodes. Contributed by Fengdong Yu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1497141 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-26 22:20:31 +00:00
Colin McCabe
03601136dd HADOOP-9355. Abstract Symlink tests to use either FileContext or FileSystem (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496690 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-26 00:35:39 +00:00
Chris Nauroth
d74908bdb6 HDFS-4927. CreateEditsLog creates inodes with an invalid inode ID, which then cannot be loaded by a namenode. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496350 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-25 05:05:20 +00:00
Jason Darrell Lowe
1087be1df4 HDFS-4205. fsck fails with symlinks. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495648 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-22 00:41:34 +00:00
Sanjay Radia
6cb5ad16d0 HADOOP-9619 Mark stability of .proto files (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495564 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-21 19:53:21 +00:00
Konstantin Shvachko
92cbba386f HDFS-4883. complete() should verify fileId. Contributed by Tao Luo. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495302 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-21 07:28:38 +00:00
Brandon Li
6ecf78a99b HDFS-4772. Add number of children in HdfsFileStatus. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495253 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-21 00:32:23 +00:00
Tsz-wo Sze
c02953dbc3 HDFS-4908. Reduce snapshot inode memory usage. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494858 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-20 05:10:39 +00:00
Tsz-wo Sze
c68b1d1b31 HDFS-4914. Use DFSClient.Conf instead of Configuration. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494854 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-20 04:43:07 +00:00
Suresh Srinivas
571aa3900c HDFS-4917. Start-dfs.sh cannot pass the parameters correctly. Contributed by Fengdong Yu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494433 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-19 03:53:10 +00:00
Colin McCabe
57006e1c8c HDFS-4461. DirectoryScanner: volume prefix takes up memory for every block that is scanned (Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494401 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-19 00:34:08 +00:00
Aaron Myers
1c309f763b HDFS-4906. HDFS Output streams should not accept writes after being closed. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494303 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-18 21:05:16 +00:00
Chris Nauroth
364b379cb8 HDFS-4818. Several HDFS tests that attempt to make directories unusable do not work correctly on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494023 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-18 04:47:16 +00:00
Colin McCabe
52ebd9c389 HDFS-4626. ClientProtocol#getLinkTarget should throw an exception for non-symlink and non-existent paths. (Andrew Wang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493980 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-18 01:07:13 +00:00
Jing Zhao
eff5e6da1d HDFS-4875. Add a test for testing snapshot file length. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493850 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-17 17:23:45 +00:00
Chris Nauroth
5694c34040 HDFS-4866. Protocol buffer support cannot compile under C. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493300 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-15 03:52:40 +00:00
Chris Nauroth
0d1a994fbb HDFS-4904. Remove JournalService. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493235 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-14 20:27:17 +00:00
Chris Nauroth
0ef156a86e HDFS-4783. TestDelegationTokensWithHA#testHAUtilClonesDelegationTokens fails on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493149 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-14 16:44:22 +00:00
Tsz-wo Sze
4cd605413a HDFS-4845. FSNamesystem.deleteInternal should acquire write-lock before changing the inode map. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492941 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-14 03:12:08 +00:00
Jing Zhao
7e1744ccf9 HDFS-4902. DFSClient#getSnapshotDiffReport should use string path rather than o.a.h.fs.Path. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492791 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-13 18:11:42 +00:00
Chris Nauroth
c5821cf38b HADOOP-9638. Parallel test changes caused invalid test path for several HDFS tests on Windows. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492297 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-12 17:21:47 +00:00
Tsz-wo Sze
f9186f3ae8 HDFS-4819. Update Snapshot doc to clarify that nested snapshots are not allowed. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492062 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-12 05:43:35 +00:00
Jing Zhao
390eca2cde HDFS-4873. callGetBlockLocations returns incorrect number of blocks for snapshotted files. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491957 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-11 21:03:09 +00:00
Konstantin Shvachko
8e0f166cf3 HDFS-4878. On Remove Block, block is not removed from neededReplications queue. Contributed by Tao Luo. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491671 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-11 01:39:32 +00:00
Suresh Srinivas
8e23270e0d HDFS-4752. TestRBWBlockInvalidation fails on Windows due to file locking. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491631 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-10 22:37:36 +00:00
Ivan Mitic
cb11d68f40 HDFS-4677. Editlog should support synchronous writes. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491096 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-08 23:28:37 +00:00
Kihwal Lee
2a76cddcd5 HDFS-4832. Namenode doesn't change the number of missing blocks in safemode when DNs rejoin or leave. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490803 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-07 20:01:55 +00:00
Suresh Srinivas
a764da16d6 HDFS-4880. Print the image and edits file loaded by the namenode in the logs. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490746 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-07 17:35:34 +00:00
Kihwal Lee
0e889e77c5 HDFS-4862. SafeModeInfo.isManual() returns true when resources are low even if it wasn't entered into manually. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490486 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-07 01:15:28 +00:00
Konstantin Shvachko
8854c210bd HDFS-4867. metaSave NPEs when there are invalid blocks in repl queue. Contributed by Plamen Jeliazkov and Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490433 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-06 20:44:40 +00:00
Jing Zhao
d46e160862 HDFS-4877. Snapshot: fix the scenario where a directory is renamed under its prior descendant. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490421 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-06 20:15:07 +00:00
Jing Zhao
496b80b28c HDFS-4850. Fix OfflineImageViewer to work on fsimages with empty files or snapshots. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490080 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-05 23:32:53 +00:00
Tsz-wo Sze
e00f828b11 HDFS-4876. Fix the javadoc of FileWithSnapshot and move FileDiffList to FileWithSnapshot. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489708 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-05 05:26:32 +00:00
Aaron Myers
8171203692 HDFS-4815. TestRBWBlockInvalidation: Double call countReplicas() to fetch corruptReplicas and liveReplicas is not needed. Contributed by Tian Hong Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489668 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-04 23:01:37 +00:00
Kihwal Lee
c4382e7565 HDFS-4840. ReplicationMonitor gets NPE during shutdown. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489634 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-04 21:43:08 +00:00
Colin McCabe
4ee1ec2126 Remove extra code that code erroneously committed in HDFS-3934 (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489083 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-03 17:58:44 +00:00
Colin McCabe
4c13c986e1 Add needed file for HDFS-3934 (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489068 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-03 17:29:37 +00:00
Colin McCabe
a7bfb25d2b HDFS-3934. duplicative dfs_hosts entries handled wrong. (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489065 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-03 17:14:27 +00:00
Jason Darrell Lowe
85623a2d75 HADOOP-9287. Parallel-testing hadoop-common. Contributed by Andrey Klochkov 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1488040 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-30 22:43:16 +00:00
Brandon Li
bf99961d67 HDFS-4848. copyFromLocal and renaming a file to .snapshot should output that .snapshot is a reserved name. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487942 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-30 17:26:25 +00:00
Jing Zhao
a0abed41a0 HDFS-4863. The root directory should be added to the snapshottable directory list while loading fsimage. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487698 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-30 01:38:54 +00:00
Jing Zhao
01f27f5c23 HDFS-4857. Snapshot.Root and AbstractINodeDiff#snapshotINode should not be put into INodeMap when loading FSImage. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487655 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-29 22:22:44 +00:00
Brandon Li
719034c12c HDFS-4846. Clean up snapshot CLI commands output stacktrace for invalid arguments. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487647 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-29 21:25:01 +00:00
Jing Zhao
973017cab7 HDFS-4842. Identify the correct prior snapshot when deleting a snapshot under a renamed subtree. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487643 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-29 20:54:53 +00:00
Devaraj Das
4bb72210c2 HDFS-4827. Slight update to the implementation of API for handling favored nodes in DFSClient. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487093 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-28 20:17:39 +00:00
Kihwal Lee
45b9d19f9d HDFS-4780. Use the correct relogin method for services. Contributed by Robert Parker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1486974 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-28 15:47:56 +00:00
Kihwal Lee
359ea88016 HDFS-4714. Log short messages in Namenode RPC server for exceptions meant for clients. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485881 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-23 22:28:06 +00:00
Kihwal Lee
2ad7397c49 HDFS-4807. createSocketForPipeline() should not include timeout extension on connect. Contributed by Cristina Abad. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485861 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-23 21:35:32 +00:00
Aaron Myers
8c62c46046 HDFS-4298. StorageRetentionManager spews warnings when used with QJM. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485371 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-22 19:37:41 +00:00
Vinod Kumar Vavilapalli
27e6673ec3 MAPREDUCE-5156. Change hadoop examples ProgramDriver to be able to run 1.x examples jar on top of YARN. This change breaks 0.23.x direct usages of ProgramDriver. Contributed by Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485085 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-22 06:36:24 +00:00
Kihwal Lee
98a692fd63 HDFS-3875. Issue handling checksum errors in write pipeline. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1484808 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-21 13:42:23 +00:00
Todd Lipcon
9fdb117476 HDFS-4824. FileInputStreamCache.close leaves dangling reference to FileInputStreamCache.cacheCleaner. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1483641 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-17 03:39:18 +00:00
Aaron Myers
0cd0f64656 HDFS-4830. Typo in config settings for AvailableSpaceVolumeChoosingPolicy in hdfs-default.xml. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1483603 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-16 23:21:35 +00:00
Aaron Myers
58e191f0c5 HDFS-4787. Create a new HdfsConfiguration before each TestDFSClientRetries testcases. Contributed by Tian Hong Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1483235 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-16 08:11:23 +00:00
Tsz-wo Sze
da05873e0e HDFS-4826. TestNestedSnapshots times out due to repeated slow edit log flushes when running on virtualized disk. Contributed by Chris Nauroth 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1483150 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-16 02:00:03 +00:00
Tsz-wo Sze
f7af4a014c HDFS-3180. Add socket timeouts to WebHdfsFileSystem. Contributed by Chris Nauroth 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482661 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-15 02:23:56 +00:00
Tsz-wo Sze
5c82a0cd1a HDFS-4813. Add volatile to BlocksMap.blocks so that the replication thread can see the updated value. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482658 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-15 02:18:27 +00:00
Kihwal Lee
d027b947d6 HDFS-4805. Webhdfs client is fragile to token renewal errors. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482121 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-13 22:03:43 +00:00
Aaron Myers
09593530fb HDFS-4300. TransferFsImage.downloadEditsToStorage should use a tmp file for destination. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481987 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-13 17:47:04 +00:00
Aaron Myers
6521b5ee42 HDFS-4765. Permission check of symlink deletion incorrectly throws UnresolvedLinkException. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481976 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-13 17:22:00 +00:00
Aaron Myers
945cb2ecaa HADOOP-9485. No default value in the code for hadoop.rpc.socket.factory.class.default. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481200 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 21:45:32 +00:00
Suresh Srinivas
b1603b44c5 HDFS-4533. start-dfs.sh ignores additional parameters besides -upgrade. Contributed by Fengdong Yu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481178 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 20:23:24 +00:00
Aaron Myers
b9a0286223 HDFS-4751. TestLeaseRenewer#testThreadName flakes. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481160 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 19:43:48 +00:00
Aaron Myers
4ed1fc58c0 HDFS-4698. Provide client-side metrics for remote reads, local reads, and short-circuit reads. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481121 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 17:58:07 +00:00
Kihwal Lee
1161ceb2c9 HDFS-4799. Corrupt replica can be prematurely removed from corruptReplicas map. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481084 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 16:36:20 +00:00
Aaron Myers
7e5b63af13 HDFS-4810. several HDFS HA tests have timeouts that are too short. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480841 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 00:16:18 +00:00
Aaron Myers
a18fd620d0 HDFS-4661. A few little code cleanups of some HDFS-347-related code. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480839 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 00:03:17 +00:00
Tsz-wo Sze
5980139140 HDFS-4809. When a QuotaExceededException is thrown during rename, the quota usage should be subtracted back. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1480508 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-09 00:23:57 +00:00
Tsz-wo Sze
37d6f14560 Merge r1479733 through r1480439 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1480440 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-08 20:20:56 +00:00
Tsz-wo Sze
08ec505d6b HDFS-4806. In INodeDirectoryWithSnapshot, use isInLatestSnapshot() to determine if an added/removed child should be recorded in the snapshot diff. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1480146 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-08 01:17:24 +00:00
Aaron Myers
3ad40e9dad HDFS-4804. WARN when users set the block balanced preference percent below 0.5 or above 1.0. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480098 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-07 21:40:50 +00:00
Tsz-wo Sze
41312abe84 HDFS-4802. Disallowing snapshot on / twice should throw SnapshotException but not IllegalStateException. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1480015 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-07 18:45:03 +00:00
Tsz-wo Sze
393188c445 Merge r1477868 through r1479732 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479733 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-07 00:17:50 +00:00
Tsz-wo Sze
98b416f5ac HDFS-4801. lsSnapshottableDir throws IllegalArgumentException when root is snapshottable. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479709 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-06 22:48:54 +00:00
Tsz-wo Sze
0aab1ef996 HDFS-4800. Fix INodeDirectoryWithSnapshot#cleanDeletedINode. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479707 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-06 22:45:00 +00:00
Tsz-wo Sze
424b270c94 HDFS-4798. Update computeContentSummary() for the reference nodes in snapshots. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479671 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-06 18:48:24 +00:00
Tsz-wo Sze
72d783374c HDFS-4791. Update and fix deletion of reference inode. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479198 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-04 22:10:55 +00:00
Suresh Srinivas
a4bae51b7d HDFS-4784. NPE in FSDirectory.resolvePath(). Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478276 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-02 06:02:12 +00:00
Suresh Srinivas
03ba436d42 HDFS-4785. Concat operation does not remove concatenated files from InodeMap. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478267 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-02 04:51:21 +00:00
Tsz-wo Sze
7c14f1557b HDFS-4781. Fix a NullPointerException when listing .snapshot under a non-existing directory. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1478135 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-01 18:33:08 +00:00
Sanjay Radia
6096cb3435 HDFS-4659 Support setting execution bit for regular files (Brandon Li via sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477994 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-01 13:31:08 +00:00
Tsz-wo Sze
faca77f227 Merge r1476453 through r1477867 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477868 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 23:02:35 +00:00
Tsz-wo Sze
98c0421fbf HDFS-4758. Disallow nested snapshottable directories and unwrap RemoteException. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477867 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 22:55:38 +00:00
Devaraj Das
2542d69d65 HDFS-4778. Fixes some issues that the first patch on HDFS-2576 missed. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477849 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 21:46:02 +00:00
Tsz-wo Sze
3a3e0f5731 HDFS-4760. Update inodeMap after node replacement. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477827 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 21:05:20 +00:00
Suresh Srinivas
3704e091a8 HDFS-4610. Use common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute. Contrbitued by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477427 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 00:35:53 +00:00
Suresh Srinivas
e2091275dc HDFS-4610. Reverting the patch Jenkins build is not run. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477396 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 22:40:03 +00:00
Suresh Srinivas
fb30240b87 HDFS-4610. Use common utils FileUtil#setReadable/Writable/Executable & FileUtil#canRead/Write/Execute. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477385 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 22:26:53 +00:00
Tsz-wo Sze
e097f8404b HDFS-4773. Fix bugs in quota usage computation and OfflineImageViewer. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477367 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 22:03:23 +00:00
Aaron Myers
ce7e5565f4 HDFS-4305. Add a configurable limit on number of blocks per file, and min block size. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477354 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 21:28:48 +00:00
Aaron Myers
ce73b3b01f HDFS-4687. TestDelegationTokenForProxyUser#testWebHdfsDoAs is flaky with JDK7. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477344 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 21:10:50 +00:00
Tsz-wo Sze
884cbb681a HDFS-4578. Restrict snapshot IDs to 24-bit wide. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477181 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 16:37:30 +00:00
Suresh Srinivas
e17d5a9683 HDFS-4734. HDFS Tests that use ShellCommandFencer are broken on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476877 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 02:07:58 +00:00
Suresh Srinivas
3e00835dad HDFS-4705. Address HDFS test failures on Windows because of invalid dfs.namenode.name.dir. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476610 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 16:16:19 +00:00
Suresh Srinivas
f55fd818e0 HDFS-4722. TestGetConf#testFederation times out on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476597 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 14:53:37 +00:00
Suresh Srinivas
fbf10b2604 HDFS-4740. Fixes for a few test failures on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476596 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 14:47:15 +00:00
Suresh Srinivas
0181ce03af HDFS-4743. TestNNStorageRetentionManager fails on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476591 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 14:38:02 +00:00
Suresh Srinivas
90612f6423 HDFS-4748. MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476587 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 14:29:41 +00:00
Suresh Srinivas
fe3853484e HADOOP-9290. Some tests cannot load native library on windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476586 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 14:24:02 +00:00
Suresh Srinivas
b7afde6d52 HDFS-4741. TestStorageRestore#testStorageRestoreFailure fails on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476585 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 14:16:32 +00:00
Suresh Srinivas
4e21c347d2 HDFS-4768. File handle leak in datanode when a block pool is removed. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476579 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 14:08:34 +00:00
Tsz-wo Sze
5276f4e04d HDFS-4767. If a directory is snapshottable, do not replace it when clearing quota. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476454 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 00:05:49 +00:00
Tsz-wo Sze
60341dae19 Merge r1476010 through r1476452 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476453 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 23:50:17 +00:00
Tsz-wo Sze
75b4231a8c HDFS-4761. When resetting FSDirectory, the inodeMap should also be reset. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476452 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 23:47:57 +00:00
Tsz-wo Sze
a5ae562d70 HDFS-4650. When passing two non-existing snapshot names to snapshotDiff, it returns success if the names are the same. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476408 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 21:30:53 +00:00
Tsz-wo Sze
d2495d553f HDFS-4721. Speed up lease recovery by avoiding stale datanodes and choosing the datanode with the most recent heartbeat as the primary. Contributed by Varun Sharma 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476399 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 20:51:45 +00:00
Devaraj Das
5d2ffde68e HDFS-2576. Enhances the DistributedFileSystem's create API so that clients can specify favored datanodes for a file's blocks. Contributed by Devaraj Das and Pritam Damania. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476395 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 20:39:51 +00:00
Tsz-wo Sze
9da3865841 HDFS-4650. Fix a bug in FSDirectory and add more unit tests for rename with existence of snapshottable directories and snapshots. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476012 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 01:31:43 +00:00
Tsz-wo Sze
fa500825fa Merge r1471229 through r1476009 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476011 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 01:19:00 +00:00
Tsz-wo Sze
76b80b48ec HDFS-4755. Fix AccessControlException message and moves "implements LinkedElement" from INode to INodeWithAdditionalFields. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476009 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 01:05:47 +00:00
Tsz-wo Sze
43ac0739ce svn merge -c -1476006 . for reverting the previous trunk merge. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476008 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 01:02:45 +00:00
Tsz-wo Sze
a259e0ba79 Merge r1471229 through r1476005 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476006 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 00:55:45 +00:00
Tsz-wo Sze
06fb184d4d HDFS-4757. Update FSDirectory#inodeMap when replacing an INodeDirectory while setting quota. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476005 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 00:50:09 +00:00
Tsz-wo Sze
36f43dcb4f HDFS-4742. Fix appending to a renamed file with snapshot. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1475903 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-25 18:53:14 +00:00
Tsz-wo Sze
745bfa0311 HDFS-4749. Use INodeId to identify the corresponding directory node in FSImage saving/loading. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1475902 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-25 18:51:00 +00:00
Suresh Srinivas
16ef8dd3a5 HDFS-4745. TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1475623 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-25 04:25:58 +00:00
Aaron Myers
e6b5b01561 HDFS-4739. NN can miscalculate the number of extra edit log segments to retain. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471769 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-24 23:29:30 +00:00
Tsz-wo Sze
e8b64d3851 HDFS-4729. Fix OfflineImageViewer and permission checking for snapshot operations. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1471665 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-24 20:47:13 +00:00
Tsz-wo Sze
0fa5cad0b2 HDFS-4686. Update quota computation for rename and INodeReference. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1471647 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-24 20:31:06 +00:00
Tsz-wo Sze
5f1e3b561a Merge r1470760 through r1471228 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1471229 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-24 02:21:58 +00:00
Tsz-wo Sze
3a812e9f3a HDFS-4738. Changes AbstractINodeDiff to implement Comparable<Integer>, and fix javadoc and other warnings. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1471228 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-24 02:11:18 +00:00
Aaron Myers
4c662fd3fe HDFS-4737. JVM path embedded in fuse binaries. Contributed by Sean Mackrory. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471215 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-24 00:47:13 +00:00
Tsz-wo Sze
65752c09ab HDFS-4735. DisallowSnapshot throws IllegalStateException for nested snapshottable directories. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1471214 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-24 00:28:07 +00:00
Tsz-wo Sze
631be95398 HDFS-4732. Fix TestDFSUpgradeFromImage which fails on Windows due to failure to unpack old image tarball that contains hard links. Chris Nauroth 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471090 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-23 18:47:47 +00:00
Tsz-wo Sze
fd24c6e833 HDFS-4725. Fix HDFS file handle leaks in FSEditLog, NameNode, OfflineEditsBinaryLoader and some tests. Contributed by Chris Nauroth 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470771 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-23 01:18:36 +00:00
Tsz-wo Sze
10a2d82b45 HDFS-4719. Remove AbstractINodeDiff.Factory and move its methods to AbstractINodeDiffList. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470759 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-23 00:11:51 +00:00
Tsz-wo Sze
92e0416ced HDFS-4727. Update inodeMap after deleting files/directories/snapshots. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470756 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-23 00:00:47 +00:00
Tsz-wo Sze
43bdc22e92 HDFS-4726. Fix test failures after merging the INodeId-INode mapping from trunk. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470735 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-22 22:13:58 +00:00
Tsz-wo Sze
cb229db4bd HDFS-4708. Add snapshot user documentation. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470665 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-22 19:13:18 +00:00
Suresh Srinivas
27b3f84fe5 Merge trunk to HDFS-2802 branch. This involves fixing many conflict with HDFS-4434. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470225 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-20 20:22:21 +00:00
Suresh Srinivas
0b101bd7e8 HDFS-4434. Reverting change r1470089 that merges trunk to HDFS-2802. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470194 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-20 16:57:44 +00:00
Suresh Srinivas
9af0babe7e Merging trunk after fixing conflict with HDFS-4434. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470089 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-20 00:02:43 +00:00
Kihwal Lee
16cc4a6e86 HDFS-4699. TestPipelinesFailover#testPipelineRecoveryStress fails sporadically. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469839 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-19 14:08:29 +00:00
Tsz-wo Sze
9ab8fa36f2 HDFS-4717. Change the path parameter type of the snapshot methods in HdfsAdmin from String to Path. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1469664 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-19 02:07:52 +00:00
Suresh Srinivas
980e6c54ba HDFS-4434. Provide a mapping from INodeId to INode. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469644 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-19 00:10:09 +00:00
Tsz-wo Sze
419fd3999c HDFS-4706. Do not replace root inode for disallowSnapshot. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1469122 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-18 01:39:12 +00:00
Tsz-wo Sze
0ad27ad3e3 HDFS-4707. Add snapshot methods to FilterFileSystem and fix findbugs warnings. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1469119 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-18 01:28:00 +00:00
Tsz-wo Sze
2186912ff9 Merge r1467713 through r1469041 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1469042 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-17 19:41:50 +00:00
Suresh Srinivas
d090a3b600 HDFS-4695. TestEditLog leaks open file handles between tests. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469015 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-17 18:11:31 +00:00
Tsz-wo Sze
9280468b1a HDFS-4550. Refactor INodeDirectory.INodesInPath to a standalone class. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1468725 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-17 02:41:38 +00:00
Tsz-wo Sze
38bd7061c1 HDFS-4529. Disallow concat when one of the src files is in some snapshot. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1468667 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-16 23:16:02 +00:00
Tsz-wo Sze
6bda1f20ad HDFS-4700. Fix the undo section of rename with snapshots. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1468632 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-16 22:03:58 +00:00
Suresh Srinivas
1822529e88 HDFS-4693. Some test cases in TestCheckpoint do not clean up after themselves. Contributed by Arpit Agarwal and Suresh. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468457 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-16 15:10:47 +00:00
Tsz-wo Sze
d13f6ebe20 HDFS-4666. Define ".snapshot" as a reserved inode name so that users cannot create a file/directory with ".snapshot" as the name. If ".snapshot" is used in a previous version of HDFS, it must be renamed before upgrade; otherwise, upgrade will fail. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1468238 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-15 21:42:06 +00:00
Tsz-wo Sze
bf807063bc Merging r1466653 through r1467712 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1467713 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-13 23:05:54 +00:00
Tsz-wo Sze
0f78c50ea7 HDFS-4692. Use timestamp as default snapshot names. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1467706 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-13 21:41:33 +00:00
Tsz-wo Sze
9c6a7bebe2 HDFS-4675. Fix rename across snapshottable directories. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1467540 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-13 02:48:34 +00:00
Aaron Myers
801b484f97 HDFS-347. DFS read performance suboptimal when client co-located on nodes with data. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467538 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-13 02:13:59 +00:00
Konstantin Shvachko
242028a3fb HDFS-4639. startFileInternal() should not increment generation stamp. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467534 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-13 01:35:58 +00:00
Aaron Myers
b7aaa1b74c Merge trunk into the HDFS-347 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1467511 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-12 23:05:28 +00:00
Kihwal Lee
f863543206 HDFS-4477. Secondary namenode may retain old tokens. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467307 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-12 15:18:07 +00:00
Suresh Srinivas
fd1000bcef HDFS-4679. Namenode operation checks should be done in a consistent manner. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466721 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-10 22:45:23 +00:00
Tsz-wo Sze
4c00514ede HDFS-4684. Use INode id for image serialization when writing INodeReference. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1466718 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-10 22:24:30 +00:00
Tsz-wo Sze
3209d4a3c4 Merge r1464808 through r1466652 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1466658 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-10 20:17:39 +00:00
Todd Lipcon
f0351527d5 HDFS-4643. Fix flakiness in TestQuorumJournalManager. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466253 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-09 21:34:12 +00:00
Suresh Srinivas
d9593621b5 HDFS-4669. TestBlockPoolManager fails using IBM java. Contributed by Tian Hong Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466176 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-09 19:04:28 +00:00
Suresh Srinivas
e73db45185 HDFS-4674. TestBPOfferService fails on Windows due to failure parsing datanode data directory as URI. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466148 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-09 17:33:05 +00:00
Suresh Srinivas
425f495591 HDFS-4676. TestHDFSFileSystemContract should set MiniDFSCluster variable to null to free up memory. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466099 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-09 16:17:06 +00:00
Suresh Srinivas
f680865d99 HDFS-3940. Add Gset#clear method and clear the block map when namenode is shutdown. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465851 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-09 01:21:48 +00:00
Suresh Srinivas
19201622be HDFS-4339. Persist inode id in fsimage and editlog. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465835 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-08 23:57:31 +00:00
Todd Lipcon
087acf8fd6 HDFS-3981. Fix handling of FSN lock in getBlockLocations. Contributed by Xiaobo Peng and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465751 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-08 19:57:16 +00:00
Uma Maheswara Rao G
c5bb615317 HDFS-4525. Provide an API for knowing that whether file is closed or not. Contributed by SreeHari. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465434 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-07 18:01:17 +00:00
Aaron Myers
a9d515aed8 HDFS-1804. Add a new block-volume device choosing policy that looks at free space. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465183 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-06 04:08:09 +00:00
Konstantin Boudnik
bcbe100541 HDFS-4646. createNNProxyWithClientProtocol ignores configured timeout value. Contributed by Jagane Sundar 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465121 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-05 20:41:04 +00:00
Tsz-wo Sze
07d7d92179 Merge r1462698 through r1464807 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1464815 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-05 02:43:29 +00:00
Tsz-wo Sze
ca848beb53 HDFS-4647. Rename should call setLocalName after an inode is removed from snapshots. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1464795 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-04 23:52:38 +00:00
Suresh Srinivas
999ce497f0 HDFS-4625. Make TestNNWithQJM#testNewNamenodeTakesOverWriter work on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464780 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-04 22:54:09 +00:00
Kihwal Lee
547d2b0bac HDFS-4548. Webhdfs doesn't renegotiate SPNEGO token. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464548 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-04 13:50:31 +00:00
Luke Lu
d088d2ddea HDFS-4665. Move TestNetworkTopologyWithNodeGroup to common. (Junping Du via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464303 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-04 07:12:28 +00:00
Kihwal Lee
8293e22565 HDFS-4649. Webhdfs cannot list large directories. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463698 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-02 19:11:56 +00:00
Aaron Myers
9c26c28c87 HDFS-4658. Standby NN will log that it has received a block report "after becoming active". Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463643 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-02 17:49:58 +00:00
Aaron Myers
ef9e1ba763 HDFS-4656. DN heartbeat loop can be briefly tight. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463357 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-02 02:11:07 +00:00
Aaron Myers
329fb1f433 HDFS-4655. DNA_FINALIZE is logged as being an unknown command by the DN when received from the standby NN. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463355 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-02 02:05:55 +00:00
Tsz-wo Sze
1096917649 HDFS-4611. Update FSImage for INodeReference. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1463332 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-01 23:24:42 +00:00
Tsz-wo Sze
8ee6ecaea4 HDFS-4637. INodeDirectory#replaceSelf4Quota may incorrectly convert a newly created directory to an INodeDirectoryWithSnapshot. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1463075 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-01 01:53:21 +00:00
Tsz-wo Sze
9602869d19 HDFS-4648. For snapshot deletion, when merging the diff from to-delete snapshot to the prior snapshot, make sure files/directories created after the prior snapshot get deleted. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1462865 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-30 23:57:27 +00:00
Tsz-wo Sze
f5bbc2d950 Merge r1460409 through r1462697 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1462698 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-30 03:50:03 +00:00
Todd Lipcon
bbb24fbf5d Merge trunk into branch. 
Conflicts resolved:
C       hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestShortCircuitLocalRead.java
!     C hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/SocketCache.java
C       hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java
C       hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
C       hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
C       hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/BlockReaderLocal.java

(thanks to Colin for help resolving)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1462652 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-29 21:33:35 +00:00
Todd Lipcon
1611b51a97 HADOOP-9150. Avoid unnecessary DNS resolution attempts for logical URIs. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1462303 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-28 20:58:45 +00:00
Tsz-wo Sze
25aab4203c HDFS-4636. Update quota usage when deleting files/dirs that were created after taking the latest snapshot. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1462192 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-28 16:18:04 +00:00
Sanjay Radia
0e6604aab3 HDFS-4633 TestDFSClientExcludedNodes fails sporadically if excluded nodes cache expires too quickly (Chris Nauroth via Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461846 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-27 20:49:48 +00:00
Todd Lipcon
694a672131 HDFS-4538. Allow use of legacy blockreader. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1461818 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-27 19:28:12 +00:00
Todd Lipcon
4809bfa6ed HDFS-4618. Default transaction interval for checkpoints is too low. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461783 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-27 18:46:32 +00:00
Todd Lipcon
81192e4e41 HDFS-4621. Additional logging to help diagnose slow QJM syncs. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461777 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-27 18:42:43 +00:00
Kihwal Lee
c9f5052803 HDFS-4581. DataNode.checkDiskError should not be called on network errors. Contributed by Rohit Kochar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461597 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-27 14:21:13 +00:00
Suresh Srinivas
fdf1e6e07e HDFS-4635. Move BlockManager#computeCapacity to LightWeightGSet. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461364 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-26 23:01:03 +00:00
Tsz-wo Sze
ca3e09bab5 HDFS-4598. Fix the default value of ConcatSourcesParam and the WebHDFS doc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461040 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-26 09:54:48 +00:00
Tsz-wo Sze
cc2f96f655 HDFS-4612. Not to use INode.getParent() when generating snapshot diff report. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1460590 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-25 10:21:30 +00:00
Suresh Srinivas
698e3f8ae5 Merging trunk to branch HDFS-2802 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1460410 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-24 15:56:18 +00:00
Suresh Srinivas
993a76f2dd HDFS-4627. Fix FSImageFormat#Loader NPE and synchronization issues. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1460389 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-24 14:53:52 +00:00
Tsz-wo Sze
7ed618e324 HDFS-4584. Skip TestNNWithQJM.testNewNamenodeTakesOverWriter() on Windows. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459592 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-21 23:56:06 +00:00
Tsz-wo Sze
c2e186bae6 HDFS-4615. Fix TestDFSShell failures on Windows. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459586 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-21 23:48:39 +00:00
Tsz-wo Sze
e976294d35 HDFS-4609. TestAuditLogs should release log handles between tests. Contributed by Ivan Mitic 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459576 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-21 23:18:26 +00:00
Tsz-wo Sze
1b98d8dda3 HDFS-4607. In TestGetConf.testGetSpecificKey(), use a platform-specific line separator; otherwise, it fails on Windows. Contributed by Ivan Mitic 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459573 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-21 23:11:20 +00:00
Aaron Myers
036c168f4f HDFS-4620. Documentation for dfs.namenode.rpc-address specifies wrong format. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459549 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-21 21:59:02 +00:00
Tsz-wo Sze
ca7c588185 HDFS-4616. Update the FilesDeleted metric while deleting file/dir in the current tree. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1459485 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-21 19:30:35 +00:00
Aaron Myers
a10fbb93e7 HDFS-4246. The exclude node list should be more forgiving, for each output stream. Contributed by Harsh J. Chouraria. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459475 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-21 18:58:06 +00:00
Aaron Myers
c92b59fd8d HDFS-4614. FSNamesystem#getContentSummary should use getPermissionChecker helper method. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1458593 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-20 00:36:13 +00:00
Tsz-wo Sze
9701555899 HDFS-4534. Add INodeReference in order to support rename with snapshots. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1458164 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-19 06:27:26 +00:00
Aaron Myers
64741f4635 HDFS-4521. Invalid network toploogies should not be cached. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457878 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-18 17:20:13 +00:00
Tsz-wo Sze
a5a66330a8 Merge r1455389 through r1457712 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1457716 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-18 11:45:07 +00:00
Tsz-wo Sze
77f7bfa9ef HDFS-4556. Add snapshotdiff and LsSnapshottableDir tools to hdfs script. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1457712 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-18 11:36:59 +00:00
Suresh Srinivas
415d038319 HDFS-4604. TestJournalNode fails on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457069 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-15 18:59:20 +00:00
Suresh Srinivas
9c7c2f4f27 HDFS-4603. TestMiniDFSCluster fails on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457057 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-15 18:41:18 +00:00
Aaron Myers
807e08334e HDFS-4596. Shutting down namenode during checkpointing can lead to md5sum error. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456630 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-14 20:01:03 +00:00
Aaron Myers
bcabbcdf4c HDFS-3277. fail over to loading a different FSImage if the first one we try to load is corrupt. Contributed by Colin Patrick McCabe and Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456578 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-14 18:04:04 +00:00
Daryn Sharp
2c42337545 HDFS-3367. WebHDFS doesn't use the logged in user when opening connections (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456469 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-14 15:14:13 +00:00
Kihwal Lee
7987bcf3f4 HDFS-3344. Unreliable corrupt blocks counting in TestProcessCorruptBlocks. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456172 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 21:58:19 +00:00
Aaron Myers
3bf09c5150 HDFS-4591. HA clients can fail to fail over while Standby NN is performing long checkpoint. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456107 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 19:51:19 +00:00
Suresh Srinivas
1f3a18ff44 HDFS-4582. TestHostsFiles fails on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456060 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 17:43:34 +00:00
Suresh Srinivas
c390683bcc HDFS-4583. TestNodeCount fails. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456052 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 17:15:38 +00:00
Suresh Srinivas
8c20a8f495 HDFS-4595. When short circuit read is fails, DFSClient does not fallback to regular reads. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456047 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 16:45:31 +00:00
Suresh Srinivas
e4e13618e8 HDFS-4593. TestSaveNamespace fails on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455956 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 14:28:55 +00:00
Suresh Srinivas
b8f3133e04 Adding file missed in the revision 1455805 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455807 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 06:06:21 +00:00
Suresh Srinivas
719c313be1 HDFS-4144. Create test for all snapshot-related metrics. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455805 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 06:05:00 +00:00
Aaron Myers
06f711d819 HDFS-4484. libwebhdfs compilation broken with gcc 4.6.2. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455782 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 02:59:00 +00:00
Aaron Myers
7c8419f14f HDFS-4522. LightWeightGSet expects incrementing a volatile to be atomic. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455780 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 02:55:20 +00:00
Aaron Myers
86a940f7ad HDFS-4592. Default values for access time precision are out of sync between hdfs-default.xml and the code. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455777 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 02:32:44 +00:00
Suresh Srinivas
c5017c71e4 HDFS-4013. TestHftpURLTimeouts throws NPE. Contributed by Chao Shi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455755 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-12 23:37:03 +00:00
Aaron Myers
813e97494a HDFS-4586. TestDataDirs.testGetDataDirsFromURIs fails with all directories in dfs.datanode.data.dir are invalid. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455708 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-12 20:55:33 +00:00
Tsz-wo Sze
3b3ea5c422 HDFS-4563. Update namespace/diskspace usage after deleting snapshots. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455396 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-12 02:41:25 +00:00
Tsz-wo Sze
f35cd45811 Merge r1454237 through r1455388 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455390 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-12 01:58:43 +00:00
Suresh Srinivas
9daa958c5a HDFS-4572. Fix TestJournal failures on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455360 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-11 23:13:55 +00:00
Aaron Myers
9d62cdd680 HDFS-4391. TestDataTransferKeepalive fails when tests are executed in a certain order. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455343 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-11 21:44:25 +00:00
Tsz-wo Sze
43f8d0b9c9 HDFS-4574. Move Diff to the util package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1454988 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-11 03:45:52 +00:00
Suresh Srinivas
d32fb8a62b HDFS-4579. Annotate snapshot tests. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1454748 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-09 18:14:30 +00:00
Suresh Srinivas
c1fabc5e91 HDFS-4573. Fix TestINodeFile on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454616 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 22:54:50 +00:00
Kihwal Lee
140076fb57 HDFS-4577. Webhdfs operations should declare if authentication is required. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454517 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 20:01:58 +00:00
Alejandro Abdelnur
a549d6fa2c HDFS-4571. WebHDFS should not set the service hostname on the server side. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454475 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 17:23:47 +00:00
Kihwal Lee
94a22114b9 HDFS-4567. Webhdfs does not need a token for token operations. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454460 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 16:56:34 +00:00
Suresh Srinivas
82230367ba Merging trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1454238 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 04:13:41 +00:00
Suresh Srinivas
4909821aa9 HDFS-4569. Small image transfer related cleanups. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454233 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 03:37:21 +00:00
Tsz-wo Sze
8d95784bf1 HDFS-4557. Fix FSDirectory#delete when INode#cleanSubtree returns 0. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1454138 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 22:34:51 +00:00
Daryn Sharp
8a4f03cb70 HDFS-4566. Webdhfs token cancelation should use authentication (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454059 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 19:58:04 +00:00
Suresh Srinivas
301079b4bf HDFS-4546. Use DFSUtil.getSpnegoKeytabKey() to get the spnego keytab key in secondary namenode and namenode http server. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454021 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 19:23:13 +00:00
Daryn Sharp
97c4668312 HDFS-4560. Webhdfs cannot use tokens obtained by another user (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453955 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 16:56:19 +00:00
Tsz-wo Sze
3145cf1ab2 Merge r1449958 through r1453659 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1453669 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 02:57:40 +00:00
Jonathan Turner Eagles
b427fe9de8 HADOOP-9209. Add shell command to dump file checksums (Todd Lipcon via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453613 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 23:17:14 +00:00
Suresh Srinivas
638801cce1 HADOOP-8952. Enhancements to support Hadoop on Windows Server and Windows Azure environments. Contributed by Ivan Mitic, Chuan Liu, Ramya Sunil, Bikas Saha, Kanna Karanam, John Gordon, Brandon Li, Chris Nauroth, David Lao, Sumadhur Reddy Bolli, Arpit Agarwal, Ahmed El Baz, Mike Liddell, Jing Zhao, Thejas Nair, Steve Maine, Ganeshan Iyer, Raja Aluri, Giridharan Kesavan, Ramya Bharathi Nimmagadda. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453486 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 19:15:18 +00:00
Suresh Srinivas
456064d899 HDFS-4544. Error in deleting blocks should not do check disk, for all types of errors. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453436 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 17:18:46 +00:00
Suresh Srinivas
56c7e7a12e HDFS-4519. Support overriding jsvc binary and log file locations when launching secure datanode. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453050 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 22:37:04 +00:00
Suresh Srinivas
a82e67af6c HDFS-4540. Namenode http server should use the web authentication keytab for spnego principal. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453025 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 21:47:22 +00:00
Kihwal Lee
97ccd64401 HDFS-4542. Webhdfs doesn't support secure proxy users. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452978 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 20:17:56 +00:00
Tsz-wo Sze
b1333e5b56 HDFS-4545. With snapshots, FSDirectory.unprotectedSetReplication(..) always changes file replication but it may or may not changes block replication. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1452636 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 02:23:34 +00:00
Suresh Srinivas
3ea26d3408 HDFS-4541. Set hadoop.log.dir and hadoop.id.str when starting secure datanode to write the logs to right dir by default. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452461 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-04 19:34:15 +00:00
Daryn Sharp
d8ca9c655b HDFS-4532. RPC call queue may fill due to current user lookup (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452435 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-04 18:36:30 +00:00
Daryn Sharp
cfa86e6110 HDFS-4128. 2NN gets stuck in inconsistent state if edit log replay fails in the middle (kihwal via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452384 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-04 16:44:23 +00:00
Suresh Srinivas
2e02b92664 HDFS-4518. Finer grained metrics for HDFS capacity. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451348 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-28 21:13:59 +00:00
Tsz-wo Sze
c7cf85ccb4 HDFS-4507. Update quota verification for snapshots. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1451081 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-28 03:08:08 +00:00
Tsz-wo Sze
e2a618e1cc HDFS-4523. Fix INodeFile replacement, TestQuota and javac errors from trunk merge. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1450477 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-26 22:04:35 +00:00
Aaron Myers
7e2d98da40 HDFS-4235. When outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449984 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-26 00:44:52 +00:00
Tsz-wo Sze
aa82b03823 Merge r1448505 through r1449957 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449976 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-26 00:10:17 +00:00
Tsz-wo Sze
59e968a114 HDFS-4514. Add CLI for supporting snapshot rename, diff report, and snapshottable directory listing. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449956 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-25 23:14:58 +00:00
Aaron Myers
63522b3224 HADOOP-8569. CMakeLists.txt: define _GNU_SOURCE and _LARGEFILE_SOURCE. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449922 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-25 22:07:45 +00:00
Tsz-wo Sze
d8ccf4e521 Add the new test file by HDFS-4520. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449863 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-25 19:49:52 +00:00
Tsz-wo Sze
5ddbbd9d65 HDFS-4520. Support listing snapshots under a snapshottable directory using ls. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449862 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-25 19:49:05 +00:00
Tsz-wo Sze
0deff1727e HDFS-4524. Update SnapshotManager#snapshottables when loading fsimage. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449265 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-23 02:44:05 +00:00
Aaron Myers
019d6a22b1 HDFS-4304. Make FSEditLogOp.MAX_OP_SIZE configurable. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449218 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-22 21:21:16 +00:00
Aaron Myers
8271fae921 HADOOP-9267. hadoop -help, -h, --help should show usage instructions. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449161 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-22 18:36:24 +00:00
Suresh Srinivas
cdb292f44c HDFS-4222. NN is unresponsive and loses heartbeats from DNs when configured to use LDAP and LDAP has issues. Contributed by Xiaobo Peng and Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448801 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 21:02:39 +00:00
Uma Maheswara Rao G
bf44d16ef4 HDFS-4482. ReplicationMonitor thread can exit with NPE due to the race between delete and replication of same file. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448708 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 16:25:12 +00:00
Tsz-wo Sze
89d05b53d9 Merge r1446505 through r1448504 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1448505 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 03:30:10 +00:00
Tsz-wo Sze
f29fa9e820 HDFS-4499. Fix file/directory/snapshot deletion for file diff. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1448504 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 03:27:36 +00:00
Tsz-wo Sze
567ab4335f HDFS-4502. JsonUtil.toFileStatus(..) should check if the fileId property exists. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448502 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 03:19:16 +00:00
Tsz-wo Sze
fac3883188 HDFS-4503. Update computeContentSummary(..), spaceConsumedInTree(..) and diskspaceConsumed(..) in INode for snapshot. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1448373 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-20 20:02:24 +00:00
Tsz-wo Sze
14eaab6778 HDFS-4431. Support snapshot in OfflineImageViewer. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1446993 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-17 02:58:31 +00:00
Aaron Myers
f61581501a Merge trunk into HDFS-347 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1446832 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-16 01:12:07 +00:00
Aaron Myers
3a417cbf1d HDFS-347: style cleanups. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1446830 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-16 00:59:01 +00:00
Suresh Srinivas
a9f6a27e93 Merge trunk to HDFS-2802 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1446507 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-15 10:57:34 +00:00
Tsz-wo Sze
d9e2514d21 HDFS-4487. Fix snapshot diff report for HDFS-4446. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1446385 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-14 23:07:49 +00:00
Tsz-wo Sze
d42d0860cb HDFS-4500. Refactor snapshot INode methods. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1446355 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-14 22:00:36 +00:00
Tsz-wo Sze
02e6b72ae1 HDFS-4481. Change fsimage to support snapshot file diffs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1446000 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-14 00:43:28 +00:00
Kihwal Lee
a9974c791a HDFS-4495. Allow client-side lease renewal to be retried beyond soft-limit. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445965 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-13 22:51:21 +00:00
Alejandro Abdelnur
6bcbf492a2 HADOOP-9117. replace protoc ant plugin exec with a maven plugin. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445956 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-13 22:13:44 +00:00
Todd Lipcon
27e158362c HDFS-4496. DFSClient: don't create a domain socket unless we need it. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1445491 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-13 07:26:42 +00:00
Tsz-wo Sze
969e84decb HDFS-4342. Directories configured in dfs.namenode.edits.dir.required but not in dfs.namenode.edits.dir are silently ignored. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445006 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-12 00:50:00 +00:00
Aaron Myers
aa92072b54 HDFS-4453. Make a simple doc to describe the usage and design of the shortcircuit read feature. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1444963 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-11 21:10:23 +00:00
Tsz-wo Sze
fa8bafbd46 Merge r1441206 through r1444434 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1444439 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-09 21:29:44 +00:00
Tsz-wo Sze
afe77ce53d HDFS-4480. Eliminate the file snapshot circular linked list. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1444280 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-08 23:19:32 +00:00
Tsz-wo Sze
4f7d921324 HDFS-4446. Support file snapshots with diff lists. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1443825 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-08 02:18:55 +00:00
Aaron Myers
6f0c56cb95 HDFS-4471. Namenode WebUI file browsing does not work with wildcard addresses configured. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443807 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-08 00:28:00 +00:00
Suresh Srinivas
7114a61318 HDFS-4470. Several HDFS tests attempt file operations on invalid HDFS paths when running on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443744 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-07 21:52:55 +00:00
Tsz-wo Sze
90c3700c52 HDFS-4458. In DFSUtil.getNameServiceUris(..), convert default fs URI using NetUtils.createSocketAddr(..) for being consistent with other addresses. Contributed by Binglin Chang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443297 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-07 03:04:18 +00:00
Aaron Myers
3d46863e12 HDFS-4473. Don't create domain socket unless we need it. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1443283 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-07 00:02:12 +00:00
Suresh Srinivas
4525c4a25b HDFS-4340. Update addBlock() to inculde inode id as additional argument. Contributed Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443169 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-06 19:52:34 +00:00
Tsz-wo Sze
e28edbffe1 HDFS-4468. Use the new StringUtils methods added by HADOOP-9252 and fix TestHDFSCLI and TestQuota. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442824 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-06 01:13:16 +00:00
Aaron Myers
ef8dd606ab HDFS-4344. dfshealth.jsp throws NumberFormatException when dfs.hosts/dfs.hosts.exclude includes port number. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442465 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-05 04:07:31 +00:00
Aaron Myers
5a0b746639 HDFS-4404. Create file failure when the machine of first attempted NameNode is down. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442461 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-05 03:18:14 +00:00
Aaron Myers
a8e39feed2 HDFS-4462. 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442375 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-04 21:29:39 +00:00
Uma Maheswara Rao G
52e6f5a276 HDFS-4445. All BKJM ledgers are not checked while tailing, So failover will fail. Contributed Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441935 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-03 17:33:55 +00:00
Suresh Srinivas
8590564dc5 HDFS-4350. Make enabling of stale marking on read and write paths independent. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441819 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-02 22:18:50 +00:00
Suresh Srinivas
24d96cbcdb HDFS-4414. Add support for getting snapshot diff from DistributedFileSystem. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1441808 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-02 20:39:01 +00:00
Konstantin Shvachko
61a262757c HDFS-4452. getAdditionalBlock() can create multiple blocks if the client times out and retries. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441681 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-02 02:07:26 +00:00
Tsz-wo Sze
e7db60fbfc HDFS-4464. Combine collectSubtreeBlocksAndClear with deleteDiffsForSnapshot and rename it to destroySubtreeAndCollectBlocks. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1441680 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-02 01:53:17 +00:00
Alejandro Abdelnur
bbdae834d2 HDFS-4456. Add concat to HttpFS and WebHDFS REST API docs. (plamenj2003 via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441603 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-01 19:42:06 +00:00
Tsz-wo Sze
40df526bd3 Merge r1440222 through r1441205 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1441206 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 21:39:42 +00:00
Tsz-wo Sze
2710e961e5 HDFS-4361. When listing snapshottable directories, only return those where the user has permission to take snapshots. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1441202 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 21:35:19 +00:00
Tsz-wo Sze
2372e394dd HDFS-4189. Renames the getMutableXxx methods to getXxx4Write and fix a bug that some getExistingPathINodes calls should be getINodesInPath4Write. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1441193 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 21:13:04 +00:00
Suresh Srinivas
6ecbb35019 HDFS-4151. hdfs balancer command returns exit code 1 on success instead of 0. Contributed by Joshua Blatt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441113 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 18:44:37 +00:00
Aaron Myers
e7380b4f9c HDFS-4428. FsDatasetImpl should disclose what the error is when a rename fails. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440865 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 07:29:46 +00:00
Aaron Myers
dcd27ff778 Merge trunk into HDFS-347 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1440579 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-30 18:32:00 +00:00
Konstantin Shvachko
481b6cccf0 HDFS-3598. WebHDFS support for file concat. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440290 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-30 06:51:57 +00:00
Aaron Myers
73066dc958 HADOOP-9221. Convert remaining xdocs to APT. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440245 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-30 01:52:14 +00:00
Tsz-wo Sze
f352b4ce0c Merge r1438306 through r1440221 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1440222 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 23:53:59 +00:00
Tsz-wo Sze
6f4fe09687 HDFS-4447. Refactor INodeDirectoryWithSnapshot for supporting general INode diff lists. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1440216 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 23:25:49 +00:00
Kihwal Lee
8acfa66897 HDFS-4288. NN accepts incremental BR as IBR in safemode. contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440192 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 22:44:35 +00:00
Suresh Srinivas
66ea187228 HDFS-4131. Add capability to namenode to get snapshot diff. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1440152 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 21:31:44 +00:00
Aaron Myers
33cee25aad HADOOP-9190. packaging docs is broken. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439796 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 09:17:40 +00:00
Suresh Srinivas
5988208b7d HDFS-4432. Support INodeFileUnderConstructionWithSnapshot in FSImage saving/loading. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1439682 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-28 22:48:58 +00:00
Suresh Srinivas
58c0c6f069 HDFS-4444. Add space between total transaction time and number of transactions in FSEditLog#printStatistics. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439559 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-28 18:56:37 +00:00
Harsh J
9639f37ee2 HDFS-4259. Improve pipeline DN replacement failure message. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439126 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-27 17:42:25 +00:00
Tsz-wo Sze
86f6dfb338 HDFS-4443. Remove a trailing '`' character from the HTML code generated by NamenodeJspHelper.generateNodeData(..). Contributed by Christian Rohling 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438808 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-26 01:17:45 +00:00
Tsz-wo Sze
a3bf208386 HDFS-4441. Move INodeDirectoryWithSnapshot.Diff and the related classes to a package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1438782 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-26 00:01:51 +00:00
Tsz-wo Sze
12e8ba804f HDFS-4429. When the latest snapshot exists, INodeFileUnderConstruction should be replaced with INodeFileWithSnapshot but not INodeFile. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1438304 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-25 03:09:26 +00:00
Aaron Myers
c0e16efe91 HDFS-4440. Avoid annoying log message when dfs.domain.socket.path is not set. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1438280 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-25 00:44:37 +00:00
Tsz-wo Sze
bb80f2fb29 HDFS-4436. Change INode.recordModification(..) to return only the current inode and remove the updateCircularList parameter from some methods in INodeDirectoryWithSnapshot.Diff. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1438203 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-24 21:33:34 +00:00
Tsz-wo Sze
74d1e5c302 Merge r1432789 through r1437840 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1437843 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-24 02:45:45 +00:00
Todd Lipcon
4e74c52e60 HDFS-4433. Make TestPeerCache not flaky. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437680 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-23 20:01:33 +00:00
Suresh Srinivas
a1e6df6bc4 HDFS-4426. Secondary namenode shuts down immediately after startup. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437627 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-23 19:00:39 +00:00
Todd Lipcon
797465820b Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437623 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-23 18:51:24 +00:00
Todd Lipcon
d12f465c67 HDFS-4417. Fix case where local reads get disabled incorrectly. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437616 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-23 18:38:56 +00:00
Suresh Srinivas
fe3584aadf HDFS-4126. Add reading/writing snapshot information to FSImage. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1437256 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-23 02:48:01 +00:00
Todd Lipcon
cfae13306a HDFS-4403. DFSClient can infer checksum type when not provided by reading first byte. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1436730 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-22 02:59:25 +00:00
Todd Lipcon
89bd14913a HDFS-4416. Rename dfs.datanode.domain.socket.path to dfs.domain.socket.path. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1436568 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-21 19:29:06 +00:00
Aaron Myers
d3d350ef0f HDFS-4359. Slow RPC responses from NN can prevent metrics collection on DNs. Contributed by liang xie. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435299 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-18 18:39:24 +00:00
Tsz-wo Sze
b71d386890 HDFS-4098. Add FileWithSnapshot, INodeFileUnderConstructionWithSnapshot and INodeFileUnderConstructionSnapshot for supporting append to snapshotted files. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1434966 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-17 23:38:30 +00:00
Todd Lipcon
52c5b8ea9f HDFS-4418. increase default FileInputStreamCache size. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1434953 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-17 23:11:30 +00:00
Suresh Srinivas
8f70a25b1c HDFS-4393. Make empty request and responses in protocol translators can be static final members. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434844 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-17 18:21:29 +00:00
Tsz-wo Sze
7856221d4a HDFS-4407. Change INodeDirectoryWithSnapshot.Diff.combinePostDiff(..) to merge-sort like and keep the postDiff parameter unmodified. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1433918 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-16 12:43:51 +00:00
Todd Lipcon
5b0187dcd3 Revert r1433755: HDFS-4288. NN accepts incremental BR as IBR in safemode. Contributed by Daryn Sharp. 
This commit caused TestBlockManager to fail.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433820 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-16 04:22:38 +00:00
Todd Lipcon
27d068b684 HDFS-4288. NN accepts incremental BR as IBR in safemode. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433755 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-16 00:09:54 +00:00
Todd Lipcon
347cf6e176 HADOOP-8712. Change default hadoop.security.group.mapping to JniBasedUnixGroupsNetgroupMappingWithFallback. Contributed by Robert Parker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433624 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 20:43:32 +00:00
Suresh Srinivas
4a579d4de9 HDFS-4392. Use NetUtils#getFreeSocketPort in MiniDFSCluster. Contributed by Andrew Purtell. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433578 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 18:47:51 +00:00
Tsz-wo Sze
00d318378e HDFS-4397. Fix a bug in INodeDirectoryWithSnapshot.Diff.combinePostDiff(..) that it may put the wrong node into the deleted list. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1433293 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 06:20:22 +00:00
Tsz-wo Sze
397835acdf svn merge -c -1432788 for reverting HDFS-4098. Add FileWithLink, INodeFileUnderConstructionWithLink and INodeFileUnderConstructionSnapshot in order to support append to snapshotted files. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1433284 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 04:33:14 +00:00
Eli Collins
e6dbad4f6f HADOOP-9178. src/main/conf is missing hadoop-policy.xml. Contributed by Sandy Ryza 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433275 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 03:25:12 +00:00
Todd Lipcon
2f4e2c607e Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433249 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:42:06 +00:00
Todd Lipcon
2fd41b3b42 HDFS-4402. Some small DomainSocket fixes: avoid findbugs warning, change log level, etc. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433242 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:31:35 +00:00
Suresh Srinivas
8767a37b9b HDFS-4375. Use token request messages defined in hadoop common. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433235 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:26:23 +00:00
Suresh Srinivas
6dbc7e03e5 HDFS-4369. GetBlockKeysResponseProto does not handle null response. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433206 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 23:13:27 +00:00
Suresh Srinivas
0671176111 HDFS-4364. GetLinkTargetResponseProto does not handle null path. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433194 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 23:01:39 +00:00
Todd Lipcon
d08b1af26a HDFS-4400. DFSInputStream#getBlockReader: last retries should ignore the cache. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433144 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 21:34:22 +00:00
Todd Lipcon
12bf674e8e Merge trunk into branch. 
Fixed a couple trivial conflicts due to HDFS-4363, which moved some methods
from HdfsProtoUtil to PBHelper


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433133 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 21:12:16 +00:00
Todd Lipcon
3052ad1f00 HDFS-3429. DataNode reads checksums even if client does not need them. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433117 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 20:47:08 +00:00
Thomas Graves
e26da77544 HDFS-4385. Maven RAT plugin is not checking all source files (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432933 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 14:36:40 +00:00
Tsz-wo Sze
686e13db2f HDFS-4395. In INodeDirectorySnapshottable's constructor, the passed-in dir could be an INodeDirectoryWithSnapshot. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432838 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 08:40:13 +00:00
Tsz-wo Sze
90d6d55a4b Merge r1426019 through r1432788 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432796 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 03:44:35 +00:00
Tsz-wo Sze
25116c26fd HDFS-4098. Add FileWithLink, INodeFileUnderConstructionWithLink and INodeFileUnderConstructionSnapshot in order to support append to snapshotted files. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432788 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 02:30:15 +00:00
Tsz-wo Sze
bc0aff27a4 HDFS-4245. Include snapshot related operations in TestOfflineEditsViewer. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432592 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-13 11:29:14 +00:00
Konstantin Shvachko
06406d7056 HDFS-1245. Plugable block id generation. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432539 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-13 01:13:29 +00:00
Todd Lipcon
d2737575ad HDFS-4390. Bypass UNIX domain socket unit tests when they cannot be run. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1432350 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-12 01:19:27 +00:00
Todd Lipcon
9a4030e0e8 HDFS-4356. BlockReaderLocal should use passed file descriptors rather than paths. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1432335 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 23:52:22 +00:00
Suresh Srinivas
ad1cd71b10 HDFS-4381. Merge change r1432149 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432247 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 19:42:11 +00:00
Suresh Srinivas
93c1b4b25a Merge r1414455:r1426018 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432246 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 19:40:23 +00:00
Eli Collins
ebfa3ab1fa HDFS-4384. test_libhdfs_threaded gets SEGV if JNIEnv cannot be initialized. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432221 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 18:47:52 +00:00
Suresh Srinivas
bbc21ad5d4 HDFS-4381. Document fsimage format details in FSImageFormat class javadoc. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432149 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 16:57:12 +00:00
Aaron Myers
91c28d4409 HDFS-4328. TestLargeBlock#testLargeBlockSize is timing out. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431867 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 03:44:36 +00:00
Eli Collins
82b218c605 HDFS-4377. Some trivial DN comment cleanup. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431753 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 00:09:37 +00:00
Suresh Srinivas
be5509c537 HDFS-4382. Fix typo MAX_NOT_CHANGED_INTERATIONS. Contributed by Ted Yu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431726 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-10 23:20:46 +00:00
Suresh Srinivas
2bd35d8de3 HDFS-4367. GetDataEncryptionKeyResponseProto does not handle null response. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431459 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-10 16:03:37 +00:00
Eli Collins
6449f52455 HDFS-4032. Specify the charset explicitly rather than rely on the default. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431179 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-10 02:30:05 +00:00
Aaron Myers
7e599d9e3b HADOOP-9155. FsPermission should have different default value, 777 for directory and 666 for file. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431148 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 23:30:41 +00:00
Aaron Myers
3555e7c574 HDFS-4306. PBHelper.convertLocatedBlock miss convert BlockToken. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431117 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 22:29:41 +00:00
Todd Lipcon
d94621a0cd HDFS-4354. Create DomainSocket and DomainPeer and associated unit tests. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1431102 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 21:37:34 +00:00
Todd Lipcon
c9db06f2e4 HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1431097 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 21:34:13 +00:00
Suresh Srinivas
3cd17b614e HDFS-4363. Combine PBHelper and HdfsProtoUtil and remove redundant methods. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431088 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 21:20:38 +00:00
Tsz-wo Sze
2d4097840c HDFS-4244. Support snapshot deletion. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1430953 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 16:44:05 +00:00
Tsz-wo Sze
eae2a30462 HDFS-4261. Fix bugs in Balaner causing infinite loop and TestBalancerWithNodeGroup timeing out. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430917 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 15:55:49 +00:00
Tsz-wo Sze
fab2cbc2c1 svn merge -c -1428729 . for reverting HDFS-4352. Encapsulate arguments to BlockReaderFactory in a class 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430663 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 02:41:34 +00:00
Tsz-wo Sze
837e17b2ea svn merge -c -1430507 . for reverting HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430662 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 02:39:15 +00:00
Eli Collins
6d4a091567 HDFS-4034. Remove redundant null checks. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430585 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 22:38:36 +00:00
Eli Collins
5cdb7e5ce7 HDFS-4033. Miscellaneous findbugs 2 fixes. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430534 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 21:05:33 +00:00
Todd Lipcon
239b2742d0 HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430507 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 20:44:09 +00:00
Eli Collins
43295b9f7b HDFS-4030. BlockManager excessBlocksCount and postponedMisreplicatedBlocksCount should be AtomicLongs. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430462 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 19:41:04 +00:00
Suresh Srinivas
18e731074e HDFS-4362. GetDelegationTokenResponseProto does not handle null token. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430137 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 04:28:45 +00:00
Aaron Myers
d3949058b8 HDFS-3970. Fix bug causing rollback of HDFS upgrade to result in bad VERSION file. Contributed by Vinay and Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430037 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-07 21:47:41 +00:00
Tsz-wo Sze
6a76ec14ad HDFS-4351. In BlockPlacementPolicyDefault.chooseTarget(..), numOfReplicas needs to be updated when avoiding stale nodes. Contributed by Andrew Wang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429653 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-07 03:05:08 +00:00
Tsz-wo Sze
93872b58e5 HDFS-4230. Support listing of all the snapshottable directories. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1429643 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-07 01:43:21 +00:00
Suresh Srinivas
251b485af5 HADOOP-9173. Add security token protobuf definition to common and use it in hdfs. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428972 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 16:49:49 +00:00
Tsz-wo Sze
f96d0a3585 HDFS-4357. Fix a bug that if an inode is replaced, further INode operations should apply to the new inode. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1428780 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 10:45:57 +00:00
Tsz-wo Sze
2c15726999 HDFS-4270. Introduce soft and hard limits for max replication so that replications of the highest priority are allowed to choose a source datanode that has reached its soft limit but not the hard limit. Contributed by Derek Dagit 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428739 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 08:09:43 +00:00
Todd Lipcon
32052a1e3a HDFS-4352. Encapsulate arguments to BlockReaderFactory in a class. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428729 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 06:59:12 +00:00
Todd Lipcon
228de3c987 HDFS-4302. Fix fatal exception when starting NameNode with DEBUG logs. Contributed by Eugene Koontz. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428590 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 20:55:05 +00:00
Tsz-wo Sze
36c5fe9961 HDFS-4346. Add SequentialNumber as a base class for INodeId and GenerationStamp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428167 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 05:12:40 +00:00
Aaron Myers
6f0eb6f5b1 HDFS-4338. TestNameNodeMetrics#testCorruptBlock is flaky. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428144 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 02:25:08 +00:00
Konstantin Shvachko
7b70a688ac HDFS-4349. Add test for reading files from BackupNode. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1427290 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-01 03:39:31 +00:00
Konstantin Shvachko
df09a85ca9 HDFS-4347. Avoid infinite waiting checkpoint to complete in TestBackupNode. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1426705 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-29 04:26:54 +00:00
Konstantin Shvachko
fc105796d1 HDFS-4308. addBlock() should persist file blocks once. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1426700 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-29 04:11:58 +00:00
Tsz-wo Sze
c82961be0f HDFS-4330. Support snapshots up to the snapshot limit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1426432 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-28 08:49:33 +00:00
Tsz-wo Sze
0fa9c7a825 HDFS-4334. Add a unique id to INode. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1426429 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-28 08:26:33 +00:00
Tsz-wo Sze
b9f965de12 HDFS-4103. Support O(1) snapshot creation. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1424782 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-21 01:30:49 +00:00
Alejandro Abdelnur
b324a6134e HADOOP-8427. Convert Forrest docs to APT, incremental. (adi2 via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424459 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-20 13:41:43 +00:00
Aaron Myers
a1279e68bf HDFS-4140. fuse-dfs handles open(O_TRUNC) poorly. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423257 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-18 02:38:14 +00:00
Aaron Myers
721095474d HDFS-4315. DNs with multiple BPs can have BPOfferServices fail to start due to unsynchronized map access. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422778 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-17 07:52:32 +00:00
Tsz-wo Sze
cbbaa93ae0 HDFS-4317. Change INode and its subclasses to support HDFS-4103. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1422748 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-17 03:40:27 +00:00
Suresh Srinivas
3363c45d69 HDFS-4275. MiniDFSCluster-based tests fail on Windows due to failure to delete test namenode directory. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422278 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-15 15:50:52 +00:00
Suresh Srinivas
8aee71d1bc HDFS-4274. BlockPoolSliceScanner does not close verification log during shutdown. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422276 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-15 15:31:18 +00:00
Aaron Myers
f6f7152995 HDFS-4307. SocketCache should use monotonic time. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1421572 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-13 22:09:02 +00:00
Aaron Myers
23586e1ae5 HDFS-4310. fix test org.apache.hadoop.hdfs.server.datanode.TestStartSecureDataNode Contributed by Ivan A. Veselovsky. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1421560 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-13 21:45:15 +00:00
Sanjay Radia
cd80628ec4 HADOOP-8957 AbstractFileSystem#IsValidName should be overridden for embedded file systems like ViewFs (Chris Nauroth via Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420965 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 20:54:30 +00:00
Suresh Srinivas
aa208941d1 HDFS-4296. Reserve layout version for release 1.2.0. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420700 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 14:26:15 +00:00
Suresh Srinivas
f31b8270db HDFS-4269. Datanode rejects all datanode registrations from localhost in single-node developer setup on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420492 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 00:14:26 +00:00
Tsz-wo Sze
99d072d072 svn -c -1419192 . for reverting HDFS-4261 since TestBalancerWithNodeGroup failed in the recent Jenkins builds. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420010 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-11 06:17:35 +00:00
Aaron Myers
47ae6831e9 HDFS-2264. NamenodeProtocol has the wrong value for clientPrincipal in KerberosInfo annotation. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419949 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-11 00:52:17 +00:00
Suresh Srinivas
39d25fbac3 HDFS-4293. Fix TestSnapshot failure. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1419882 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 23:54:26 +00:00
Aaron Myers
6e82da0dea HDFS-4294. Backwards compatibility is not maintained for TestVolumeId. Contributed by Ivan A. Veselovsky and Robert Parker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419875 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 23:46:10 +00:00
Todd Lipcon
64cbb3c2ff HDFS-4295. Using port 1023 should be valid when starting Secure DataNode. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419854 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 22:46:46 +00:00
Todd Lipcon
cb9f516756 HDFS-4292. Sanity check not correct in RemoteBlockReader2.newBlockReader. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419675 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 19:13:03 +00:00
Todd Lipcon
8114bcc6d3 HDFS-4291. edit log unit tests leave stray test_edit_log_file around. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419663 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 18:54:59 +00:00
Uma Maheswara Rao G
103eff1fad HDFS-4130. BKJM: The reading for editlog at NN starting using bkjm is not efficient. Contributed by Han Xiao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419649 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 18:42:53 +00:00
Tsz-wo Sze
f4a723249e Merge r1415804 through r1419190 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1419193 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 03:37:32 +00:00
Tsz-wo Sze
8f5bd5f1bc HDFS-4261. Fix bugs in Balancer that it does not terminate in some cases and it checks BlockPlacementPolicy instance incorrectly. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419192 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 03:31:34 +00:00
Aaron Myers
e7cb3fd39c HDFS-4279. NameNode does not initialize generic conf keys when started with -recover. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418559 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 23:52:08 +00:00
Sanjay Radia
ad619d34d0 HDFS-4260 Fix HDFS tests to set test dir to a valid HDFS path as opposed to the local build path (Chris Nauroth via Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418424 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 18:32:27 +00:00
Suresh Srinivas
e1ba3f8158 HDFS-4236. Remove artificial limit on username length introduced in HDFS-4171. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418356 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 15:23:49 +00:00
Todd Lipcon
6681523c87 HDFS-4282. TestEditLog.testFuzzSequences FAILED in all pre-commit test. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418214 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 08:18:14 +00:00
Aaron Myers
df2fb006b2 HDFS-3680. Allow customized audit logging in HDFS FSNamesystem. Contributed by Marcelo Vanzin. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418114 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-06 22:27:27 +00:00
Konstantin Shvachko
8bb0dc34e4 HDFS-4268. Remove redundant enum NNHAStatusHeartbeat.State. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417752 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-06 07:20:20 +00:00
Todd Lipcon
adb8941cc2 HDFS-4238. Standby namenode should not do purging of shared storage edits. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417651 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-05 21:18:06 +00:00
Aaron Myers
6cc49f1a8b HDFS-4199. Provide test for HdfsVolumeId. Contributed by Ivan A. Veselovsky. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417263 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-05 01:45:29 +00:00
Tsz-wo Sze
1f4b135b1f HDFS-4234. Use generic code for choosing datanode in Balancer. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417130 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-04 19:22:51 +00:00
Suresh Srinivas
9821af9ce8 Reverting the previous merge r1416603 which committed some extra changes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1416712 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 22:43:00 +00:00
Tsz-wo Sze
c0a8957c2b HDFS-4243. When replacing an INodeDirectory, the parent pointers of the children of the child have to be updated to the new child. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416709 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 22:38:33 +00:00
Tsz-wo Sze
8f7c92094d HDFS-4240. For nodegroup-aware block placement, when a node is excluded, the nodes in the same nodegroup should also be excluded. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416691 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 21:59:36 +00:00
Suresh Srinivas
d500d59cbe Merging trunk to HDFS-2802 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1416603 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 18:04:51 +00:00
Konstantin Shvachko
cbed126eec HDFS-4231. BackupNode: Introduce BackupState. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416288 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-02 23:17:03 +00:00
Harsh J
5954e4f1ac HDFS-3358. Specify explicitly that the NN UI status total is talking of persistent objects on heap. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416245 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-02 20:05:54 +00:00
Tsz-wo Sze
88eea21572 HDFS-4248. Renaming directories may incorrectly remove the paths in leases under the tree. Contributed by daryn 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416064 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-01 22:29:54 +00:00
Daryn Sharp
64fe19e0d4 HDFS-4247. saveNamespace should be tolerant of dangling lease (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416034 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-01 18:18:58 +00:00
Tsz-wo Sze
6ad4752853 Merge r1414455 through r1415803 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1415809 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 19:52:49 +00:00
Tsz-wo Sze
571da54179 HDFS-4213. Add an API to hsync for updating the last block length at the namenode. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415799 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 19:24:30 +00:00
Aaron Myers
d866f81edb Reverting initial commit of HDFS-3680 pending further comments. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415797 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 19:19:01 +00:00
Aaron Myers
a85a0293c7 HDFS-3680. Allow customized audit logging in HDFS FSNamesystem. Contributed by Marcelo Vanzin. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415794 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 19:11:24 +00:00
Tsz-wo Sze
6b08d7de5f HDFS-4242. Map.Entry is incorrectly used in LeaseManager since the behavior of it is undefined after the iteration or modifications of the map. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415480 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 02:51:25 +00:00
Tsz-wo Sze
1634e980af HDFS-3495. Update Balancer to support new NetworkTopology with NodeGroup. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414874 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-28 19:19:27 +00:00
Aaron Myers
2b8824853b HDFS-4214. OfflineEditsViewer should print out the offset at which it encountered an error. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414500 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-28 01:38:31 +00:00
Tsz-wo Sze
1ce3274dd5 Merge r1412283 through r1414454 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1414456 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-27 23:02:00 +00:00
Tsz-wo Sze
9047eb5162 HDFS-4209. Clean up the addNode/addChild/addChildNoQuotaCheck methods in FSDirectory and INodeDirectory. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414447 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-27 22:36:20 +00:00
Suresh Srinivas
7e56bfe405 HDFS-4200. Reduce the size of synchronized sections in PacketResponder. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413826 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-26 20:47:58 +00:00
Tsz-wo Sze
3dd84fcef7 Merge r1410998 through r1412282 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1412297 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 21:08:45 +00:00
Tsz-wo Sze
0f1899ee19 HDFS-4216. Do not ignore QuotaExceededException when adding symlinks. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412237 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 19:27:48 +00:00
Thomas White
d6af507199 HADOOP-9049. DelegationTokenRenewer needs to be Singleton and FileSystems should register/deregister to/from. Contributed by Karthik Kambatla. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412077 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 12:29:37 +00:00
Tsz-wo Sze
506938f0b3 HDFS-4215. Remove locking from addToParent(..) since it is used in image loading, and add INode.isFile(). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411947 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 00:13:53 +00:00
Eli Collins
c3f13a7fef HADOOP-9042. Add a test for umask in FileSystemContractBaseTest. Contributed by Colin McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411879 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-20 21:13:48 +00:00
Konstantin Shvachko
573c41c266 HDFS-4179. BackupNode: allow reads, fix checkpointing, safeMode. (shv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411508 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-20 02:00:20 +00:00
Suresh Srinivas
1253e02f66 HDFS-4175. Additional snapshot tests for more complicated directory structure and modifications. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1411503 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-20 01:51:19 +00:00
Daryn Sharp
c944d0666c HDFS-4178. Shell scripts should not close stderr (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411229 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-19 15:04:28 +00:00
Tsz-wo Sze
d8ffea5943 Merge r1408927 through r1410997 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1411007 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 22:31:28 +00:00
Tsz-wo Sze
d66f9e8269 HDFS-4206. Change the fields in INode and its subclasses to private. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410996 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 22:03:11 +00:00
Tsz-wo Sze
9bed64a6fc HDFS-4196. Support renaming of snapshots. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1410986 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 20:44:10 +00:00
Alejandro Abdelnur
6f80a2a76c HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410824 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 04:10:29 +00:00
Eli Collins
ecbb41923c HDFS-4156. Seeking to a negative position should throw an IOE. Contributed by Eli Reisman 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410812 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 02:11:50 +00:00
Jitendra Nath Pandey
1cbc38a878 HDFS-4105. The SPNEGO user for secondary namenode should use the web keytab. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410691 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-17 03:30:48 +00:00
Aaron Myers
320c32a289 HDFS-3507. DFS#isInSafeMode needs to execute only on Active NameNode. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410587 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-16 21:51:39 +00:00
Todd Lipcon
51ca2fd3e9 HDFS-3935. Add JournalNode to the start/stop scripts. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410584 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-16 21:45:48 +00:00
Tsz-wo Sze
b5a2dd19c4 HDFS-4187. Add tests for replication handling in snapshots. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1410097 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 23:08:25 +00:00
Tsz-wo Sze
8ca8687fb2 HDFS-4188. Add Snapshot.ID_COMPARATOR for comparing IDs and fix a bug in ReadOnlyList.Util.binarySearch(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1410027 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 21:34:54 +00:00
Eli Collins
96f28d878e HDFS-4100. Fix all findbug security warings. Contributed by Liang Xie 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409995 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 20:37:41 +00:00
Daryn Sharp
298eb42657 HDFS-4186. logSync() is called with the write lock held while releasing lease (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409988 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 20:33:30 +00:00
Uma Maheswara Rao G
8a2de21315 HDFS-3623. BKJM: zkLatchWaitTimeout hard coded to 6000. Make use of ZKSessionTimeout instead. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409905 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 18:25:55 +00:00
Daryn Sharp
97e52dd71e HDFS-4104. dfs -test -d prints inappropriate error on nonexistent directory (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409848 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 15:51:03 +00:00
Robert Joseph Evans
59e4199d84 HDFS-4182. SecondaryNameNode leaks NameCache entries (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409311 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 19:21:25 +00:00
Robert Joseph Evans
b2456ca3b8 svn merge -r 1409087:1409086 reverting HDFS-4171 until test failures can be fixed. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409266 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 17:32:55 +00:00
Eli Collins
a780f0ac33 HDFS-4139. fuse-dfs RO mode still allows file truncation. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409088 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 06:17:19 +00:00
Alejandro Abdelnur
368f628ce5 HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409087 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 06:12:03 +00:00
Uma Maheswara Rao G
0800aa90dd HDFS-4038. Override toString() for BookKeeperEditLogInputStream. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409071 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 03:10:10 +00:00
Suresh Srinivas
2116d0520e HDFS-4148. Disallow write/modify operations on files and directories in a snapshot. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1409023 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 23:26:40 +00:00
Tsz-wo Sze
2a9f450511 Merge r1407704 through r1408926 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1408938 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 20:21:39 +00:00
Tsz-wo Sze
099762a0bc HDFS-4177. Add a snapshot parameter to INodeDirectory.getChildrenList() for selecting particular snapshot children list views. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1408923 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 19:59:55 +00:00
Daryn Sharp
4741064250 HDFS-4181. LeaseManager tries to double remove and prints extra messages (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408779 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 15:29:04 +00:00
Eli Collins
3492ab6de0 HDFS-1322. Document umask in DistributedFileSystem#mkdirs javadocs. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408532 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 01:28:33 +00:00
Aaron Myers
b3e42a1ed5 HDFS-3921. NN will prematurely consider blocks missing when entering active state while still in safe mode. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408531 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 01:26:20 +00:00
Eli Collins
c1a2098304 HDFS-4164. fuse_dfs: add -lrt to the compiler command line on Linux. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408477 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 22:20:43 +00:00
Robert Joseph Evans
7ff7f67a82 HDFS-4172. namenode does not URI-encode parameters when building URI for datanode request (Derek Dagit via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408401 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 18:51:27 +00:00
Thomas White
42f4691ead Add new files missed from HADOOP-8860 commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408288 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 13:54:27 +00:00
Tsz-wo Sze
40fe1ffbaa Merge r1406415 through r1407703 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1407706 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-10 00:49:15 +00:00
Tsz-wo Sze
5120bfca0a HDFS-4170. Add snapshot information to INodesInPath. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1407703 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-10 00:27:59 +00:00
Alejandro Abdelnur
9d5205aadd HADOOP-8860. Split MapReduce and YARN sections in documentation navigation. (tomwhite via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407658 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 21:44:00 +00:00
Suresh Srinivas
db71de2e11 HDFS-4080. Add a separate logger for block state change logs to enable turning off those logs. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407566 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 18:07:04 +00:00
Suresh Srinivas
c7ab9779d2 HDFS-4162. Some malformed and unquoted HTML strings are returned from datanode web ui. Contributed by Darek Dagit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407556 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 17:39:20 +00:00
Eli Collins
312eb23598 HDFS-4048. Use ERROR instead of INFO for volume failure logs. Contributed by Stephen Chu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407345 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 02:57:05 +00:00
Daryn Sharp
be94bf6b57 HDFS-3990. NN's health report has severe performance problems (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407333 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 00:53:11 +00:00
Suresh Srinivas
0f7a4337ac HDFS-4165. Faulty sanity check in FsDirectory.unprotectedSetQuota. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407245 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-08 19:54:55 +00:00
Uma Maheswara Rao G
f1fe91ec95 HDFS-3810. Implement format() for BKJM. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407182 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-08 17:45:46 +00:00
Tsz-wo Sze
b94cf83a11 HDFS-4159. Rename should fail when the destination directory is snapshottable and has snapshots. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1406771 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 19:38:29 +00:00
Tsz-wo Sze
8a577a16f9 HDFS-4150. Update the inode in the block map when a snapshotted file or a snapshot file is deleted. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1406763 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 19:30:36 +00:00
Konstantin Shvachko
1ab97373de HDFS-4138. BackupNode startup fails due to uninitialized edit log. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406734 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 17:45:01 +00:00
Aaron Myers
817a26b6c8 HDFS-4153. Add START_MSG/SHUTDOWN_MSG for JournalNode. Contributed by liang xie. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406473 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 06:29:37 +00:00
Tsz-wo Sze
7160c01f61 Merge r1406327 through r1406414 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1406415 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 01:03:16 +00:00
Suresh Srinivas
c013142a12 HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406413 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 00:48:17 +00:00
Tsz-wo Sze
1e7010cf38 HDFS-3979. For hsync, datanode should wait for the local sync to complete before sending ack. Contributed by Lars Hofhansl 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406382 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 22:34:29 +00:00
Suresh Srinivas
251230a126 HADOOP-9004. Reverting the commit r1406202 to address patch issue 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406379 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 22:23:51 +00:00
Todd Lipcon
a3f3a6c5a3 HDFS-4155. libhdfs implementation of hsync API. Contributed by Liang Xie. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406372 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 22:05:34 +00:00
Tsz-wo Sze
92c440c115 Merge r1406007 through r1406326 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1406337 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 21:11:42 +00:00
Tsz-wo Sze
1734215a10 HDFS-4152. Add a new class BlocksMapUpdateInfo for the parameter in INode.collectSubtreeBlocksAndClear(..). Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406326 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 21:04:32 +00:00
Daryn Sharp
54b70db347 HDFS-4075. Reduce recommissioning overhead (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406278 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 19:27:47 +00:00
Suresh Srinivas
b13a5cdcb7 HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406202 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 16:12:43 +00:00
Daryn Sharp
3a698e6aea HDFS-1331. dfs -test should work like /bin/test (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406198 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 15:57:58 +00:00
Tsz-wo Sze
34413c2000 svn merge -c 1406006 from trunk for HDFS-4151. Change the methods in FSDirectory to pass INodesInPath instead of INode[] as a parameter. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1406014 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 23:56:53 +00:00
Suresh Srinivas
159e507995 HDFS-4046. Adding the missed file in revision 1406011 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406012 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 23:50:29 +00:00
Suresh Srinivas
e0ce1b2475 HDFS-4046. Rename ChecksumTypeProto enum NULL since it is illegal in C/C++. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406011 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 23:49:33 +00:00
Tsz-wo Sze
7ee5ce3176 HDFS-4151. Change the methods in FSDirectory to pass INodesInPath instead of INode[] as a parameter. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406006 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 23:26:34 +00:00
Tsz-wo Sze
b3bc2fb76e HDFS-4147. When there is a snapshot in a subtree, deletion of the subtree should fail. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1405688 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 01:22:54 +00:00
Tsz-wo Sze
f84000900a HDFS-4149. Implement the disallowSnapshot(..) in FSNamesystem and add resetSnapshottable(..) to SnapshotManager. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1405683 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 00:40:54 +00:00
Tsz-wo Sze
deaf979d41 HDFS-4146. Use getter and setter in INodeFileWithLink to access blocks and initialize root directory as snapshottable. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1405648 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-04 22:00:13 +00:00
Tsz-wo Sze
554fb4d2b2 Merge r1404624 through r1405251 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1405253 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-03 01:38:41 +00:00
Tsz-wo Sze
e5a7b3d430 HDFS-4141. Support directory diff - the difference between the current state and a previous snapshot of an INodeDirectory. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1405250 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-03 01:31:51 +00:00
Tsz-wo Sze
d174f574ba HDFS-4143. Change blocks to private in INodeFile and renames isLink() to isSymlink() in INode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405237 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-03 00:20:03 +00:00
Todd Lipcon
a9e4b08f2b HDFS-4132. When libwebhdfs is not enabled, nativeMiniDfsClient frees uninitialized memory. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405149 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-02 20:35:51 +00:00
Daryn Sharp
19befa0748 HDFS-3804. TestHftpFileSystem fails intermittently with JDK7 (Trevor Robinson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404985 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-02 14:56:22 +00:00
Suresh Srinivas
77fe43ac14 HDFS-4095. Add some snapshot related metrics. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1404881 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-02 05:01:10 +00:00
Suresh Srinivas
98c0f13b19 HDFS-4116. Add auditlog for some snapshot operations. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1404860 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-02 02:26:58 +00:00
Suresh Srinivas
8b71399abb HDFS-4133. Add testcases for testing basic snapshot functionalities. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1404498 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-01 08:29:41 +00:00
Tsz-wo Sze
e341184d54 Merge r1403306 through r1404284 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1404285 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 18:34:51 +00:00
Suresh Srinivas
f3b9963d46 HDFS-4118. Change INodeDirectory.getExistingPathINodes(..) to work with snapshots. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1403959 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 03:13:20 +00:00
Suresh Srinivas
07e0d7730d HDFS-4129. Add utility methods to dump NameNode in memory tree for testing. Contributed by Tsz Wo (Nicholas), SZE. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403956 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 02:33:44 +00:00
Suresh Srinivas
cd0d206bb8 HDFS-3916. libwebhdfs testing code cleanup. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403922 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 23:12:12 +00:00
Daryn Sharp
deef03c5d6 HADOOP-8994. TestDFSShell creates file named "noFileHere", making further tests hard to understand (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403714 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 14:21:00 +00:00
Suresh Srinivas
7604a276a7 HDFS-4127. Log message is not correct in case of short of replica. Contributed by Junping Du. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403616 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 05:48:58 +00:00
Suresh Srinivas
783124488c Merging changes from trunk to pick HDFS-4124 changes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1403306 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 14:17:28 +00:00
Suresh Srinivas
1b3b09d947 HDFS-4124. Refactor INodeDirectory#getExistingPathINodes() to enable returningmore than INode array. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403304 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 14:11:04 +00:00
Suresh Srinivas
564adec5b5 Merging trunk to HDFS-2802 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1403301 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 14:09:47 +00:00
Suresh Srinivas
4bcf516d0e HDFS-3920. libwebdhfs string processing and using strerror consistently to handle all errors. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403173 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 05:10:29 +00:00
Suresh Srinivas
cea7bbc630 HDFS-4122. Cleanup HDFS logs and reduce the size of logged messages. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403120 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-28 23:10:53 +00:00
Tsz-wo Sze
f60a844e7a HDFS-4119. Complete the allowSnapshot code and add a test for it. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1403087 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-28 20:02:54 +00:00
Suresh Srinivas
fd7de4c4eb HDFS-4106. BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be volatile. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403075 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-28 19:03:57 +00:00
Suresh Srinivas
abe3676e50 HDFS-4115. TestHDFSCLI.testAll fails one test due to number format. Contributed by Trevor Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403074 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-28 18:59:11 +00:00
Suresh Srinivas
cd2e9d2fce HDFS-4121. Add namespace declarations in hdfs .proto files for languages other than java. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402836 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-27 18:25:02 +00:00
Suresh Srinivas
9e26fdcda7 HDFS-4111. Support snapshot of subtrees. Contributed by Tsz Wo (Nicholas), Sze. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1402684 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 22:02:30 +00:00
Tsz-wo Sze
3335e50244 HDFS-3616. Fix a ConcurrentModificationException bug that BP actor threads may not be shutdown properly in DataNode. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402608 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 18:22:49 +00:00
Tsz-wo Sze
b5355e5050 Merge r1402274 through r1402603 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1402605 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 18:17:03 +00:00
Tsz-wo Sze
0e796b61e8 HDFS-4112. A few improvements on INodeDirectory include adding a utility method for casting; avoiding creation of new empty lists; cleaning up some code and rewriting some javadoc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402599 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 18:08:38 +00:00
Tsz-wo Sze
719279ea8a HDFS-4092. Update file deletion logic for snapshot so that the current inode is removed from the circular linked list; and if some blocks at the end of the block list no longer belong to any other inode, collect them and update the block list. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1402287 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 19:32:26 +00:00
Tsz-wo Sze
40d2b6f308 Merge r1401869 through r1402273 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1402278 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 19:09:34 +00:00
Tsz-wo Sze
2d74f68054 HDFS-3948. Do not use hflush in TestWebHDFS.testNamenodeRestart() since the out stream returned by WebHdfsFileSystem does not support it. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402270 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 18:53:25 +00:00
Tsz-wo Sze
ba2ee1d7fb HDFS-4107. Add utility methods for casting INode to INodeFile and INodeFileUnderConstruction. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402265 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 18:44:46 +00:00
Suresh Srinivas
163577f905 HDFS-4067. TestUnderReplicatedBlocks intermittently fails due to ReplicaAlreadyExistsException. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402261 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 18:32:41 +00:00
Suresh Srinivas
611684e2e5 HDFS-4110. Refine a log printed in JNStorage. Contributed by Liang Xie. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402203 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 16:15:59 +00:00
Suresh Srinivas
2d5334931e HDFS-4097. Provide CLI support for createSnapshot. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1401971 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 04:08:36 +00:00
Tsz-wo Sze
14d8d0a670 Merge r1400738 through r1401868 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1401869 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 20:42:03 +00:00
Tsz-wo Sze
b897bb8992 HDFS-4091. Add snapshot quota to limit the number of snapshots allowed. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1401868 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 20:39:26 +00:00
Suresh Srinivas
4fde5c0190 HDFS-4084. Provide CLI support to allow and disallow snapshot on a directory. Contributed by Brondon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1401444 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 20:26:08 +00:00
Suresh Srinivas
aa42e2161d HDFS-2434. TestNameNodeMetrics.testCorruptBlock fails intermittently. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401423 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 20:02:09 +00:00
Daryn Sharp
a92313f7bd HDFS-4090. getFileChecksum() result incompatible when called against zero-byte files. (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401309 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 15:03:53 +00:00
Tsz-wo Sze
75cdb5bb49 HDFS-4099. Clean up replication code and add more javadoc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400986 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-22 18:30:16 +00:00
Tsz-wo Sze
9a0651b4b8 HDFS-4078. Handle replication in snapshots. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400743 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-22 00:11:25 +00:00
Suresh Srinivas
f29724956a Merging trunk changes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400740 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-21 23:10:11 +00:00
Tsz-wo Sze
820b5495ca HDFS-4079. Add SnapshotManager which maintains a list for all the snapshottable directories and supports snapshot methods such as setting a directory to snapshottable and creating a snapshot. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400728 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-21 21:35:13 +00:00
Suresh Srinivas
625d7cf20b HDFS-4087. Protocol changes for listSnapshots functionality. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400698 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-21 19:05:49 +00:00
Uma Maheswara Rao G
35ec20b7c6 HDFS-4022. Replication not happening for appended block. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400578 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-21 06:31:31 +00:00
Tsz-wo Sze
d9a9daeb2d Merge r1399946 through r1400349 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400351 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-20 00:33:57 +00:00
Suresh Srinivas
a2d837b0e9 HDFS-4077. Adding a file missed in the commit r1400318. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400350 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-20 00:31:57 +00:00
Tsz-wo Sze
661a8d176a HDFS-4088. Remove "throws QuotaExceededException" from an INodeDirectoryWithQuota constructor. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400345 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-20 00:06:12 +00:00
Suresh Srinivas
af130d4baf HDFS-4077. Add support for Snapshottable Directory. Contributed by Nicholas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400318 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 22:21:50 +00:00
Suresh Srinivas
f5c4defcb3 HDFS-4083. Protocol changes for snapshots. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400316 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 22:15:27 +00:00
Suresh Srinivas
ecffab63af HDFS-4086. Add editlog opcodes to allow and disallow snapshots on a directory. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400298 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 21:15:11 +00:00
Suresh Srinivas
40f8b7dcfb Reverting the change r1400285 since it included unrelated changes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400290 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 21:04:29 +00:00
Suresh Srinivas
4cccdc2a96 Moving HDFS-2802 related changes to a separate CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400285 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 21:01:26 +00:00
Tsz-wo Sze
e75424544f HDFS-4082. Add editlog opcodes for snapshot create and delete operations. Contributed by suresh 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400247 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 19:38:48 +00:00
Tsz-wo Sze
5c1a7b9d5d HDFS-4076. Support snapshot of single files. (szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400245 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 19:35:19 +00:00
Suresh Srinivas
0603447f2a HDFS-4072. On file deletion remove corresponding blocks pending replications. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399965 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 04:55:11 +00:00
Eli Collins
7da5d03c35 HDFS-4053. Increase the default block size. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399908 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-18 22:56:30 +00:00
Eli Collins
57ee22e589 HADOOP-8925. Remove the packaging. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399889 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-18 22:30:11 +00:00
Tsz-wo Sze
4af8761e4c HDFS-4074. Remove the unused default constructor from INode. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399866 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-18 21:29:12 +00:00
Tsz-wo Sze
c1bd54daa3 HDFS-4073. Two minor improvements to FSDirectory. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399861 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-18 21:18:25 +00:00
Eli Collins
4d5600f6c7 HDFS-4068. DatanodeID and DatanodeInfo member should be private. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399443 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 21:34:48 +00:00
Eli Collins
a258263ecf HDFS-4029. GenerationStamp should use an AtomicLong. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399096 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 04:58:24 +00:00
Eli Collins
24015b7684 HDFS-4055. TestAuditLogs is flaky. Contributed by Binglin Chang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399093 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 04:39:07 +00:00
Aaron Myers
402836479f HDFS-3997. OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED element. Contributed by Mithun Radhakrishnan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399062 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 01:10:55 +00:00
Eli Collins
e074b5816a HDFS-4061. TestBalancer and TestUnderReplicatedBlocks need timeouts. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399010 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 21:59:15 +00:00
Suresh Srinivas
0ef9c6f71a HDFS-4059. Add number of stale DataNodes to metrics. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398949 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 19:39:50 +00:00
Eli Collins
b245adb163 HDFS-3985. Add timeouts to TestMulitipleNNDataBlockScanner. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398874 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 16:29:21 +00:00
Suresh Srinivas
b7887f31fb HDFS-4052. BlockManager#invalidateWork should print log outside the lock. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398631 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 03:37:49 +00:00
Eli Collins
a75673cbd8 HDFS-4058. DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398612 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 02:12:59 +00:00
Aaron Myers
557ffe2101 HDFS-2946. HA: Put a cap on the number of completed edits files retained by the NN. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398609 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 01:59:46 +00:00
Todd Lipcon
ded304e6a6 HDFS-4049. Fix hflush performance regression due to nagling delays. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398591 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 00:55:29 +00:00
Tsz-wo Sze
698fa5077a HDFS-4036. Remove "throw UnresolvedLinkException" from FSDirectory.unprotectedAddFile(..). Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398293 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-15 14:05:31 +00:00
Tsz-wo Sze
ad06a08713 HDFS-4037. Rename the getReplication() method in BlockCollection to getBlockReplication(). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398288 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-15 13:48:56 +00:00
Jason Darrell Lowe
f8bdac0a1b HADOOP-8906. paths with multiple globs are unreliable. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397704 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 19:49:40 +00:00
Suresh Srinivas
89b66da42c HDFS-4044. Duplicate ChecksumType definition in HDFS .proto files. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397580 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 14:32:16 +00:00
Suresh Srinivas
94ed14c48c HADOOP-8911. CRLF characters in source and text files. Contributed Raja Aluri. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397432 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 04:35:42 +00:00
Suresh Srinivas
4e64e6f860 HDFS-4041. Hadoop HDFS Maven protoc calls must not depend on external sh script. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397362 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 23:10:47 +00:00
Suresh Srinivas
2887bbb33c HDFS-3912. Detect and avoid stale datanodes for writes. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397211 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 18:08:27 +00:00
Todd Lipcon
ff8f84ccf6 Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1396918 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 06:14:26 +00:00
Suresh Srinivas
33c16f2a24 HADOOP-8913. hadoop-metrics2.properties should give units in comment for sampling period. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396904 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 05:17:03 +00:00
Aaron Myers
8078e16015 HDFS-4021. Misleading error message when resources are low on the NameNode. Contributed by Christopher Conner. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396881 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 00:32:46 +00:00
Jason Darrell Lowe
08f35a04c6 HDFS-3224. Bug in check for DN re-registration with different storage ID. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396798 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 21:15:06 +00:00
Eli Collins
c9a1d4dc33 HDFS-4020. TestRBWBlockInvalidation may time out. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396725 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 18:42:54 +00:00
Thomas Graves
a0a96eb142 HDFS-3824. TestHftpDelegationToken fails intermittently with JDK7 (Trevor Robinson via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396705 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 17:35:18 +00:00
Eli Collins
03c96ef29e HDFS-4018. TestDataNodeMultipleRegistrations#testMiniDFSClusterWithMultipleNN is missing some cluster cleanup. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395821 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 00:18:27 +00:00
Todd Lipcon
17b32bb2de HDFS-4007. Rehabilitate bit-rotted unit tests under hadoop-hdfs-project/hadoop-hdfs/src/test/unit/. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395731 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 19:19:21 +00:00
Todd Lipcon
70fc5cf01c HDFS-4017. Unclosed FileInputStream in GetJournalEditServlet. Contributed by Chao Shi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1395727 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 19:11:48 +00:00
Eli Collins
5dcdc8aa58 HDFS-4003. test-patch should build the common native libs before running hdfs tests. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395708 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 18:34:14 +00:00
Eli Collins
3a4cf1c064 HDFS-4008. TestBalancerWithEncryptedTransfer needs a timeout. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395700 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 18:11:53 +00:00
Eli Collins
5a5473b29f HDFS-4006. TestCheckpoint#testSecondaryHasVeryOutOfDateImage occasionally fails due to unexpected exit. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395387 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-07 21:35:51 +00:00
Eli Collins
e32af6034b HDFS-3682. MiniDFSCluster#init should provide more info when it fails. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395385 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-07 21:16:08 +00:00
Aaron Myers
353958dccc HDFS-3483. Better error message when hdfs fsck is run against a ViewFS config. Contributed by Stephen Fritz. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394864 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-06 00:13:28 +00:00
Thomas Graves
d35169d9ba HDFS-3829. TestHftpURLTimeouts fails intermittently with JDK7 (Trevor Robinson via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394609 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 15:51:10 +00:00
Suresh Srinivas
dfb8369c29 HDFS-3735. NameNode WebUI should allow sorting live datanode list by fields Block Pool Used, Block Pool Used(%) and Failed Volumes. Contributed by Brahma Reddy Battula. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394385 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 07:02:52 +00:00
Suresh Srinivas
a41f808c3c HDFS-3995. Use DFSTestUtil.createFile() for file creation and writing in test cases. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394376 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 06:22:26 +00:00