big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
10,229 Commits 2 Branches 2 Tags 264 MiB
344d7cb6dc
Commit Graph

2740 Commits

Author SHA1 Message Date
Eli Collins
43ae84761f HDFS-3996. Add debug log removed in HDFS-3873 back. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393777 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 21:30:45 +00:00
Eli Collins
f8f79a02aa HDFS-3753. Tests don't run with native libraries. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393113 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-02 19:13:53 +00:00
Robert Joseph Evans
af647bb3ce Preparing for release 0.23.4 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391805 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 14:15:39 +00:00
Aaron Myers
648ba4a36b HDFS-3992. Method org.apache.hadoop.hdfs.TestHftpFileSystem.tearDown() sometimes throws NPEs. Contributed by Ivan A. Veselovsky. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391763 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 07:30:45 +00:00
Aaron Myers
e8dc3b3a8a HDFS-3896. Add descriptions for dfs.namenode.rpc-address and dfs.namenode.servicerpc-address to hdfs-default.xml. Contributed by Jeff Lord. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391708 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 00:51:48 +00:00
Robert Joseph Evans
01c0dc98bb HDFS-3831. Failure to renew tokens due to test-sources left in classpath (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391121 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 17:31:48 +00:00
Eli Collins
47dfcf45af HDFS-3972. Trash emptier fails in secure HA cluster. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390729 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 21:25:04 +00:00
Tsz-wo Sze
a7bcdcc051 HDFS-3373. Change DFSClient input stream socket cache to global static and add a thread to cleanup expired cache entries. Contributed by John George 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390466 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 13:23:21 +00:00
Suresh Srinivas
248756eac6 Moving HDFS-234 from trunk to Release 2.0.0-alpha section 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389494 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-24 17:44:32 +00:00
Harsh J
9c9b3f09ed HADOOP-8158. Interrupting hadoop fs -put from the command line causes a LeaseExpiredException. Contributed by Daryn Sharp. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389010 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-23 10:50:44 +00:00
Eli Collins
fa6d519657 HDFS-3964. Make NN log of fs.defaultFS debug rather than info. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388335 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 06:17:29 +00:00
Eli Collins
3ea3508319 HDFS-3931. TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388331 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 05:48:42 +00:00
Eli Collins
7dee7f11f6 HDFS-3932. NameNode Web UI broken if the rpc-address is set to the wildcard. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388321 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 04:51:43 +00:00
Eli Collins
d26f05b7f5 HDFS-3949. NameNodeRpcServer#join should join on both client and server RPC servers. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387838 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-20 01:33:13 +00:00
Alejandro Abdelnur
7fb42f8f4b HDFS-3951. datanode web ui does not work over HTTPS when datanode is started in secure mode. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387688 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 17:39:46 +00:00
Eli Collins
a8e4bb81b2 HDFS-3939. NN RPC address cleanup. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387278 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 17:42:09 +00:00
Eli Collins
7e3776ca6e HDFS-3936. MiniDFSCluster shutdown races with BlocksMap usage. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387255 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 16:59:47 +00:00
Alejandro Abdelnur
c419b1385d HDFS-3944. Httpfs resolveAuthority() is not resolving host correctly. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386994 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 05:45:57 +00:00
Alejandro Abdelnur
0de9642514 HDFS-3938. remove current limitations from HttpFS docs. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384842 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-14 16:28:47 +00:00
Aaron Myers
86635168fe HDFS-3924. Multi-byte id in HdfsVolumeId. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384602 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-13 23:48:25 +00:00
Suresh Srinivas
d543140089 HDFS-3703. Datanodes are marked stale if heartbeat is not received in configured timeout and are selected as the last location to read from. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384209 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-13 05:46:18 +00:00
Eli Collins
4f312cfa70 HDFS-3928. MiniDFSCluster should reset the first ExitException on shutdown. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384092 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 19:15:38 +00:00
Eli Collins
2ba149f85c HDFS-3902. TestDatanodeBlockScanner#testBlockCorruptionPolicy is broken. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384081 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 18:36:01 +00:00
Todd Lipcon
80a8d57ffc HDFS-3925. Prettify PipelineAck#toString() for printing to a log. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384078 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 18:32:57 +00:00
Eli Collins
f0c3ed79dd HDFS-3919. MiniDFSCluster:waitClusterUp can hang forever. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383759 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 04:21:31 +00:00
Eli Collins
414abe6918 HDFS-3664. BlockManager race when stopping active services. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383753 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 04:10:58 +00:00
Eli Collins
dc1fd84bd1 HDFS-3910. DFSTestUtil#waitReplication should timeout. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383618 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 21:24:12 +00:00
Eli Collins
e1ffefa860 HDFS-3907. Allow multiple users for local block readers. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383031 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:46:13 +00:00
Tsz-wo Sze
009235f4a9 HDFS-2656. Add libwebhdfs, a pure C client based on WebHDFS. Contributed by Jaimin D Jetly and Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382836 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 13:43:28 +00:00
Eli Collins
3a4dcfba57 HDFS-2757. Cannot read a local block that's being written to when using the local read short circuit. Contributed by Jean-Daniel Cryans 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382409 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-09 06:37:31 +00:00
Arun Murthy
681408f898 Set date for hadoop-2.0.2-alpha 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382199 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 22:39:45 +00:00
Arun Murthy
7851676f22 Preparing for hadoop-2.0.2-alpha release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382191 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 22:09:48 +00:00
Alejandro Abdelnur
9da626af41 HDFS-3895. hadoop-client must include commons-cli (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381719 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 19:03:37 +00:00
Uma Maheswara Rao G
6fd7df77a5 HDFS-3809. Make BKJM use protobufs for all serialization with ZK. Contributed by Ivan Kelly 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381699 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 18:03:16 +00:00
Daryn Sharp
82b981cca4 HDFS-3890. filecontext mkdirs doesn't apply umask as expected (Tom Graves via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381606 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 14:06:58 +00:00
Eli Collins
01db4d2bb2 HDFS-3828. Block Scanner rescans blocks too frequently. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381472 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 06:19:30 +00:00
Todd Lipcon
31142aa892 HDFS-1490. TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380988 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:53:15 +00:00
Todd Lipcon
c334cc89a8 HDFS-2793. Add an admin command to trigger an edit log roll. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380982 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:40:23 +00:00
Tsz-wo Sze
658e7b5818 HDFS-3888. Clean up BlockPlacementPolicyDefault. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380939 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-04 23:56:10 +00:00
Tsz-wo Sze
f3927595cc HDFS-3887. Remove redundant chooseTarget methods in BlockPlacementPolicy. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380934 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-04 23:48:01 +00:00
Alejandro Abdelnur
4244c1443c HDFS-3866. HttpFS POM should have property where to download tomcat from (zero45 via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380927 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-04 22:55:40 +00:00
Robert Joseph Evans
f5943c1eef Updated CHANGES.txt for 0.23.4 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380906 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-04 21:45:33 +00:00
Uma Maheswara Rao G
3969bcb7c9 HDFS-3469. start-dfs.sh will start zkfc, but stop-dfs.sh will not stop zkfc similarly. Contributed by Vinay 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380003 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-02 16:20:13 +00:00
Suresh Srinivas
da3bd67138 HDFS-3880. Use Builder to build RPC server in HDFS. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379917 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-02 06:20:41 +00:00
Harsh J
54e612bfb9 HDFS-2580. NameNode#main(...) can make use of GenericOptionsParser. Contributed by harsh. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379828 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-01 19:22:11 +00:00
Tsz-wo Sze
50222ff529 HDFS-3871. Change NameNodeProxies to use RetryUtils. Contributed by Arun C Murthy 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379743 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-01 11:41:15 +00:00
Owen O'Malley
c76a7893f9 HDFS-3466. Get HTTP kerberos principal from the web authentication keytab. 
(omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379646 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 22:31:03 +00:00
Daryn Sharp
94c69f2c82 HDFS-3852. TestHftpDelegationToken is broken after HADOOP-8225 (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379623 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 21:31:55 +00:00
Daryn Sharp
3819c964fa HDFS-3873. Hftp assumes security is disabled if token fetch fails (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379615 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 21:24:48 +00:00
Suresh Srinivas
2fd49f5a57 HDFS-3833. TestDFSShell fails on windows due to concurrent file read/write. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379525 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 17:43:35 +00:00
Eli Collins
7d1c8d92f9 HDFS-3733. Audit logs should include WebHDFS access. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379278 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 04:08:23 +00:00
Eli Collins
34d1e73235 HDFS-3837. Fix DataNode.recoverBlock findbugs warning. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379172 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 21:40:28 +00:00
Daryn Sharp
bb64f860eb HDFS-3861. Deadlock in DFSClient (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379093 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 19:46:14 +00:00
Aaron Myers
b2d186d865 HDFS-3864. NN does not update internal file mtime for OP_CLOSE when reading from the edit log. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378413 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-29 01:19:07 +00:00
Aaron Myers
d4d2bf73a9 HDFS-3849. When re-loading the FSImage, we should clear the existing genStamp and leases. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378364 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 22:09:27 +00:00
Aaron Myers
8d724dd8b9 HDFS-3860. HeartbeatManager#Monitor may wrongly hold the writelock of namesystem. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378228 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 17:01:38 +00:00
Eli Collins
36c5388080 Fixup CHANGELOG for HDFS-3856. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377936 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 01:45:26 +00:00
Eli Collins
b29cb2d997 HDFS-3856. TestHDFSServerPorts failure is causing surefire fork failure. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377934 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 01:41:13 +00:00
Suresh Srinivas
735046ebec HDFS-3851. DFSOutputStream class code cleanup. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377372 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-26 04:00:26 +00:00
Aaron Myers
56285e1bee HDFS-3683. Edit log replay progress indicator shows >100% complete. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377367 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-26 00:31:12 +00:00
Suresh Srinivas
deead78e35 HDFS-3844. Add @Override and remove {@inheritdoc} and unnecessary imports. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377168 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-25 01:03:22 +00:00
Eli Collins
a11042365f HDFS-3731. 2.0 release upgrade must handle blocks being written from 1.0. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377137 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 22:10:38 +00:00
Aaron Myers
92cb6b093c HDFS-3678. Edit log files are never being purged from 2NN. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377046 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 18:52:59 +00:00
Suresh Srinivas
a95bbb107f Correcting the jira number back to HDFS-3834 from HDFS-3844. I should pay better attention. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377008 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 17:53:19 +00:00
Suresh Srinivas
8c8d679cd5 Correcting the jira number from HDFS-3834 to HDFS-3844 for the commit 1377001 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377007 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 17:51:10 +00:00
Suresh Srinivas
7a1dc1ab70 HDFS-3834. Remove unused static fields NAME, DESCRIPTION and Usage from Command. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377001 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 17:36:22 +00:00
Tsz-wo Sze
c46de830da HDFS-3177. Update DFSClient and DataXceiver to handle different checkum types in file checksum computation. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376928 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 14:15:14 +00:00
Eli Collins
c10a73350e Revert HDFS-3837. Fix DataNode.recoverBlock findbugs warning. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376701 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 21:08:19 +00:00
Eli Collins
6885d03501 HDFS-3715. Fix TestFileCreation#testFileCreationNamenodeRestart. Contributed by Andrew Whang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376689 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 20:49:55 +00:00
Aaron Myers
de8b34a70e HDFS-3835. Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376188 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 18:47:07 +00:00
Jitendra Nath Pandey
901b1739c6 HDFS-3819. Should check whether invalidate work percentage default value is not greater than 1.0f. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376185 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 18:44:44 +00:00
Suresh Srinivas
30bd8ef9d1 Moving HDFS-2686 and HDFS-3832 to branch-2 section in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376142 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 17:04:08 +00:00
Suresh Srinivas
380870d544 HDFS-3832. Remove protocol methods related to DistributedUpgrade. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376139 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 16:59:50 +00:00
Eli Collins
89e16be81b HDFS-3837. Fix DataNode.recoverBlock findbugs warning. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376129 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 16:26:50 +00:00
Eli Collins
2b030c6a4a HDFS-3830. test_libhdfs_threaded: use forceNewInstance. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376121 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 16:19:27 +00:00
Suresh Srinivas
a99cfe3ca0 HDFS-3817. Avoid printing SafeModeException stack trace in RPC server. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376054 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 13:59:40 +00:00
Suresh Srinivas
557b937f47 HDFS-3827. TestHASafeMode#assertSafemode method should be made static. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375828 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 22:25:49 +00:00
Suresh Srinivas
6c0ccb5989 HDFS-2686. Remove DistributedUpgrade related code. Contributed by Suresh Srinivas 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375800 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 21:18:40 +00:00
Eli Collins
a6262430ff HDFS-2727. libhdfs should get the default block size from the server. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375383 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 03:48:00 +00:00
Eli Collins
97bb7b180e HDFS-3707. TestFSInputChecker: improper use of skip. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375336 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 00:00:33 +00:00
Suresh Srinivas
086c855198 HDFS-3816. Invalidate work percentage default value should be 0.32f. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374645 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-18 19:50:15 +00:00
Aaron Myers
fccace6116 HDFS-3672. Expose disk-location information for blocks to enable better scheduling. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374355 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 16:52:07 +00:00
Tsz-wo Sze
ffbadbdd36 HDFS-2421. Improve the concurrency of SerialNumberMap in NameNode. Contributed by Jing Zhao and Weiyan Wang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374127 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 01:54:16 +00:00
Tsz-wo Sze
87d87b04e6 HDFS-3788. ByteRangeInputStream should not expect HTTP Content-Length header when chunked transfer-encoding is used. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374122 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 01:42:35 +00:00
Aaron Myers
bbe4584ebf HDFS-3808. fuse_dfs: postpone libhdfs intialization until after fork. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374106 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 23:47:33 +00:00
Eli Collins
cf93dfba4e HDFS-2963. Console Output is confusing while executing metasave (dfsadmin command). Contributed by Andrew Wang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374040 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 20:35:50 +00:00
Eli Collins
4524655afd HDFS-3194. DataNode block scanner is running too frequently. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373928 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 17:13:13 +00:00
Eli Collins
f75deca0f9 HDFS-3048. Small race in BlockManager#close. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373664 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 22:43:01 +00:00
Todd Lipcon
89153a9c68 HDFS-3796. Speed up edit log tests by avoiding fsync(). Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373567 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 18:53:13 +00:00
Tsz-wo Sze
9dff7876d9 HDFS-3802. StartupOption.name in HdfsServerConstants should be final. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373253 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 08:07:29 +00:00
Tsz-wo Sze
f41497c141 HDFS-3794. WebHDFS OPEN returns the incorrect Content-Length in the HTTP header when offset is specified and length is omitted. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373193 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 02:23:21 +00:00
Suresh Srinivas
6c96039693 HDFS-3803. Change BlockPoolSliceScanner chatty INFO log to DEBUG. Contributed by Andrew Purtell 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373174 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:33:53 +00:00
Suresh Srinivas
28e87740c5 HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373173 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:28:41 +00:00
Suresh Srinivas
231a52a7df Reverting previous incomplete change r1373170 for HDFS-3723 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373172 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:25:07 +00:00
Suresh Srinivas
f026d8bb1b HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373170 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:03:19 +00:00
Eli Collins
f98d8eb291 HDFS-3150. Add option for clients to contact DNs via hostname. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373094 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 20:59:54 +00:00
Daryn Sharp
f46b6ea55c HDFS-3718. Datanode won't shutdown because of runaway DataBlockScanner thread (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373090 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 20:56:49 +00:00
Todd Lipcon
b38bd555e8 HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373061 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 20:11:40 +00:00
Tsz-wo Sze
0c27c77080 HDFS-3658. Fix bugs in TestDFSClientRetries and add more tests. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372707 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 03:02:43 +00:00
Todd Lipcon
ab3ab17a43 HDFS-3792. Fix two findbugs introduced by HDFS-3695. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372690 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 00:52:10 +00:00
Aaron Myers
4139298b61 HDFS-3790. test_fuse_dfs.c doesn't compile on centos 5. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372676 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 00:04:55 +00:00
Todd Lipcon
c93185df66 HDFS-3276. initializeSharedEdits should have a -nonInteractive flag. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372628 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 21:26:39 +00:00
Todd Lipcon
c9ed8342f5 Move HDFS-2330 and HDFS-3190 to branch-2 section, since they have been backported from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372605 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 20:52:17 +00:00
Todd Lipcon
7aacfd5a08 HDFS-3789. JournalManager#format() should be able to throw IOException. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372566 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 19:36:31 +00:00
Aaron Myers
bbe0e823db Revert HDFS-3719. See discussion there and HDFS-3770 for more info. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372544 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 18:42:51 +00:00
Eli Collins
bcb715459c HDFS-3758. TestFuseDFS test failing. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371555 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-10 03:42:36 +00:00
Todd Lipcon
9d0f8792a9 HDFS-3695. Genericize format() to non-file JournalManagers. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371513 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 22:13:54 +00:00
Aaron Myers
9ea7c06468 HDFS-3721. hsync support broke wire compatibility. Contributed by Todd Lipcon and Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371495 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 21:31:12 +00:00
Aaron Myers
fb970f3df7 HDFS-3634. Add self-contained, mavenized fuse_dfs test. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371231 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 14:44:05 +00:00
Jakob Homan
ac31ae6a79 HDFS-3768. Exception in TestJettyHelper is incorrect. Contributed by Eli Reisman. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370952 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 20:34:03 +00:00
Todd Lipcon
6dcf2e4815 HDFS-3755. Creating an already-open-for-write file with overwrite=true fails. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370937 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 20:15:40 +00:00
Aaron Myers
b587af4631 HDFS-3710. libhdfs misuses O_RDONLY/WRONLY/RDWR. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370898 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 19:11:30 +00:00
Aaron Myers
34554d1e11 HDFS-3760. primitiveCreate is a write, not a read. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370649 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 02:53:56 +00:00
Eli Collins
c12e994eda HDFS-3754. BlockSender doesn't shutdown ReadaheadPool threads. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370495 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 20:17:59 +00:00
Alejandro Abdelnur
754fd7b2fb HDFS-3291. add test that covers HttpFS working w/ a non-HDFS Hadoop filesystem (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370387 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 17:43:32 +00:00
Aaron Myers
9b4a7900c7 HDFS-3637. Add support for encrypting the DataTransferProtocol. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370354 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 16:40:03 +00:00
Aaron Myers
f7b37c009b HDFS-3579. libhdfs: fix exception handling. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370015 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-06 21:02:30 +00:00
Aaron Myers
294b514596 HDFS-3719. Re-enable append-related tests in TestFileConcurrentReader. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369848 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-06 13:59:00 +00:00
Alejandro Abdelnur
42d071ab6f HDFS-3756. DelegationTokenFetcher creates 2 HTTP connections, the second one not properly configured. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368733 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-02 22:10:51 +00:00
Alejandro Abdelnur
fe17d871d0 HDFS-3513. HttpFS should cache filesystems. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368304 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 23:09:19 +00:00
Aaron Myers
8ea7112595 HDFS-3738. TestDFSClientRetries#testFailuresArePerOperation sets incorrect timeout config. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367844 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 02:16:57 +00:00
Tsz-wo Sze
cb787968c5 HDFS-3667. Add retry support to WebHdfsFileSystem. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367841 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 01:41:23 +00:00
Tsz-wo Sze
556be2af92 svn merge -c -1366601 for reverting HDFS-3667. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367407 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 04:33:59 +00:00
Aaron Myers
aeade62b95 HDFS-3732. fuse_dfs: incorrect configuration value checked for connection expiry timer period. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367199 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 18:07:07 +00:00
Tsz-wo Sze
e4eec269d9 HDFS-3667. Add retry support to WebHdfsFileSystem. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366601 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-28 05:57:47 +00:00
Suresh Srinivas
0c4e670eff HDFS-3679. fuse_dfs notrash option sets usetrash. Contributed by Conrad Meyer. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366545 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-27 21:51:07 +00:00
Daryn Sharp
cbd59c1c50 HDFS-3553. Hftp proxy tokens are broken (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366471 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-27 18:02:56 +00:00
Aaron Myers
c1ea9b4490 HDFS-3650. Use MutableQuantiles to provide latency histograms for various operations. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366246 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-27 00:26:21 +00:00
Alejandro Abdelnur
4d4560189a HDFS-3113. httpfs does not support delegation tokens. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365988 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-26 13:39:05 +00:00
Tsz-wo Sze
8f395c2f78 HDFS-3696. Set chunked streaming mode in WebHdfsFileSystem write operations to get around a Java library bug causing OutOfMemoryError. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365839 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 23:37:25 +00:00
Todd Lipcon
972953bd77 HDFS-3626. Creating file with invalid path can corrupt edit log. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365801 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 21:52:38 +00:00
Aaron Myers
56b0912b6c HDFS-3720. hdfs.h must get packaged. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365759 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 21:21:14 +00:00
Aaron Myers
d8f3913856 HDFS-3711. Manually convert remaining tests to JUnit4. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365119 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-24 15:19:08 +00:00
Eli Collins
1fd21078d8 HDFS-3709. TestStartup tests still binding to the ephemeral port. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364865 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-24 01:53:29 +00:00
Todd Lipcon
b7b8db51de HDFS-3697. Enable fadvise readahead by default. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364698 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-23 16:27:59 +00:00
Aaron Myers
decd9e1c74 Move entry for HDFS-3583 in CHANGES.txt to be under branch-2. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363949 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-20 20:46:25 +00:00
Aaron Myers
02a5551ba3 HDFS-3608. fuse_dfs: detect changes in UID ticket cache. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363904 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-20 19:15:52 +00:00
Todd Lipcon
9833468302 HDFS-3597. SNN fails to start after DFS upgrade. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363899 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-20 18:58:58 +00:00
Eli Collins
6383679872 HDFS-3690. BlockPlacementPolicyDefault incorrectly casts LOG. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363576 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-19 23:04:01 +00:00
Eli Collins
5d5a83877a HDFS-1249. With fuse-dfs, chown which only has owner (or only group) argument fails with Input/output error. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363466 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-19 18:37:47 +00:00
Eli Collins
7d5d63c13e HDFS-3675. libhdfs: follow documented return codes. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363459 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-19 18:26:04 +00:00
Eli Collins
15eec42316 HDFS-3673. libhdfs: fix some compiler warnings. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363457 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-19 18:22:56 +00:00
Todd Lipcon
23b6ed973e HDFS-3605. Block mistakenly marked corrupt during edit log catchup phase of failover. Contributed by Todd Lipcon and Brahma Reddy Battula. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363175 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 23:42:13 +00:00
Daryn Sharp
0a6806ce8c HDFS-3646. LeaseRenewer can hold reference to inactive DFSClient instances forever (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363170 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 23:21:30 +00:00
Tsz-wo Sze
6e56376023 HDFS-3577. In DatanodeWebHdfsMethods, use MessageBodyWriter instead of StreamingOutput, otherwise, it will fail to transfer large files. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362976 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 15:12:47 +00:00
Eli Collins
d61c5bcb0b Revert HDFS-3639. JspHelper#getUGI should always verify the token if security is enabled. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362760 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 05:11:01 +00:00
Eli Collins
6981b14003 Revert HDFS-3654. TestJspHelper#testGetUgi fails with NPE. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362759 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 05:05:50 +00:00
Aaron Myers
e2253b539e HDFS-3583. Convert remaining tests to Junit4. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362753 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 03:46:28 +00:00
Eli Collins
527933f4f3 HDFS-3666. Plumb more exception messages to terminate. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362270 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 21:26:58 +00:00
Todd Lipcon
6df36b58e1 HDFS-3625. Fix TestBackupNode by properly initializing edit log during startup. Contributed by Junping Du. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362189 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 18:54:46 +00:00
Eli Collins
572823c82c HDFS-3665. Add a test for renaming across file systems via a symlink. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362177 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 18:29:25 +00:00
Eli Collins
69f7a329ba HDFS-3537. Move libhdfs and fuse-dfs source to native subdirectories. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362119 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 16:42:53 +00:00
Harsh J
0e8e499ff4 HDFS-3659. Add missing @Override to methods across the hadoop-hdfs project. Contributed by Brandon Li. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361894 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 02:58:03 +00:00
Eli Collins
64fc2cb03d HDFS-3663. MiniDFSCluster should capture the code path that led to the first ExitException. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361775 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 19:43:39 +00:00
Eli Collins
2eb39c55d6 HDFS-3610. fuse_dfs: Provide a way to use the default (configured) NN URI. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361565 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-14 17:19:01 +00:00
Eli Collins
32d4c148df HDFS-3654. TestJspHelper#testGetUgi fails with NPE. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361463 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-14 01:07:57 +00:00
Eli Collins
f5dd4583bb HDFS-3539. libhdfs code cleanups. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361459 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-14 00:47:43 +00:00
Eli Collins
cfd692b866 HDFS-3609. libhdfs: don't force the URI to look like hdfs://hostname:port. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361454 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-14 00:34:28 +00:00
Eli Collins
06d635cd2c HDFS-3492. fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361449 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-14 00:18:56 +00:00
Eli Collins
8c2a2f909c HDFS-470. libhdfs should handle 0-length reads from FSInputStream correctly. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361446 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-14 00:03:58 +00:00
Eli Collins
dcf0ac7a8a HDFS-3606. libhdfs: create self-contained unit test. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361440 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 23:28:03 +00:00
Harsh J
d9911e923d HDFS-3612. Single namenode image directory config warning can be improved. Contributed by Andy Isaacson. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361059 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 07:20:27 +00:00
Eli Collins
bfa51a33d0 HDFS-3306. fuse_dfs: don't lock release operations. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361021 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 00:44:27 +00:00
Eli Collins
0f3ba4870b HDFS-799. libhdfs must call DetachCurrentThread when a thread is destroyed. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361008 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 00:10:04 +00:00
Eli Collins
e2318c2895 HDFS-3633. libhdfs: hdfsDelete should pass JNI_FALSE or JNI_TRUE. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361005 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 23:52:48 +00:00
Sanjay Radia
6a59f08a15 HDFS-3630 Modify TestPersistBlocks to use both flush and hflush (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360991 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 22:46:53 +00:00
Eli Collins
4a5ba3b7bd HDFS-3641. Move server Util time methods to common and use now instead of System#currentTimeMillis. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360858 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 19:01:49 +00:00
Eli Collins
8ced7381a4 HDFS-3639. JspHelper#getUGI should always verify the token if security is enabled. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360485 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 00:12:15 +00:00
Eli Collins
cdae6953e8 HDFS-3582. Hook daemon process exit for testing. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360329 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 17:58:02 +00:00
Aaron Myers
664ca6b75e HDFS-3615. Two BlockTokenSecretManager findbugs warnings. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360255 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 16:09:18 +00:00
Harsh J
2c27b5826d HDFS-3611. NameNode prints unnecessary WARNs about edit log normally skipping a few bytes. Contributed by Colin Patrick McCabe. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360001 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 03:37:07 +00:00
Harsh J
c81aed0271 HDFS-3613. GSet prints some INFO level values, which aren't really very useful to all. Contributed by Andrew Wang. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359999 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 03:15:03 +00:00
Harsh J
3b5ea87502 HDFS-3629. Fix the typo in the error message about inconsistent storage layout version. Contributed by Brandon Li. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359905 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 21:14:27 +00:00
Aaron Myers
fb4a6ac9e9 HDFS-3568. fuse_dfs: add support for security. Contributed by Colin McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359824 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 18:28:13 +00:00
Harsh J
e0f96aa249 HDFS-3555. idle client socket triggers DN ERROR log (should be INFO or DEBUG). Contributed by Andy Isaacson. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359619 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 11:52:13 +00:00
Aaron Myers
b6a9d38c09 Move CHANGES.txt entry for HDFS-3067 to branch-2 instead of trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359331 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 18:34:36 +00:00
Eli Collins
9facccfd28 Update CHANGES.txt for 2391 merge. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358849 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-08 22:06:03 +00:00
Eli Collins
5952c7bb62 HDFS-3614. Revert unused MiniDFSCluster constructor from HDFS-3049. Contributed by Arun Murthy 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358825 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-08 19:53:14 +00:00
Eli Collins
21fdf16b0d HDFS-3548. NamenodeFsck.copyBlock fails to create a Block Reader. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358822 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-08 19:41:55 +00:00
Uma Maheswara Rao G
07295260b1 HDFS-3482. hdfs balancer throws ArrayIndexOutOfBoundsException if option is specified without values. Contributed by Madhukara Phatak. 
Submitted by:	Madhukara Phatak.
Reviewed by:	Uma Maheswara Rao G.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358812 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-08 18:39:09 +00:00
Eli Collins
52f5c70330 HDFS-711. hdfsUtime does not handle atime = 0 or mtime = 0 correctly. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358810 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-08 18:29:00 +00:00
Eli Collins
9bebba6605 Fixup CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358805 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-08 18:18:55 +00:00
Eli Collins
6dcf42262d HDFS-3603. Decouple TestHDFSTrash from TestTrash. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358804 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-08 18:15:30 +00:00
Uma Maheswara Rao G
d4fb882163 HDFS-3541. Deadlock between recovery, xceiver and packet responder. Contributed by Vinay. 
Submitted by:	Vinay
Reviewed by:	Uma Maheswara Rao G


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358794 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-08 17:42:19 +00:00
Harsh J
e5b00f1bdc HDFS-2988. Improve error message when storage directory lock fails. Contributed by Miomir Boljanovic. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358683 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-08 00:36:38 +00:00
Eli Collins
535b039581 HDFS-3604. Add dfs.webhdfs.enabled to hdfs-default.xml. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358659 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-07 22:35:14 +00:00
Todd Lipcon
e0ef844280 HDFS-3170. Add more useful metrics for write latency. Contributed by Matthew Jacobs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357970 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-05 22:18:30 +00:00
Tsz-wo Sze
4d0cab2729 HDFS-3601. Add BlockPlacementPolicyWithNodeGroup to support block placement with 4-layer network topology. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357442 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-05 01:31:57 +00:00
Eli Collins
359b4efd19 HDFS-3581. FSPermissionChecker#checkPermission sticky bit check missing range check. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356971 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-03 21:43:25 +00:00
Todd Lipcon
3728d16160 HDFS-3574. Fix small race and do some cleanup in GetImageServlet. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356939 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-03 20:55:29 +00:00
Todd Lipcon
b8389e4c73 HDFS-3343. Improve metrics for DN read latency. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356928 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-03 20:45:21 +00:00
Todd Lipcon
8dd3148e73 HDFS-3190. Simple refactors in existing NN code to assist QuorumJournalManager extension. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356525 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-02 23:59:41 +00:00
Todd Lipcon
7accbabdee HDFS-3573. Supply NamespaceInfo when instantiating JournalManagers. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356388 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-02 18:21:49 +00:00
Alejandro Abdelnur
2b2344a57e HDFS-3575. HttpFS does not log Exception Stacktraces (brocknoland via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356330 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-02 16:41:33 +00:00
Tsz-wo Sze
28e8151ad3 HDFS-3157. Fix a bug in the case that the generation stamps of the stored block in a namenode and the reported block from a datanode do not match. Contributed by Ashish Singhi 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356086 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-02 07:26:03 +00:00
Alejandro Abdelnur
5a8ea48c37 HDFS-3580. incompatible types; no instance(s) of type variable(s) V exist so that V conforms to boolean compiling HttpFSServer.java with OpenJDK (adi2 via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355593 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-29 22:58:32 +00:00
Todd Lipcon
802f885a55 HDFS-3446. HostsFileReader silently ignores bad includes/excludes. Contributed by Matthew Jacobs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355584 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-29 22:24:29 +00:00
Alejandro Abdelnur
34605c9594 HDS-3491. HttpFs does not set permissions correctly (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355556 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-29 20:59:11 +00:00
Suresh Srinivas
d8198d9273 Fixed CHANGES.txt name typo 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355190 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 23:01:00 +00:00
Suresh Srinivas
19dd66a3f6 HDFS-3510. Editlog pre-allocation is performed prior to writing edits to avoid partial edits case disk out of space. Contributed by Collin McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355189 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 23:00:10 +00:00
Todd Lipcon
1d54e2b331 HDFS-3571. Allow EditLogFileInputStream to read from a remote URL. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355174 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 21:46:12 +00:00
Aaron Myers
9255cb83c8 HDFS-3559. DFSTestUtil: use Builder class to construct DFSTestUtil instances. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355141 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 20:04:49 +00:00
Eli Collins
550853203b HDFS-3475. Make the replication monitor multipliers configurable. Contributed by Harsh J Chouraria 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355089 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 17:54:52 +00:00
Tsz-wo Sze
f105784d6a svn merge -c -1354790 for reverting HDFS-3576 since it requires more changes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354792 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 01:25:32 +00:00
Tsz-wo Sze
44389399d4 HDFS-3576. Move the definition of the constant NameNode.DEFAULT_PORT to DFSConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354790 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 01:11:22 +00:00
Todd Lipcon
5770a453f3 HDFS-3572. Cleanup code which inits SPNEGO in HttpServer. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354767 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-27 22:41:41 +00:00
Alejandro Abdelnur
c03f1dcf30 Re-amendment to previous commit JIRA was HDFS-3481 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354611 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-27 16:20:47 +00:00
Alejandro Abdelnur
38f8b0aee5 Amendment to previous commit, correct JIRA is HDFS-3113 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354602 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-27 16:09:48 +00:00
Alejandro Abdelnur
d263653ae2 HDFS-3481. Refactor HttpFS handling of JAX-RS query string parameters (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354599 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-27 16:06:37 +00:00
Tsz-wo Sze
bf1649d5fd HDFS-3551. WebHDFS CREATE should use client location for HTTP redirection. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354316 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-27 02:51:39 +00:00
Eli Collins
0270889b4e HDFS-3535. Audit logging should log denied accesses. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354144 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-26 18:14:09 +00:00
Tsz-wo Sze
bbab35e6d8 HDFS-3498. Support replica removal in BlockPlacementPolicy and make BlockPlacementPolicyDefault extensible for reusing code in subclasses. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353807 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-26 03:25:47 +00:00
Tsz-wo Sze
361ea9a62c HDFS-3516. Check content-type in WebHdfsFileSystem. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353800 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-26 01:58:13 +00:00
Daryn Sharp
60f4f25afa HDFS-3549. Fix dist tar build fails in hadoop-hdfs-raid project. (Jason Lowe via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353695 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-25 18:26:29 +00:00
Daryn Sharp
4b88923e19 HDFS-3550. Fix raid javadoc warnings. (Jason Lowe via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353592 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-25 15:28:09 +00:00
Tsz-wo Sze
5572f73d45 HDFS-3518. Add a utility method HdfsUtils.isHealthy(uri) for checking if the given HDFS is healthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350825 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-15 23:00:36 +00:00
Uma Maheswara Rao G
7a5c2e8790 Updated CHANGES.txt for HDFS-3408(BKJM : Namenode format fails, if there is no BK root) And HDFS-3389(Document the BKJM usage in Namenode HA) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350733 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-15 18:35:58 +00:00
Tsz-wo Sze
9d2b1b2ee8 HDFS-3524. Update TestFileLengthOnClusterRestart for HDFS-3522. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350384 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-14 20:17:54 +00:00
Eli Collins
29d39bcc7b HDFS-3480. Multiple SLF4J binding warning. Contributed by Vinay 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349643 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-13 05:53:24 +00:00
Aaron Myers
9cabf93e7a HDFS-766. Error message not clear for set space quota out of boundary values. Contributed by Jon Zuanich. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349639 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-13 05:29:57 +00:00
Eli Collins
fda95a6a3d HDFS-3478. Test quotas with Long.Max_Value. Contributed by Sujay Rau 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349634 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-13 05:04:20 +00:00
Eli Collins
6702d5dbd4 HDFS-3372. offlineEditsViewer should be able to read a binary edits file with recovery mode. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349628 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-13 03:31:47 +00:00
Eli Collins
07b8584431 HDFS-3531. EditLogFileOutputStream#preallocate should check for incomplete writes. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349616 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-13 02:42:52 +00:00
Alejandro Abdelnur
c83ccc5002 Amendment to my previous commit, fixing JIRA in CHANGES.txt from HDFS-3228 to HDFS-3428 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349556 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 22:02:56 +00:00
Alejandro Abdelnur
4d4661802e HDFS-3228. Move DelegationTokenRenewer to common (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349555 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 21:52:46 +00:00
Tsz-wo Sze
45fafc2b8f HDFS-3504. Support configurable retry policy in DFSClient for RPC connections and RPC calls, and add MultipleLinearRandomRetry, a new retry policy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349124 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 05:27:15 +00:00
Eli Collins
8879653ab4 HDFS-3520. Add transfer rate logging to TransferFsImage. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349117 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 05:00:07 +00:00
Todd Lipcon
9947d8054c HDFS-3049. During the normal NN startup process, fall back on a different edit log if we see one that is corrupt. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349114 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 04:15:18 +00:00
Tsz-wo Sze
543f86631b HDFS-3522. If a namenode is in safemode, it should throw SafeModeException when getBlockLocations has zero locations. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349088 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 01:55:51 +00:00
Eli Collins
9e7334a8fe HDFS-3517. TestStartup should bind ephemeral ports. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349004 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-11 20:52:45 +00:00
Tsz-wo Sze
ca39e780c4 HDFS-3052. Change INodeFile and INodeFileUnderConstruction to package private. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348998 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-11 20:38:46 +00:00
Eli Collins
56d2ef6f5e HDFS-2797. Fix misuses of InputStream#skip in the edit log code. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348945 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-11 18:01:38 +00:00
Tsz-wo Sze
5991ed9cbd HDFS-3490. DatanodeWebHdfsMethods throws NullPointerException if NamenodeRpcAddressParam is not set. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348287 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-09 00:54:10 +00:00
Todd Lipcon
51d889e369 Move several JIRAs from trunk to branch-2 section of CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348258 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-08 21:48:16 +00:00
Aaron Myers
bc367be4ef HDFS-3514. Add missing TestParallelLocalRead. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348207 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-08 19:50:24 +00:00
Aaron Myers
b98e26af58 HDFS-2914. HA: Standby should not enter safemode when resources are low. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347895 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-08 06:57:52 +00:00
Aaron Myers
072ae08a00 HDFS-3040. TestMulitipleNNDataBlockScanner is misspelled. Contributed by Madhukara Phatak. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347891 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-08 06:38:14 +00:00
Todd Lipcon
0b3af2a66b Move HDFS-3042 (automatic failover) to branch-2 section of CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347809 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-07 21:35:30 +00:00
Todd Lipcon
05a73a3a1e Revert HDFS-3492 from r1347192: patch broke TestShortCircuitLocalRead 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347796 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-07 21:06:13 +00:00
Todd Lipcon
6d8efb7378 HDFS-3485. DataTransferThrottler will over-throttle when currentTimeMillis jumps. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347751 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-07 18:41:24 +00:00
Todd Lipcon
bef65d0601 HDFS-3492. Fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347192 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-06 22:48:48 +00:00
Vinod Kumar Vavilapalli
9ae7639405 Fixing CHANGES.txt to refer to branch-2 instead of (an unreleased, not-yet-decided) release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347136 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-06 21:19:33 +00:00
Eli Collins
8813f42175 HDFS-3505. DirectoryScanner does not join all threads in shutdown. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347117 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-06 20:56:26 +00:00
Aaron Myers
a4b1793df0 HDFS-3266. DFSTestUtil#waitCorruptReplicas doesn't sleep between checks. Contributed by Madhukara Phatak. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346192 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-04 23:06:19 +00:00
Eli Collins
119a8c7b15 Updated CHANGES.txt files to reflect the 2.0.0-alpha release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346150 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-04 20:53:15 +00:00
Eli Collins
8bab8b7752 HDFS-3501. Checkpointing with security enabled will stop working after ticket lifetime expires. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346106 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-04 19:37:56 +00:00
Aaron Myers
d1207cbd88 HDFS-3442. Incorrect count for Missing Replicas in FSCK report. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345408 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-02 00:39:34 +00:00
Todd Lipcon
f65f528356 Merge back changelog entries for HDFS-3042 into main CHANGES.txt files 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345307 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-01 18:20:03 +00:00
Eli Collins
f343419055 HDFS-3487. offlineimageviewer should give byte offset information when it encounters an exception. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344972 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-01 02:37:09 +00:00
Eli Collins
4eb6d65eef HDFS-3486. offlineimageviewer can't read fsimage files that contain persistent delegation tokens. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344970 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-01 02:31:29 +00:00
Eli Collins
675a7e4acb HDFS-3484. hdfs fsck doesn't work if NN HTTP address is set to 0.0.0.0 even if NN RPC address is configured. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344908 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-31 21:02:08 +00:00
Tsz-wo Sze
83cf475050 HDFS-744. Support hsync in HDFS. Contributed by Lars Hofhans 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344419 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-30 19:10:09 +00:00
Harsh J
f2c3d3ac52 HDFS-3476. Correct the default used in TestDFSClientRetries.busyTest() after HDFS-3462. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344394 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-30 18:33:41 +00:00
Harsh J
5cf21e4383 HDFS-3462. TestDFSClientRetries.busyTest() should restore default xceiver count in the config. Contributed by Madhukara Phatak. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343798 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-29 16:01:44 +00:00
Harsh J
befd45fcb1 HDFS-2391. Newly set BalancerBandwidth value is not displayed anywhere. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342520 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 07:04:35 +00:00
Konstantin Shvachko
2e0a15c488 HDFS-3368. Missing blocks due to bad DataNodes coming up and down. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342512 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 06:29:17 +00:00
Alejandro Abdelnur
e937068c0b HDFS-3460. HttpFS proxyuser validation with Kerberos ON uses full principal name. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342334 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-24 16:51:04 +00:00
Todd Lipcon
14bf2d4357 HDFS-1013. Miscellaneous improvements to HTML markup for web UIs. Contributed by Eugene Koontz. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342102 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-24 00:27:51 +00:00
Todd Lipcon
74dfa8f1f2 HDFS-2982. Startup performance suffers when there are many edit log segments. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342042 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 20:42:48 +00:00
Tsz-wo Sze
ade42bce10 HDFS-3436. In DataNode.transferReplicaForPipelineRecovery(..), it should use the stored generation stamp to check if the block is valid. Contributed by Vinay 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341961 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 17:59:30 +00:00
Eli Collins
445018cea8 HDFS-3454. Balancer unconditionally logs InterruptedException at INFO level on shutdown if security is enabled. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341916 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 15:56:59 +00:00
Tsz-wo Sze
aa80e6895d HDFS-3415. Make sure all layout versions are the same for all storage directories in the Namenode. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341676 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-22 23:18:04 +00:00
Tsz-wo Sze
d69510a7f8 HDFS-3394. Do not use generic in INodeFile.getLastBlock(): the run-time ClassCastException check is useless since generic type information is only available in compile-time. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341141 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-21 18:51:15 +00:00
Eli Collins
260dfa367e HDFS-2885. Remove "federation" from the nameservice config options. Contributed by Tsz Wo (Nicholas), SZE 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340841 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-20 21:13:17 +00:00
Todd Lipcon
d1a54b872d HDFS-3438. BootstrapStandby should not require a rollEdits on active node. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340343 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-19 05:13:38 +00:00
Aaron Myers
ea0baa3609 HDFS-3444. hdfs groups command doesn't work with security enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340260 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-18 21:25:21 +00:00
Todd Lipcon
7d1f97b821 HDFS-3440. More effectively limit stream memory consumption when reading corrupt edit logs. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339978 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-18 05:28:18 +00:00
Todd Lipcon
5258d6bf3f HDFS-3391. Fix InvalidateBlocks to compare blocks including their generation stamps. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339897 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 22:30:46 +00:00
Todd Lipcon
15ddb6634f HDFS-2800. Fix cancellation of checkpoints in the standby node to be more reliable. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339745 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 17:49:48 +00:00
Eli Collins
5ef725eb53 HDFS-3434. InvalidProtocolBufferException when visiting DN browseDirectory.jsp. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339712 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 17:01:13 +00:00
Eli Collins
6d71407582 HDFS-1153. dfsnodelist.jsp should handle invalid input parameters. Contributed by Ravi Phulari 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339706 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 16:55:49 +00:00
Aaron Myers
1377709b4c HDFS-3433. GetImageServlet should allow administrative requestors when security is enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339540 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 10:23:18 +00:00
Todd Lipcon
ba1e4a823a HDFS-3422. TestStandbyIsHot timeouts too aggressive. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339452 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 02:45:47 +00:00
Eli Collins
97e1d5c9ad HDFS-860. fuse-dfs truncate behavior causes issues with scp. Contributed by Brian Bockelman 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339413 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-16 22:57:18 +00:00
Aaron Myers
7286e8a9da HDFS-3413. TestFailureToReadEdits timing out. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339250 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-16 16:24:38 +00:00
Todd Lipcon
9142dcac9e Move changes from 2.0.0-alpha to 2.0.1-alpha in CHANGES.txt for those that did not make rc1 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339019 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-16 05:48:16 +00:00
Eli Collins
dac828de0f HDFS-3197. Incorrect class comments in a few tests. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338880 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 20:37:12 +00:00
Eli Collins
7428aeca86 HDFS-3418. Rename BlockWithLocationsProto datanodeIDs field to storageIDs. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338830 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 19:03:14 +00:00
Eli Collins
c4e4e56160 HDFS-3419. Cleanup LocatedBlock. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338802 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 17:23:50 +00:00
Eli Collins
e9a7648f62 HDFS-3416. Cleanup DatanodeID and DatanodeRegistration constructors used by testing. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338784 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 16:23:52 +00:00
Eli Collins
e4df14f8f1 HDFS-3417. Rename BalancerDatanode#getName to getDisplayName to be consistent with Datanode. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338767 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 16:01:44 +00:00
Todd Lipcon
95710c15b7 HDFS-3335. check for edit log corruption at the end of the log. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338492 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 00:41:37 +00:00
Todd Lipcon
2a406d0437 Move HDFS-2759 to branch-2 section of CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338490 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 00:32:11 +00:00
Aaron Myers
a8eef98f41 HDFS-3163. TestHDFSCLI.testAll fails if the user name is not all lowercase. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338486 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 00:14:51 +00:00
Todd Lipcon
bcdb125643 HDFS-3031. Fix complete() and getAdditionalBlock() RPCs to be idempotent. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338466 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-14 22:35:25 +00:00
Aaron Myers
05c5fcfb42 HDFS-3414. Balancer does not find NameNode if rpc-address or servicerpc-address are not set in client configs. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338275 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-14 16:25:17 +00:00
Harsh J
f1560d379d HDFS-2312. FSNamesystem javadoc incorrectly says its for DNs. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337761 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-13 03:33:19 +00:00
Aaron Myers
f22341ab1a HDFS-3404. Make putImage in GetImageServlet infer remote address to fetch from request. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337755 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-13 02:51:33 +00:00
Tsz-wo Sze
3d18382285 Move HDFS-3211 to 2.0.0 in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337432 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-12 01:57:50 +00:00
Aaron Myers
5dbd09ee76 HDFS-3026. HA: Handle failure during HA state transition. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337030 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 05:57:37 +00:00
Eli Collins
8def56e51e HDFS-3400. DNs should be able start with jsvc even if security is disabled. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337017 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 03:15:54 +00:00
Tsz-wo Sze
ba6360e493 HDFS-3385. The last block of INodeFileUnderConstruction is not necessarily a BlockInfoUnderConstruction, so do not cast it in FSNamesystem.recoverLeaseInternal(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336976 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 00:25:48 +00:00
Eli Collins
fcb4b1995b HDFS-3401. Cleanup DatanodeDescriptor creation in the tests. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336972 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 00:03:37 +00:00
Eli Collins
98b00d7cc0 HDFS-3134. harden edit log loader against malformed or malicious input. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336943 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 23:13:02 +00:00
Tsz-wo Sze
7e8e983620 HDFS-3369. Rename {get|set|add}INode(..) methods in BlockManager and BlocksMap to {get|set|add}BlockCollection(..). Contributed by John George 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336909 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 21:41:25 +00:00
Eli Collins
6a0865440e HDFS-3230. Cleanup DatanodeID creation in the tests. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336815 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 17:58:55 +00:00
Aaron Myers
f5960f71d9 HDFS-3395. NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336690 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 13:49:06 +00:00
Eli Collins
54303465a6 HDFS-3396. FUSE build fails on Ubuntu 12.04. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336495 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 06:28:56 +00:00
Eli Collins
a67054d7c3 HDFS-3328. NPE in DataNode.getIpcPort. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336480 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 04:52:46 +00:00
Todd Lipcon
b75f0187c8 HDFS-3341, HADOOP-8340. SNAPSHOT build versions should compare as less than their eventual release. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336459 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 00:30:53 +00:00
Aaron Myers
e3fbc52686 HDFS-3390. DFSAdmin should print full stack traces of errors when DEBUG logging is enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336324 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-09 18:16:40 +00:00
Eli Collins
1d7b980592 HDFS-3378. Remove DFS_NAMENODE_SECONDARY_HTTPS_PORT_KEY and DEFAULT. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335309 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-08 00:25:34 +00:00
Tsz-wo Sze
f0f9a3631f HDFS-3363. Define BlockCollection and MutableBlockCollection interfaces so that INodeFile and INodeFileUnderConstruction do not have to be used in block management. Contributed by John George 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335304 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-08 00:06:09 +00:00
Todd Lipcon
7aa2889f82 HDFS-3375. Put client name in DataXceiver thread name for readBlock and keepalive. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335270 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-07 21:34:30 +00:00
Todd Lipcon
567aed4f2c HDFS-3365. Enable users to disable socket caching in DFS client configuration. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335222 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-07 19:56:23 +00:00
Todd Lipcon
eca2c850a5 HDFS-3376. DFSClient fails to make connection to DN if there are many unusable cached sockets. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335115 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-07 16:42:19 +00:00
Eli Collins
a2eb525ce1 Move HDFS-2617 commit message to the right place. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334223 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 22:01:57 +00:00
Eli Collins
5dbbe0e0a5 HDFS-2617. Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution. Contributed by Jakob Homan, Alejandro Abdelnur, and Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334216 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 21:58:44 +00:00
Tsz-wo Sze
0bf8f11860 HDFS-3303. Remove Writable implementation from RemoteEditLogManifest. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334156 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 20:16:23 +00:00
Todd Lipcon
a701c792f8 HDFS-3357. DataXceiver reads from client socket with incorrect/no timeout. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334116 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 18:50:54 +00:00
Tsz-wo Sze
dd8b7ae9d8 HDFS-3350. In INode, add final to compareTo(..), equals(..) and hashCode(), and remove synchronized from updatePermissionStatus(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333679 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 23:33:44 +00:00
Todd Lipcon
25882b199b HDFS-3359. DFSClient.close should close cached sockets. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333624 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 21:13:43 +00:00
Aaron Myers
470b1197be HDFS-3351. NameNode#initializeGenericKeys should always set fs.defaultFS regardless of whether HA or Federation is enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333299 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 03:00:10 +00:00
Todd Lipcon
cbc2424290 HDFS-3330. If GetImageServlet throws an Error or RTE, response should not have HTTP "OK" status. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333286 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 01:44:22 +00:00
Alejandro Abdelnur
e1a961d1bc HDFS-3336. hdfs launcher script will be better off not special casing namenode command with regards to hadoop.security.logger (rvs via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333236 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-02 22:47:04 +00:00
Tsz-wo Sze
8620a99d1e HDFS-3339. Change INode to package private. Contributed by John George 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332876 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-01 23:02:53 +00:00
Tsz-wo Sze
2af70cb517 HDFS-3293. Add toString(), equals(..) and hashCode() to JournalInfo. Contributed by Hari Mankude 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332458 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-30 22:57:22 +00:00
Matthew Foley
c203c7628c HDFS-3265. PowerPc Build error. Contributed by Kumar Ravi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332107 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-30 08:27:34 +00:00
Uma Maheswara Rao G
d5edc04635 HDFS-2743. Streamline usage of bookkeeper journal manager. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331790 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-28 16:17:25 +00:00
Eli Collins
a22c138291 HDFS-3326. Append enabled log message uses the wrong variable. Contributed by Matthew Jacobs 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331626 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-27 23:03:45 +00:00
Tsz-wo Sze
cd271773ac HDFS-3331. In namenode, check superuser privilege for setBalancerBandwidth and acquire the write lock for finalizeUpgrade. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331598 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-27 21:17:53 +00:00
Tsz-wo Sze
920b8fac18 HDFS-3334. Fix ByteRangeInputStream stream leakage. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331570 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-27 20:13:17 +00:00
Alejandro Abdelnur
84b36cfd80 HDFS-3309. HttpFS (Hoop) chmod not supporting octal and sticky bit permissions. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331493 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-27 16:30:22 +00:00
Tsz-wo Sze
3e835c47d1 HDFS-3181. Fix a test case in TestLeaseRecovery2. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331138 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 22:44:34 +00:00
Tsz-wo Sze
1a76c82a31 HDFS-3322. Use HdfsDataInputStream and HdfsDataOutputStream in Hdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331114 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 21:50:50 +00:00
Eli Collins
2b254dad2e HDFS-3258. Test for HADOOP-8144 (pseudoSortByDistance in NetworkTopology for first rack local node). Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330613 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 00:47:16 +00:00
Tsz-wo Sze
3b773da036 HDFS-3319. Change DFSOutputStream to not to start a thread in constructors. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330535 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 20:17:20 +00:00
Tsz-wo Sze
2584779166 HDFS-3321. Fix safe mode turn off tip message. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330506 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 19:34:36 +00:00
Tsz-wo Sze
f86352c2df HDFS-3318. Use BoundedInputStream in ByteRangeInputStream, otherwise, it hangs on transfers >2 GB. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330500 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 19:24:00 +00:00
Tsz-wo Sze
8e99d9a764 Move HDFS-3282 and HDFS-3298 to 2.0.0 in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330443 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 17:57:28 +00:00
Tsz-wo Sze
ea32198db4 HDFS-3298. Add HdfsDataOutputStream as a public API. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330064 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 23:39:43 +00:00
Alejandro Abdelnur
f4711ef3ab HDFS-3314. HttpFS operation for getHomeDirectory is incorrect. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329715 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 13:46:25 +00:00
Tsz-wo Sze
93c5585d31 HDFS-3312. In HftpFileSystem, the namenode URI is non-secure but the delegation tokens have to use secure URI. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329462 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 21:27:01 +00:00
Sanjay Radia
589c68ae09 HADOOP-8285 Use ProtoBuf for RpcPayLoadHeader (sanjay radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329319 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 16:34:21 +00:00
Tsz-wo Sze
cdbe15ccdc HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328541 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-20 23:59:19 +00:00
Tsz-wo Sze
201af20406 Revert r1328482 for HDFS-3308. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328487 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-20 19:32:23 +00:00
Tsz-wo Sze
ab8f458742 HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328482 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-20 19:16:58 +00:00
Aaron Myers
49ed783a3a HDFS-3305. GetImageServlet should consider SBN a valid requestor in a secure HA setup. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328115 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 20:43:03 +00:00
Uma Maheswara Rao G
c6d3537d33 HDFS-3282. Expose getFileLength API. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327788 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 02:34:44 +00:00
Eli Collins
4550627cab HDFS-3169. TestFsck should test multiple -move operations in a row. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327776 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 01:51:13 +00:00
Eli Collins
54e61ffdc0 HDFS-3206. Miscellaneous xml cleanups for OEV. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327768 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 01:31:53 +00:00
Eli Collins
0c16ec4d6e HDFS-891. DataNode no longer needs to check for dfs.network.script. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327762 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 01:09:12 +00:00
Tsz-wo Sze
2bf8be3c72 HDFS-3292. Remove the deprecated DiskStatus, getDiskStatus(), getRawCapacity() and getRawUsed() from DistributedFileSystem. Contributed by Arpit Gupta 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327664 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 20:21:08 +00:00
Alejandro Abdelnur
8bda086d04 HDFS-3263. HttpFS should read HDFS config from Hadoop site.xml files (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327627 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 18:51:22 +00:00
Tsz-wo Sze
eeec4dc72a HDFS-3294. Fix code indentation in NamenodeWebHdfsMethods and DatanodeWebHdfsMethods. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327365 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 03:25:08 +00:00
Tsz-wo Sze
c80dbe5e09 HDFS-2652. Add support for host-based delegation tokens. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327309 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 22:21:33 +00:00
Eli Collins
1d5861a8c4 HDFS-3165. HDFS Balancer scripts are refering to wrong path of hadoop-daemon.sh. Contributed by Amith D K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326848 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 00:50:40 +00:00
Todd Lipcon
574f99bd6b HDFS-3284. bootstrapStandby fails in secure cluster. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326813 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 21:51:52 +00:00
Tsz-wo Sze
f1667dee14 HDFS-3279. Move the FSEditLog constructor with @VisibleForTesting to TestEditLog. Contributed by Arpit Gupta 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326762 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 19:31:34 +00:00
Todd Lipcon
258da66cc7 HDFS-3268. FileContext API mishandles token service and incompatible with HA. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326747 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 19:08:29 +00:00
Aaron Myers
15fe3ae61b HDFS-2708. Stats for the # of blocks per DN. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326039 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-14 01:51:03 +00:00
Tsz-wo Sze
841fdc5628 HDFS-3273. Refactor BackupImage and FSEditLog, and rename JournalListener.rollLogs(..) to startLogSegment(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326016 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 23:41:01 +00:00
Aaron Myers
d6533cc321 Move CHANGES.txt message for HDFS-2765 to be under 2.0.0 instead of trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326013 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 23:32:17 +00:00
Eli Collins
5a20d446cf HDFS-2799. Trim fs.checkpoint.dir values. Contributed by Amith D K 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325963 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 21:31:27 +00:00
Aaron Myers
4f230adc13 HDFS-3256. HDFS considers blocks under-replicated if topology script is configured with only 1 rack. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325531 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 21:28:44 +00:00
Aaron Myers
07a4367445 HDFS-3259. NameNode#initializeSharedEdits should populate shared edits dir with edit log segments. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325518 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 21:11:32 +00:00
Todd Lipcon
72406e940a HDFS-3255. HA DFS returns wrong token service. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325414 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 18:08:00 +00:00
Aaron Myers
4ea042666c HDFS-3260. TestDatanodeRegistration should set minimum DN version in addition to minimum NN version. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325119 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 05:27:03 +00:00
Aaron Myers
7f427646df HDFS-2983. Relax the build version check to permit rolling upgrades within a release. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325110 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 03:36:13 +00:00
Tsz-wo Sze
ed678e52ce HDFS-3179. Improve the exception message thrown by DataStreamer when it failed to add a datanode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324892 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 17:49:28 +00:00
Todd Lipcon
dab66bee55 HDFS-3249. Use ToolRunner.confirmPrompt in NameNode. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324564 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:28:58 +00:00
Todd Lipcon
21824d8232 HDFS-3247. Improve bootstrapStandby behavior when original NN is not active. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324558 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:16:06 +00:00
Eli Collins
e235dd3760 HDFS-2696. Fix the fuse-fds build. Contributed by Bruno Mahé 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312068 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 01:55:05 +00:00
Eli Collins
80447bd35a HDFS-3244. Remove dead writable code from hdfs/protocol. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312061 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 01:10:38 +00:00
Todd Lipcon
58228e4e7b HDFS-3243. TestParallelRead timing out on jenkins. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312029 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 22:31:18 +00:00
Todd Lipcon
7c2e10e0cd HDFS-3248. bootstrapStandby repeated twice in hdfs namenode usage message. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312028 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 22:28:25 +00:00
Todd Lipcon
3ffdb9152e HDFS-3094. add -nonInteractive and -force option to namenode -format command. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312025 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 22:22:38 +00:00
Eli Collins
926f0a5ae0 HDFS-3238. ServerCommand and friends don't need to be writables. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311774 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 15:03:17 +00:00
Todd Lipcon
df3e1a3158 HDFS-3240. Drop log level of "heartbeat: ..." in BPServiceActor to DEBUG. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311577 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 05:12:00 +00:00
Aaron Myers
53dc8546d4 HDFS-3235. MiniDFSClusterManager doesn't correctly support -format option. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311556 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 02:25:40 +00:00
Aaron Myers
9597c81f35 HDFS-3236. NameNode does not initialize generic conf keys when started with -initializeSharedEditsDir. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311554 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 02:17:17 +00:00
Todd Lipcon
91528ce9ed HDFS-3234. Accidentally left log message in GetConf after HDFS-3226. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311541 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 00:59:38 +00:00
Eli Collins
706394d039 HDFS-3004. Implement Recovery Mode. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311394 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 19:39:58 +00:00
Uma Maheswara Rao G
3ced5ea066 HDFS-3119. Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file. Contributed by Ashish Singhi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311380 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 19:11:58 +00:00
Todd Lipcon
ee5daee1b7 HDFS-3214. InterDatanodeProtocolServerSideTranslatorPB doesn't handle null response from initReplicaRecovery. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311125 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 03:22:41 +00:00
Tsz-wo Sze
74b4b45651 HDFS-3211. Add fence(..) and replace NamenodeRegistration with JournalInfo and epoch in JournalProtocol. Contributed by suresh 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310649 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 00:52:12 +00:00
Todd Lipcon
2ab67dce11 HDFS-3226. Allow GetConf tool to print arbitrary keys. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310648 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 00:15:30 +00:00
Suresh Srinivas
de3fb5c23a HDFS-3121. Add HDFS tests for HADOOP-8014 change. Contributed by John George. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310630 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 23:03:00 +00:00
Tsz-wo Sze
58e920d1a0 HDFS-2505. Add a test to verify getFileChecksum(..) with ViewFS. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310522 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 18:04:05 +00:00
Suresh Srinivas
b3ac25048c HDFS-3136. Remove SLF4J dependency as HDFS does not need it to fix unnecessary warnings. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310476 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 16:50:31 +00:00
Todd Lipcon
d166bd184d HDFS-3110. Use directRead API to reduce the number of buffer copies in libhdfs. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310185 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 06:31:10 +00:00
Eli Collins
e505b7e704 HDFS-3208. Bogus entries in hosts files are incorrectly displayed in the report. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310138 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 00:20:55 +00:00
Eli Collins
112c324151 HDFS-3210. JsonUtil#toJsonMap for for a DatanodeInfo should use "ipAddr" instead of "name". Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310135 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 00:10:54 +00:00
Suresh Srinivas
861c872541 HDFS-3204. Minor modification to JournalProtocol.proto to make it generic. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310134 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 00:08:19 +00:00
Tsz-wo Sze
80bbefafaf HDFS-3178. Add states and state handler for journal synchronization in JournalService. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310115 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 22:35:53 +00:00
Suresh Srinivas
4c908d0987 HDFS-3109. Remove hsqldf exclusions from pom.xml. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309971 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 17:42:46 +00:00
Aaron Myers
8e739ff01e HDFS-3202. NamespaceInfo PB translation drops build version. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309955 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 17:18:26 +00:00
Eli Collins
663fbd46a8 HDFS-3199. TestValidateConfigurationSettings is failing. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309641 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 03:31:03 +00:00
Eli Collins
4f6e0a5a65 HDFS-3050. rework OEV to share more code with the NameNode. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309629 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 00:02:11 +00:00
Aaron Myers
ba688e11c1 HDFS-3102. Add CLI tool to initialize the shared-edits dir. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309580 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 20:15:08 +00:00
Todd Lipcon
a7d6bdc63b HDFS-3084. FenceMethod.tryFence() and ShellCommandFencer should pass namenodeId as well as host:port. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309526 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 18:40:43 +00:00
Eli Collins
4f7f58fa8b Updated CHANGES.txt to reflect HDFS-2564 merge 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309488 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 16:40:08 +00:00
Aaron Myers
7525ee5b67 HDFS-3000. Add a public API for setting quotas. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309227 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 03:18:49 +00:00
Tsz-wo Sze
8c0366bf10 HDFS-3168. Remove unnecessary "throw IOException" and change fields to final in FSNamesystem and BlockManager. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309218 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 02:51:34 +00:00
Todd Lipcon
9972a9633d HDFS-3187. Upgrade guava to 11.0.2. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309181 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 22:30:29 +00:00
Tsz-wo Sze
e561cb9e78 HDFS-3176. Use MD5MD5CRC32FileChecksum.readFields() in JsonUtil . Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309114 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 19:44:53 +00:00
Tsz-wo Sze
0db8003e2e HDFS-3166. Add timeout to Hftp connections. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309103 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 19:26:57 +00:00
Suresh Srinivas
e449de0526 HDFS-3126. Journal stream from Namenode to BackupNode needs to have timeout. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308636 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 00:55:08 +00:00
Eli Collins
4f15b9dfed HDFS-3148. The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308617 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 23:20:34 +00:00
Eli Collins
f44ca78179 Previous commit was for HDFS-3120, fixing up CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308615 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 23:15:43 +00:00
Eli Collins
72b3f302dc HDFS-3148. The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308614 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 23:13:06 +00:00
Robert Joseph Evans
57af34b776 Preping for 0.23.3 stabilization. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308473 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 19:13:53 +00:00
Tsz-wo Sze
bc13dfb142 HDFS-3130. Move fsdataset implementation to a package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308437 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 17:38:56 +00:00
Eli Collins
be8a0d1e62 HDFS-3174. Fix assert in TestPendingDataNodeMessages. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308226 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 01:45:11 +00:00
Eli Collins
ad0c49ec31 Fixup CHANGES.txt for HDFS-3144. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308206 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 22:14:14 +00:00
Eli Collins
be7dd8333a HDFS-3144. Refactor DatanodeID#getName by use. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308205 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 22:12:12 +00:00
Eli Collins
43afa4ee51 HDFS-2995. start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configured. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308174 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 18:41:58 +00:00
Aaron Myers
a232d5c791 HDFS-3167. CLI-based driver for MiniDFSCluster. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308159 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 17:27:54 +00:00
Eli Collins
0663dbaac0 HDFS-3171. The DatanodeID "name" field is overloaded. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308014 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 03:41:41 +00:00
Eli Collins
8bd825bb6f HDFS-3164. Move DatanodeInfo#hostName to DatanodeID. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307890 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-31 19:58:51 +00:00
Eli Collins
eeb687daa7 HDFS-3172. dfs.upgrade.permission is dead code. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307888 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-31 19:56:23 +00:00
Aaron Myers
ff897e75c9 HDFS-3070. HDFS balancer doesn't ensure that hdfs-site.xml is loaded. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307841 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-31 16:20:54 +00:00
Eli Collins
a8cbf19548 HDFS-3138. Move DatanodeInfo#ipcPort to DatanodeID. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307553 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 17:50:05 +00:00
Eli Collins
c5c476ed6a Move HDFS-3137 to the right place in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307174 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 00:13:50 +00:00
Eli Collins
64641c28b5 HDFS-3137. Bump LAST_UPGRADABLE_LAYOUT_VERSION to -16. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307173 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 00:11:14 +00:00
Aaron Myers
51908783be HDFS-3142. TestHDFSCLI.testAll is failing. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307134 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 22:00:39 +00:00
Eli Collins
da58921cf5 HDFS-3066. Cap space usage of default log4j rolling policy. Contributed by Patrick Hunt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307100 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 20:51:29 +00:00
Eli Collins
e7444b2a07 HDFS-3160. httpfs should exec catalina instead of forking it. Contributed by Roman Shaposhnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306665 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 01:16:02 +00:00
Aaron Myers
17d22e6dc4 HDFS-3158. LiveNodes member of NameNodeMXBean should list non-DFS used space and capacity per DN. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306635 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 22:59:52 +00:00
Tsz-wo Sze
99a68a1423 HDFS-3155. Clean up FSDataset implemenation related code. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306582 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 20:37:34 +00:00
Eli Collins
0475795066 HDFS-3139. Minor Datanode logging improvement. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306549 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 19:33:22 +00:00
Aaron Myers
aa8cb2287f HDFS-3143. TestGetBlocks.testGetBlocks is failing. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306542 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 19:02:16 +00:00
Aaron Myers
991eddd043 Change "0.23.3" to "2.0.0" in CHANGES.txt files. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306538 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 18:55:33 +00:00
Aaron Myers
1427468a72 HDFS-3156. TestDFSHAAdmin is failing post HADOOP-8202. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306517 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 17:58:23 +00:00
Suresh Srinivas
940dac52a7 HDFS-3125. Add JournalService to enable Journal Daemon. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305726 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 04:02:03 +00:00
Aaron Myers
466908e67b HDFS-3131. Improve TestStorageRestore. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305688 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 00:13:42 +00:00
Tsz-wo Sze
525ceb99ad HDFS-2413. Add an API DistributedFileSystem.isInSafeMode() and change DistributedFileSystem to @InterfaceAudience.LimitedPrivate. Contributed by harsh 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305632 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 22:18:04 +00:00
Eli Collins
7ef57bfc81 Fix CHANGES.txt for HDFS-3129 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305631 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 22:16:11 +00:00
Tsz-wo Sze
67bdbd60cd (recommit) HDFS-3089. Move FSDatasetInterface and the related classes to a package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305603 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 21:14:12 +00:00
Tsz-wo Sze
5e38a9acea Revert 1305590 for HDFS-3089. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305598 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 21:09:14 +00:00
Tsz-wo Sze
1ebcc378af HDFS-3089. Move FSDatasetInterface and the related classes to a package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305590 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 21:01:47 +00:00
Aaron Myers
429baf606a Move CHANGES.txt entry for HDFS-2941 to the right version. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305453 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 17:11:19 +00:00
Aaron Myers
ce1a7ec975 HDFS-2941. Add an administrative command to download a copy of the fsimage from the NN. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305447 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 17:02:40 +00:00
Aaron Myers
ea868d3d8b HDFS-3116. Typo in fetchdt error message. Contributed by AOE Takashi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304996 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-25 08:45:04 +00:00
Todd Lipcon
4cb809bf04 HDFS-3132. Fix findbugs warning on HDFS trunk. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304681 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 00:21:52 +00:00
Todd Lipcon
b795c65f49 HDFS-3071. haadmin failover command does not provide enough detail when target NN is not ready to be active. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304203 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 06:29:40 +00:00
Eli Collins
4feef86372 HDFS-3044. fsck move should be non-destructive by default. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304063 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 21:11:18 +00:00
Tsz-wo Sze
0c4acdc176 HDFS-3100. In BlockSender, throw an exception when it needs to verify checksum but the meta data does not exist. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303628 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 00:10:20 +00:00
Todd Lipcon
2f820dde17 HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303485 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 18:14:09 +00:00
Todd Lipcon
f55a1c0876 HDFS-2834. Add a ByteBuffer-based read API to DFSInputStream. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303474 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 17:30:37 +00:00
Tsz-wo Sze
9e108e61fb HDFS-3086. Change Datanode not to send storage list in registration. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303318 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 09:07:33 +00:00
Aaron Myers
4ceca97606 HDFS-3083. Cannot run an MR job with HA and security enabled when second-listed NN active. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303098 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 19:00:56 +00:00
Tsz-wo Sze
6326605acb HDFS-3105. Add DatanodeStorage information to block recovery. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302683 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-19 22:09:14 +00:00
Uma Maheswara Rao G
f77b1a63ec HDFS-3091. Update the usage limitations of ReplaceDatanodeOnFailure policy in the config description for the smaller clusters. Contributed by Nicholas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302624 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-19 19:54:13 +00:00
Uma Maheswara Rao G
3573d504e4 HDFS-3111. Missing license headers in trunk. (Contributed by Uma Maheswara Rao G). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301871 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-17 06:50:36 +00:00
Tsz-wo Sze
2a0024403a HDFS-3104. Add tests for HADOOP-8175. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301665 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 17:48:33 +00:00
Tsz-wo Sze
662b1887af HDFS-3088. Move FSDatasetInterface inner classes to a package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301661 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 17:32:57 +00:00
Tsz-wo Sze
9b2a324ba5 HDFS-3098. Update and add tests for HADOOP-8173. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301295 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 00:27:40 +00:00
Tsz-wo Sze
7e5b60116e HDFS-3101. Cannot read empty file using WebHDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301287 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 00:01:23 +00:00
Todd Lipcon
49619e8997 HDFS-3062. Fix bug which prevented MR job submission from creating delegation tokens on an HA cluster. Contributed by Mingjie Lai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301285 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 00:00:29 +00:00
Aaron Myers
65425b0961 HDFS-3099. SecondaryNameNode does not properly initialize metrics system. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301222 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 21:51:23 +00:00
Aaron Myers
6d96a28a08 HDFS-3067. NPE in DFSInputStream.readBuffer if read is repeated on corrupted block. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301182 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 20:26:29 +00:00
Tsz-wo Sze
1177d4edc2 HDFS-3005. FSVolume.decDfsUsed(..) should be synchronized. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301127 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 18:24:40 +00:00
Todd Lipcon
59eb544744 HDFS-3093. Fix bug where namenode -format interpreted the -force flag in reverse. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300814 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 05:36:03 +00:00
Alejandro Abdelnur
a0ee9adfd3 HDFS-3057. httpfs and hdfs launcher scripts should honor CATALINA_HOME and HADOOP_LIBEXEC_DIR (rvs via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300637 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-14 17:01:34 +00:00
Tsz-wo Sze
3e582c690c HDFS-3082. Clean up FSDatasetInterface and change DataNode.data to package private. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300392 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 22:52:17 +00:00
Eli Collins
ab20dae519 HDFS-2303. Unbundle jsvc. Contributed by Roman Shaposhnik and Mingjie Lai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299963 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 03:38:57 +00:00
Todd Lipcon
1a75ec8288 HDFS-2731. Add command to bootstrap the Standby Node's name directories from the Active NameNode. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299807 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-12 19:41:21 +00:00
Suresh Srinivas
46a88ded0d Moving HDFS-1623 and HADOOP-7454 to 0.23.3 section in CHANGES.txt files 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299417 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-11 18:11:43 +00:00
Tsz-wo Sze
501a283986 HDFS-3056. Add a new interface RollingLogs for DataBlockScanner logging. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299139 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-10 01:52:17 +00:00
Steve Loughran
381a9b2d58 HDFS-2966 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298820 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 13:17:04 +00:00
Uma Maheswara Rao G
b19d1186ab HDFS-2976. Remove unnecessary method (tokenRefetchNeeded) in DFSClient. 
(Contributed by Uma Maheswara Rao G)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298495 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 18:31:33 +00:00
Suresh Srinivas
b874d06133 Moving HDFS-3036, HDFS-3014, HDFS-3003, HDFS-2878, HDFS-208, HDFS-2764, HDFS-2410, HDFS-2285, HDFS-2507 to 0.23.3 section 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298274 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 05:23:50 +00:00
Tsz-wo Sze
22738ae1d0 HDFS-2038. Update TestHDFSCLI to handle relative paths with globs. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298066 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-07 19:44:47 +00:00
Eli Collins
0a2b413dff HDFS-3060. Bump TestDistributedUpgrade#testDistributedUpgrade timeout. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298044 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-07 19:16:03 +00:00
Suresh Srinivas
6f8d347b83 Moving HDFS-2158, HDFS-2188, HDFS-2334, HDFS-2477, HDFS-2495, HDFS-2476, HDFS-1580, HDFS-1765 to 0.23.3 section in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297903 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-07 09:15:30 +00:00
Tsz-wo Sze
0ee71adeb4 HDFS-3032. Change DFSClient.renewLease() so that it only retries up to the lease soft-limit. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297328 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 02:42:46 +00:00
Aaron Myers
8e303014bc Fix up CHANGES.txt files post commit of HDFS-1623 and HADOOP-7454. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296540 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-03 00:50:04 +00:00
Aaron Myers
8a99218853 HDFS-3038. Add FSEditLog.metrics to findbugs exclude list. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296019 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 01:37:02 +00:00
Aaron Myers
6da670ce6a HDFS-3037. TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296016 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 01:26:54 +00:00
Tsz-wo Sze
b2f67b4704 HADOOP-8124, HDFS-3034, MAPREDUCE-3956. Remove the deprecated Syncable.sync(). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295999 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 23:51:19 +00:00
Aaron Myers
f22677ef8e HDFS-3036. Remove unused method DFSUtil#isDefaultNamenodeAddress. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295961 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 22:52:05 +00:00
Tsz-wo Sze
9e31bf675d HDFS-3021. Use generic type to declare FSDatasetInterface. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295929 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 21:58:39 +00:00
Arun Murthy
753c2ba66c HDFS-3012. Moving to hadoop-0.23.2. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295310 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 22:07:03 +00:00
Todd Lipcon
28de3628f5 HDFS-3020. Fix editlog to automatically sync when buffer is full. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295239 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 19:57:18 +00:00
Jitendra Nath Pandey
ca9b4de772 HDFS-3012. Exception while renewing delegation token. Contributed by Bobby Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295232 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 19:36:17 +00:00
Eli Collins
fbf3a9ee3d HDFS-2992. Edit log failure trace should include transaction ID of error. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295227 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 19:31:36 +00:00
Todd Lipcon
34c73db5e1 HDFS-2991. Fix case where OP_ADD would not be logged in append(). Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295214 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 18:52:00 +00:00
Jitendra Nath Pandey
e57fd85fd4 HDFS-3030. Remove getProtocolVersion and getProtocolSignature from translators. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295017 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 08:52:45 +00:00
Aaron Myers
e58b7e202b HDFS-3014. FSEditLogOp and its subclasses should have toString() method. Contributed by Sho Shimauchi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294926 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 01:17:37 +00:00
Jitendra Nath Pandey
daf782ca7e HDFS-3016. Security in unit tests. Contributed by Jaimin Jetly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294773 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 18:41:25 +00:00
Todd Lipcon
7decf112c0 HDFS-3024. Improve performance of stringification in addStoredBlock. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294754 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 18:04:13 +00:00
Tsz-wo Sze
12b3ce7205 Move entries to 0.23.3 in CHANGES.txt for the 0.23-PB merge. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294431 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 01:10:53 +00:00
Aaron Myers
b57260f848 HDFS-2978. The NameNode should expose name dir statuses via JMX. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293707 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-25 22:14:53 +00:00
Arun Murthy
1de3fa8653 Preparing for 0.23.3 release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293506 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-25 01:37:07 +00:00
Tsz-wo Sze
dacbeb5f67 HDFS-3006. In WebHDFS, when the return body is empty, set the Content-Type to application/octet-stream instead of application/json. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293487 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-25 00:15:37 +00:00
Suresh Srinivas
5293e5d1c5 HDFS-3002. TestNameNodeMetrics need not wait for metrics update. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293482 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 23:52:20 +00:00
Eli Collins
78f22bc525 HDFS-3008. Negative caching of local addrs doesn't work. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293419 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 21:14:04 +00:00
Suresh Srinivas
0e79131981 HDFS-3009. Remove duplicate code in DFSClient#isLocalAddress by using NetUtils. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293390 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 19:29:41 +00:00
Aaron Myers
62c7e2edfc HDFS-3003. Remove getHostPortString() from NameNode, replace it with NetUtils.getHostPortString(). Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293338 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 17:03:17 +00:00
Tsz-wo Sze
f11b0788df HDFS-2981. In hdfs-default.xml, the default value of dfs.client.block.write.replace-datanode-on-failure.enable should be true. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292626 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 02:27:07 +00:00
Tsz-wo Sze
af70addc94 Move HDFS-2944 entry to 0.23 in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292624 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 02:23:46 +00:00
Todd Lipcon
475db83b87 HDFS-2985. Improve logging when replicas are marked as corrupt. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292609 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 01:16:33 +00:00
Tsz-wo Sze
efbc58f30c HDFS-2907. Add a conf property dfs.datanode.fsdataset.factory to make FSDataset in Datanode pluggable. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292419 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-22 17:47:39 +00:00
Steve Loughran
a57b9b8335 HDFS-2725 script to mention dfs command 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245943 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 15:25:11 +00:00
Arun Murthy
e38b7e6ddd Preparing for hadoop-0.23.1-rc2. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245845 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 02:30:48 +00:00
Todd Lipcon
9ae4fac8dd HDFS-2968. Protocol translator for BlockRecoveryCommand broken when multiple blocks need recovery. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245832 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 01:18:01 +00:00
Todd Lipcon
a8e7f745cd HDFS-2969. ExtendedBlock.equals is incorrectly implemented. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245830 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 01:13:09 +00:00
Suresh Srinivas
257e9440ed Moving HDFS-2525 to relevant release section (0.23.2) in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245312 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 03:56:45 +00:00
Jitendra Nath Pandey
b8448dea82 HDFS-2655. BlockReaderLocal#skip performs unnecessary IO. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245118 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 18:58:19 +00:00
Suresh Srinivas
ff91453227 HDFS-2938. Recursive delete of a large directory make namenode unresponsive. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244752 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 22:00:08 +00:00
Jitendra Nath Pandey
f82e862e1f HDFS-2525. Race between BlockPoolSliceScanner and append. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244640 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 18:43:01 +00:00
Todd Lipcon
3bd230af11 HDFS-2950. Secondary NN HTTPS address should be listed as a NAMESERVICE_SPECIFIC_KEY. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244635 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 18:27:37 +00:00
Aaron Myers
a87328dfab HDFS-2943. Expose last checkpoint time and transaction stats as JMX metrics. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243822 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 08:27:15 +00:00
Aaron Myers
2acafd1783 HDFS-2944. Typo in hdfs-default.xml causes dfs.client.block.write.replace-datanode-on-failure.enable to be mistakenly disabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243690 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 20:57:48 +00:00
Suresh Srinivas
a70bc6c6a2 HDFS-2815. Namenode sometimes oes not come out of safemode during NN crash + restart. Contributed by Uma Maheswara Rao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243673 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 20:11:43 +00:00
Tsz-wo Sze
52004aa8e9 HDFS-776. Fix exception handling in Balancer. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243654 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 19:07:04 +00:00
Harsh J
8b730c867f HDFS-2869. Fix an error in the webhdfs docs for the mkdir op (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243104 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-11 17:13:30 +00:00
Todd Lipcon
8be9441b9b HDFS-2878. Fix TestBlockRecovery and move it back into main test directory. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242995 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-11 01:20:59 +00:00
Tsz-wo Sze
83fd3160da HDFS-2931. Switch DataNode's BlockVolumeChoosingPolicy to private-audience. Contributed by harsh 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242891 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 19:15:15 +00:00
Tsz-wo Sze
dc847b39fd HDFS-2486. Remove unnecessary priority level checks in UnderReplicatedBlocks. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242636 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 02:05:38 +00:00
Aaron Myers
3c6863ab4a Update CHANGES.txt to reflect the back-port of HDFS-2764 from trunk to branch-0.23. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242554 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 22:09:25 +00:00
Todd Lipcon
a1574e1715 HDFS-2923. Namenode IPC handler count uses the wrong configuration key. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242220 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 05:28:40 +00:00
Jitendra Nath Pandey
987449b9b8 HDFS-2908. Add apache license header for StorageReport.java. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242192 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 00:24:06 +00:00
Tsz-wo Sze
b6ffb08a46 HDFS-2887. FSVolume, is a part of FSDatasetInterface implementation, should not be referred outside FSDataset. A new FSVolumeInterface is defined. The BlockVolumeChoosingPolicy.chooseVolume(..) method signature is also updated. (szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242087 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 20:58:29 +00:00
Arun Murthy
647f374607 Preparing for release 0.23.1 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241795 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 07:27:58 +00:00
Aaron Myers
4d3dc530e8 HDFS-2764. TestBackupNode is racy. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241780 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 05:38:29 +00:00
Jitendra Nath Pandey
11db1b855f HDFS-2786. Fix host-based token incompatibilities in DFSUtil. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241766 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 03:55:36 +00:00
Suresh Srinivas
8e524e731c Fixing 0.23.1 version of the CHANGES.txt to make it consistent with the CHANGES.txt from 0.23.1 release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241751 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 02:58:28 +00:00
Arun Murthy
eabe75d6f2 HDFS-2572. Moved to trunk section from 0.23.1 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241746 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 02:31:26 +00:00
Suresh Srinivas
28eadb7cd7 HDFS-2899. Service protocol changes in DatanodeProtocol to add multiple storages. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241519 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 16:59:48 +00:00
Konstantin Shvachko
7e4bd89590 HDFS-2886. CreateEditLogs should generate a realistic edit log. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241296 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 00:44:27 +00:00
Suresh Srinivas
2a9e430ff9 HDS-2895. Remove Writable wire protocol types and translators to complete transition to protocol buffers. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241007 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 13:33:35 +00:00
Eli Collins
b837bbb7d5 HDFS-2893. The start/stop scripts don't start/stop the 2NN when using the default configuration. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240928 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 08:52:50 +00:00
Harsh J
da7b0d90c6 HDFS-2868. Expose xceiver counts via the DataNode MXBean. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240897 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 05:25:12 +00:00
Suresh Srinivas
f88574acde HDFS-2880. Protobuf chagnes in DatanodeProtocol to add multiple storages. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240653 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-05 01:39:30 +00:00
Jitendra Nath Pandey
205f0470f4 HDFS-2785. Update webhdfs and httpfs for host-based token support. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240460 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 06:57:40 +00:00
Aaron Myers
447e81f51a HDFS-2889. getNumCurrentReplicas is package private but should be public on0.23 (see HDFS-2408). Contributed by Gregory Chanan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240412 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 00:01:06 +00:00
Tsz-wo Sze
38ad4b5036 HDFS-2879. Change FSDataset to package private. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240020 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-03 07:26:02 +00:00
Todd Lipcon
6d5510dfb8 HDFS-2877. If locking of a storage dir fails, it will remove the other NN's lock file on exit. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239880 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 22:12:02 +00:00
Jitendra Nath Pandey
9eb8f4d267 HDFS-2784. Update hftp and hdfs for host-based token support. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239763 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 19:04:40 +00:00
Konstantin Shvachko
191db6a907 HDFS-2718. Optimize OP_ADD in edits loading. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239760 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 18:57:49 +00:00
Jitendra Nath Pandey
c909aedbc1 HDFS-2814 NamenodeMXBean does not account for svn revision in the version information. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239464 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 05:31:46 +00:00
Tsz-wo Sze
dbbfaebb71 HDFS-2864. Remove some redundant methods and the constant METADATA_VERSION from FSDataset. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238969 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 07:46:50 +00:00
Suresh Srinivas
536b30ec91 HDFS-2835. Fix findbugs and javadoc issue with GetConf.java. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238779 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 20:03:49 +00:00
Suresh Srinivas
319021d6fb HDFS-2857. Cleanup BlockInfo class. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238747 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 18:59:58 +00:00
Tsz-wo Sze
8dfef7d2dc HDFS-2827. When the parent of a directory is the root, renaming the directory results in leases updated incorrectly. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238700 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 17:36:42 +00:00
Jitendra Nath Pandey
98302971c2 HDFS-2801. Provide a method in client side translators to check for a methods supported in underlying protocol. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237192 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-29 02:01:24 +00:00
Aaron Myers
976c07696d HDFS-2759. Pre-allocate HDFS edit log files after writing version number. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237153 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 20:26:13 +00:00
Todd Lipcon
da91e0d427 HDFS-2791. If block report races with closing of file, replica is incorrectly marked corrupt. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236945 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 00:42:34 +00:00
Alejandro Abdelnur
0d5b734681 HDFS-2840. TestHostnameFilter should work with localhost or localhost.localdomain (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236940 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 00:24:46 +00:00
Alejandro Abdelnur
cf16929584 HDFS-2837. mvn javadoc:javadoc not seeing LimitedPrivate class (revans2 via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236338 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-26 18:15:04 +00:00
Alejandro Abdelnur
a7091893de HDFS-2836. HttpFSServer still has 2 javadoc warnings in trunk (revans2 via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236328 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-26 17:58:42 +00:00
Harsh J
7c69883917 HDFS-442. dfsthroughput in test jar throws NPE (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235137 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 06:10:28 +00:00
Eli Collins
5dfe62d845 HDFS-2397. Undeprecate SecondaryNameNode. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235135 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 06:05:52 +00:00
Todd Lipcon
1525aae4b3 HDFS-2826. Add test case for HDFS-1476 (safemode can initialize replication queues before exiting) (todd) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235067 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 23:42:17 +00:00
Todd Lipcon
c0016ba85f HDFS-2825. Add test hook to turn off the writer preferring its local DN. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235025 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 22:07:49 +00:00
Todd Lipcon
12645ff6c0 HDFS-2822. processMisReplicatedBlock incorrectly identifies under-construction blocks as under-replicated. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234925 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 18:11:09 +00:00
Harsh J
ece854211f HDFS-2818. Fix a missing space issue in HDFS webapps' title tags. (Devaraj K via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234555 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-22 17:30:33 +00:00
Todd Lipcon
c840548d6b HDFS-2817. Combine the two TestSafeMode test suites. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234221 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-21 00:42:35 +00:00
Alejandro Abdelnur
654b90fa23 HDFS-2816. Fix missing license header in httpfs findbugsExcludeFile.xml. (hitesh via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234135 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-20 21:04:24 +00:00
Todd Lipcon
f7d20b2198 HDFS-2751. Datanode may incorrectly drop OS cache behind reads even for short reads. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233796 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-20 07:32:06 +00:00
Todd Lipcon
520a39ac2d HDFS-2810. Leases not getting renewed properly by clients. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233794 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-20 07:26:19 +00:00
Eli Collins
fa6033a029 HDFS-2768. BackupNode stop can not close proxy connections because it is not a proxy instance. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233584 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-19 21:41:50 +00:00
Todd Lipcon
1d2e706dd1 HDFS-2803. Add logging to LeaseRenewer for better lease expiration debugging. Contributed by Jimmy Xiang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233453 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-19 16:35:25 +00:00
Eli Collins
c53c94ec46 Update changelog for HDFS-362 to reflect the merge. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232205 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-16 22:43:11 +00:00
Eli Collins
f02ea82bd1 HDFS-2790. FSNamesystem.setTimes throws exception with wrong configuration name in the message. Contributed by Arpit Gupta 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231572 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-14 19:50:14 +00:00
Eli Collins
6b8bcfa916 HDFS-2788. HdfsServerConstants#DN_KEEPALIVE_TIMEOUT is dead code. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231569 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-14 19:45:12 +00:00
Jitendra Nath Pandey
6234f3d91c HADOOP-2776. Missing interface annotation on JournalSet. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230412 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 06:21:05 +00:00
Harsh J
dcea80a21b HDFS-69. Improve the 'dfsadmin' commandline help. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230398 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 05:13:19 +00:00
Tsz-wo Sze
1c8e3e8854 Add HDFS-2499 to CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229897 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 05:40:57 +00:00
Jitendra Nath Pandey
8faf7e8fb6 HDFS-2739. SecondaryNameNode doesn't start up. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229877 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 02:54:48 +00:00
Aaron Myers
a7195bdd14 HDFS-2765. TestNameEditsConfigs is incorrectly swallowing IOE. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229028 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-09 04:53:20 +00:00
Harsh J
8819fda489 Merged HDFS-2349, HDFS-2729, HDFS-2726, HDFS-554, HDFS-1314, HADOOP-7910 to branch-0.23, updating CHANGES.txt for trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1228567 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 03:44:48 +00:00
Jitendra Nath Pandey
4efd3699a6 HDFS-2697. Move RefreshAuthPolicy, RefreshUserMappings, GetUserMappings protocol to protocol buffers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227887 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 23:03:31 +00:00
Alejandro Abdelnur
5f5561d057 Fixing CHANGES.txt files, moving JIRAs from trunk to 0.23.1 section. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227859 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 21:55:43 +00:00
Suresh Srinivas
472e971891 HDFS-2710. Add HDFS tests related to HADOOP-7933. Contributed by Siddarth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227756 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 18:57:01 +00:00
Harsh J
075122690c HDFS-1314. Make dfs.blocksize accept size-indicating prefixes (Sho Shimauchi via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227165 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 14:15:15 +00:00
Harsh J
05ed36cd52 HDFS-2722. HttpFs should not be using an int for block size. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226861 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-03 16:47:49 +00:00
Harsh J
8e8203f3c5 HDFS-554. Use System.arraycopy in BlockInfo.ensureCapacity. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226239 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-01 12:06:49 +00:00
Harsh J
11905517f1 HDFS-2574. Remove references to some deprecated properties in conf templates and defaults files. (Joe Crobak via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226211 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-01 03:11:48 +00:00
Harsh J
6c349f9420 HDFS-2729. Update BlockManager's comments regarding the invalid block set (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225591 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 16:51:59 +00:00
Harsh J
41737432c0 HDFS-2726. Fix a logging issue under DFSClient's createBlockOutputStream method (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225456 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 07:22:54 +00:00
Alejandro Abdelnur
ae0d48854d HDFS-2707. HttpFS should read the hadoop-auth secret from a file instead inline from the configuration. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1224794 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-26 19:37:25 +00:00
Alejandro Abdelnur
6b4f40cbf9 HttpFS server should check that upload requests have correct content-type. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221616 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 05:26:20 +00:00
Alejandro Abdelnur
8fe3dd3fea HDFS-2657. TestHttpFSServer and TestServerWebApp are failing on trunk. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221580 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 03:03:16 +00:00
Alejandro Abdelnur
45620eee68 HDFS-2646. Hadoop HttpFS introduced 4 findbug warnings. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221572 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 02:46:04 +00:00
Tsz-wo Sze
3503d9a4a8 HDFS-2706. Use configuration for blockInvalidateLimit if it is set. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221106 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-20 05:49:24 +00:00
Alejandro Abdelnur
de928a4aa0 HDFS-2658. HttpFS introduced 70 javadoc warnings. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220810 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 15:53:53 +00:00
Eli Collins
5e185702ea HDFS-2335. DataNodeCluster and NNStorage always pull fresh entropy. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220510 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-18 18:12:48 +00:00
Todd Lipcon
a89baed833 HDFS-2553. Fix BlockPoolSliceScanner spinning in a tight loop. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220317 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-18 01:13:00 +00:00
Todd Lipcon
fa1edc9a1e HDFS-2700. Fix failing TestDataNodeMultipleRegistrations in trunk. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220315 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-18 01:10:49 +00:00
Suresh Srinivas
89553be90e HDFS-2687. Tests failing with ClassCastException post protobuf RPC changes. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215366 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-17 00:26:46 +00:00
Aaron Myers
52c1491155 HDFS-2694. Removal of Avro broke non-PB NN services. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215364 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-17 00:19:01 +00:00
Thomas White
9b7617a909 HDFS-2640. Javadoc generation hangs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215354 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-17 00:09:04 +00:00
Sanjay Radia
d8dfcdcbc2 HDFS-2669 Enable protobuf rpc for ClientNamenodeProtocol 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214128 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 09:27:51 +00:00
Suresh Srinivas
60dd76c6ab HDFS-2676. Remove Avro RPC. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214102 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 08:20:23 +00:00
Todd Lipcon
b9238e3bad HDFS-2675. Reduce warning verbosity when double-closing edit logs. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214098 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 08:13:55 +00:00
Eli Collins
bdc2a77d6b HDFS-2649. eclipse:eclipse build fails for hadoop-hdfs-httpfs. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214046 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 03:42:24 +00:00
Jitendra Nath Pandey
3cffe34177 HDFS-2661. Enable protobuf RPC for DatanodeProtocol. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214033 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 02:15:37 +00:00
Tsz-wo Sze
433a6e78f6 HDFS-2545. Change WebHDFS to support multiple namenodes in federation. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214027 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 01:47:57 +00:00
Suresh Srinivas
3954a2fb1c HDFS-2663. Optional protobuf parameters are not handled correctly. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213985 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:31:44 +00:00
Suresh Srinivas
6a609cb471 Reverting the patch r1213981 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213984 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:27:58 +00:00
Jitendra Nath Pandey
1f2f4e105b HDFS-234. Integration with BookKeeper logging system. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213983 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:27:13 +00:00
Suresh Srinivas
b5229fd19b HDFS-2663. Optional protobuf parameters are not handled correctly. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213981 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:22:28 +00:00
Suresh Srinivas
3001a172c8 Reverting r1213512 because it committed changes that were not part of the patch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213980 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:17:02 +00:00
Suresh Srinivas
f2f4e93413 HDFS-2650. Replace @inheritDoc with @Override. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213813 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 18:07:29 +00:00
Suresh Srinivas
4ec8424e5d HDFS-2666. Fix TestBackupNode failure. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213808 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 17:59:37 +00:00
Eli Collins
5f39d6c239 HDFS-2654. Make BlockReaderLocal not extend RemoteBlockReader2. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213592 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 08:09:50 +00:00
Eli Collins
197634f2f7 HDFS-2653. DFSClient should cache whether addrs are non-local when short-circuiting is enabled. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213586 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 07:51:23 +00:00
Eli Collins
2892b058e0 Put HDFS-1765 in the right place in the changelog. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213541 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 02:23:07 +00:00
Eli Collins
43100e9c0e HDFS-1765. Block Replication should respect under-replication block priority. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213537 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 01:58:25 +00:00
Suresh Srinivas
13345f3a85 HDFS-2663. Handle protobuf optional parameters correctly. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213512 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 00:21:48 +00:00
Sanjay Radia
48da033901 HDFS-2651 ClientNameNodeProtocol Translators for Protocol Buffers (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213143 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 05:36:35 +00:00
Konstantin Shvachko
2c1ee1d342 Preparing for release 0.22.0 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213121 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 00:26:01 +00:00
Suresh Srinivas
2740112bb6 HDFS-2647. Used protobuf based RPC for InterDatanodeProtocol, ClientDatanodeProtocol, JournalProtocol, NamenodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213040 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-11 18:53:21 +00:00
Alejandro Abdelnur
e7682e1496 HDFS-2511. Add dev script to generate HDFS protobufs. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212609 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 20:21:19 +00:00
Jitendra Nath Pandey
38a19bc293 HDFS-2642. Protobuf translators for DatanodeProtocol. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212606 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 20:02:33 +00:00
Tsz-wo Sze
9b1f47226b HDFS-2594. Support getDelegationTokens and createSymlink in WebHDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212299 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 09:26:33 +00:00
Alejandro Abdelnur
3334306512 HDFS-2178. Contributing Hoop to HDFS, replacement for HDFS proxy with read/write capabilities. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212060 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 19:25:28 +00:00
Sanjay Radia
9f69ae5a9e HDFS-2597 ClientNameNodeProtocol in Protocol Buffers (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211769 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 06:48:45 +00:00
Aaron Myers
a27adf3de4 HDFS-2430. The number of failed or low-resource volumes the NN can tolerate should be configurable. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211650 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-07 21:47:13 +00:00
Suresh Srinivas
c17bb83644 HDFS-2636. Implement protobuf service for ClientDatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211249 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-07 01:05:56 +00:00
Suresh Srinivas
7a59150bff HDFS-2629. Implement protobuf service for InterDatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211206 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 22:19:10 +00:00
Suresh Srinivas
0a713035f2 HDFS-2618. Implement protobuf service for NamenodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210719 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 00:25:25 +00:00
Suresh Srinivas
c256f8266d HDFS-2581. Implement protobuf service for JournalProtocol. Contributed Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210657 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 21:52:23 +00:00
Jitendra Nath Pandey
d18e5b3844 HDFS-1580. Add interface for generic Write Ahead Logging mechanisms. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210602 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 20:10:27 +00:00
Sanjay Radia
65200998c0 HADOOP-7862 Move the support for multiple protocols to lower layer so that Writable, PB and Avro can all use it (includes HDFS and MR changes to match) (Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210208 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-04 20:44:36 +00:00
Alejandro Abdelnur
afbc3aa30c HDFS-2606. webhdfs client filesystem impl must set the content-type header for create/append. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208157 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 00:25:54 +00:00
Tsz-wo Sze
0398a9e88d HDFS-2604. Add a log message to show if WebHDFS is enabled and a configuration section in the forrest doc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208140 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 23:38:59 +00:00
Konstantin Shvachko
68f56ca906 HDFS-2287. Fix second assert. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207710 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 00:03:49 +00:00
Konstantin Shvachko
3083d7d7db Fix CHANGES.txt. Moving changes from 0.21.1 section to 0.22.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207709 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 00:00:20 +00:00
Konstantin Shvachko
82da8fb490 Fix CHANGES.txt. Some changes have been committed under 0.21.1 section rather than 0.22.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207706 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 23:53:49 +00:00
Konstantin Shvachko
32935d3e67 Fix CHANGES.txt for HDFS-2346 in trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207700 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 23:40:24 +00:00
Eli Collins
b32543d9ae HDFS-2596. TestDirectoryScanner doesn't test parallel scans. (eli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207694 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 23:20:16 +00:00
Konstantin Shvachko
49c44117f3 Fix typo in HDFS-993 commit. Was -933. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207676 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 22:51:45 +00:00
Tsz-wo Sze
91a75ad34f Fix WebHDFS capitalization in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207585 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 20:47:38 +00:00
Matthew Foley
e9c2307838 HDFS-2316. Record completion of umbrella jira. Contributed by Tsz Wo (Nicholas), Sze. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206990 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 06:30:49 +00:00
Tsz-wo Sze
4b65d10cfe HDFS-2590. Fix the missing links in the WebHDFS forrest doc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206178 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-25 13:58:29 +00:00
Tsz-wo Sze
d3a51478e3 HDFS-2587. Add apt doc for WebHDFS REST API. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205626 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 22:02:19 +00:00
Matthew Foley
db092f5048 HADOOP-7827 HDFS-2588 MAPREDUCE-3464. jsp pages missing DOCTYPE. Contributed by Dave Vronay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205519 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 18:15:37 +00:00
Tsz-wo Sze
7381884e85 HDFS-2552. Add Forrest doc for WebHDFS REST API. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205146 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 20:04:58 +00:00
Suresh Srinivas
49417594e8 HDFS-2519. Add protobuf service for DatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204825 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 06:25:13 +00:00
Tsz-wo Sze
2ab10e29d9 HDFS-2246. Enable reading a block directly from local file system for a client on the same node as the block file. Contributed by Andrew Purtell, Suresh Srinivas and Jitendra Nath Pandey 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204792 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 02:57:04 +00:00
Konstantin Boudnik
a2e66776a9 HDFS-2573. TestFiDataXceiverServer is failing, not testing OOME. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204781 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 02:15:49 +00:00
Suresh Srinivas
5293760973 HDFS-2410. Further cleanup of hardcoded configuration keys and values. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204753 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 23:49:44 +00:00
Suresh Srinivas
b76b85986e HDFS-2520. Add protobuf service for InterDatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204709 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 21:11:43 +00:00
Suresh Srinivas
4754b80862 HDFS-2518. Add protobuf service for NamenodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204707 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 21:10:04 +00:00
Todd Lipcon
39ce694d05 HDFS-2566. Move BPOfferService to be a non-inner class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204659 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 19:27:00 +00:00
Todd Lipcon
68173af69d HDFS-2575. DFSTestUtil may create empty files. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204652 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 19:03:31 +00:00
Suresh Srinivas
54ac7e5413 HDFS-2517. Add protobuf service for JounralProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204544 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 15:39:33 +00:00
Eli Collins
9c2f4f634d HDFS-2514. Link resolution bug for intermediate symlinks with relative targets. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204370 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 07:01:29 +00:00
Todd Lipcon
5bc66c4c86 HDFS-2532. TestDfsOverAvroRpc timing out in trunk. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204366 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 06:41:56 +00:00
Harsh J
67f25b0a1b HDFS-2572. Remove Unnecessary double-check in DN#getHostName (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204177 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 15:18:14 +00:00
Eli Collins
5573b691d5 HDFS-2567. When 0 DNs are available, show a proper error when trying to browse DFS via web UI. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204131 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 06:28:37 +00:00
Eli Collins
8686a00c7a HDFS-2570. Add descriptions for dfs.*.https.address in hdfs-default.xml. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204129 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 06:22:44 +00:00
Eli Collins
8e8bb50afd HDFS-2454. Move maxXceiverCount check to before starting the thread in dataXceiver. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204124 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 04:27:59 +00:00
Eli Collins
513718f92d HDFS-2568. Use a set to manage child sockets in XceiverServer. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204122 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 04:13:32 +00:00
Eli Collins
b2313021fd HDFS-2536. Remove unused imports. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204120 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 03:58:50 +00:00
Eli Collins
0e5c1a45bf HDFS-208. name node should warn if only one dir is listed in dfs.name.dir. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204119 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 03:38:51 +00:00
Eli Collins
84f0c0f180 HDFS-2502. hdfs-default.xml should include dfs.name.dir.restore. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204117 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 03:29:20 +00:00
Eli Collins
7a8015c0e2 HDFS-2541. For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204114 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 02:51:50 +00:00
Eli Collins
b7cd8c0f86 HDFS-2564. Cleanup unnecessary exceptions thrown and unnecessary casts. Contributed by Hari Mankude 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203950 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-19 02:34:25 +00:00
Todd Lipcon
1f92266516 HDFS-2563. Some cleanup in BPOfferService. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203943 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-19 01:31:59 +00:00
Todd Lipcon
905a127850 HDFS-2562. Refactor DN configuration variables out of DataNode class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203543 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 09:04:20 +00:00
Thomas White
6a01c22755 HDFS-2543. HADOOP_PREFIX cannot be overridden. Contributed by Bruno Mahé. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203486 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 05:10:40 +00:00
Thomas White
dc5a0ab245 HDFS-2544. Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. Contributed by Bruno Mahé 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203452 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 00:53:46 +00:00
Todd Lipcon
0864ef1908 HDFS-2560. Refactor BPOfferService to be a static inner class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203444 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 00:45:31 +00:00
Todd Lipcon
9a3f147fdd HDFS-2476. More CPU efficient data structure for under-replicated, over-replicated, and invalidated blocks. Contributed by Tomasz Nykiel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201991 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 01:13:58 +00:00
Tsz-wo Sze
09a156fcce HDFS-2539. Support doAs and GETHOMEDIRECTORY in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200731 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 04:19:45 +00:00
Tsz-wo Sze
94c631af1f HDFS-2540. Webhdfs: change "Expect: 100-continue" to two-step write; change "HdfsFileStatus" and "localName" respectively to "FileStatus" and "pathSuffix" in JSON response. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199396 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-08 19:25:57 +00:00
Hairong Kuang
6dff9329d5 HDFS-2495. Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lock. Contributed by Tomasz Nykiel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199024 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-08 00:16:23 +00:00
Tsz-wo Sze
a590b498ac HDFS-2528. Webhdfs: set delegation kind to WEBHDFS and add a HDFS token when http requests are redirected to datanode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198903 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-07 20:05:16 +00:00
Tsz-wo Sze
6afe3e0d22 HDFS-2527. WebHdfs: remove the use of "Range" header in Open; use ugi username if renewer parameter is null in GetDelegationToken; response OK when setting replication for non-files; rename GETFILEBLOCKLOCATIONS to GET_BLOCK_LOCATIONS and state that it is a private unstable API; replace isDirectory and isSymlink with enum {FILE, DIRECTORY, SYMLINK} in HdfsFileStatus JSON object. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197329 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 22:34:47 +00:00
Todd Lipcon
40fe96546f HDFS-2129. Simplify BlockReader to not inherit from FSInputChecker. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196976 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 06:54:59 +00:00
Todd Lipcon
fd8c757b9f Add new section to HDFS CHANGES.txt for 0.23.1. Moved two things that were recently committed post-0.23.0 to this new section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196904 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 01:02:28 +00:00
Todd Lipcon
11cf658d0a HDFS-2533. Remove needless synchronization on some FSDataSet methods. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196902 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 01:00:25 +00:00
Todd Lipcon
f84552ac35 HDFS-2130. Switch default checksum to CRC32C. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196889 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 00:35:37 +00:00
Hairong Kuang
a4baabe4a4 HDFS-2477. Optimize computing the diff between a block report and the namenode state. Contributed by Tomasz Nykiel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196676 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-02 16:31:21 +00:00
Jitendra Nath Pandey
bd21ddcb78 HDFS-2416. distcp with a webhdfs uri on a secure cluster fails. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196434 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-02 02:08:20 +00:00
Aaron Myers
abe45f59ac HDFS-2526. (Client)NamenodeProtocolTranslatorR23 do not need to keep a reference to rpcProxyWithoutRetry (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196171 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 17:59:53 +00:00
Eli Collins
4961441584 HDFS-2308. NamenodeProtocol.endCheckpoint is vestigial and can be removed. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196113 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 16:44:28 +00:00
Arun Murthy
4e42044b1c Preparing for release 0.23.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195872 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 08:46:22 +00:00
Konstantin Shvachko
22000ce96d HDFS-2002. Incorrect computation of needed blocks in getTurnOffTip(). Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195869 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 08:37:11 +00:00
Arun Murthy
a3a4ccfed7 Preparing for release 0.23.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195838 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 06:02:53 +00:00
Todd Lipcon
1c940637b1 HDFS-2521. Remove custom checksum headers from data transfer protocol. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195829 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 05:17:08 +00:00
Tsz-wo Sze
8d1a09b741 HDFS-2065. Add null checks in DFSClient.getFileChecksum(..). Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195731 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 00:38:57 +00:00
Todd Lipcon
c46876982e HDFS-2512. Add textual error message to data transfer protocol responses. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195693 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 21:53:58 +00:00
Tsz-wo Sze
32cad9affe HDFS-2385. Support renew and cancel delegation tokens in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195656 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 20:37:16 +00:00
Jitendra Nath Pandey
7cb77a3b1b HDFS-2334. Add Closeable to JournalManager. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195620 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 19:03:55 +00:00
Konstantin Shvachko
64c019cccc HDFS-2285. BackupNode should reject requests to modify namespace. Contributed by Konstantin Shvachko and Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195013 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 20:11:35 +00:00
Tsz-wo Sze
2eca60199a Revert 1190677 for HDFS-2509. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1194986 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 19:31:06 +00:00
Tsz-wo Sze
2dcd43c7b1 HDFS-2436. Change FSNamesystem.setTimes(..) for allowing setting times on directories. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190708 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 00:19:21 +00:00
Tsz-wo Sze
c8ac31e9a0 HDFS-2509. Add a test for DistributedFileSystem.getFileChecksum(..) on directories or non existing files. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190677 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 23:42:27 +00:00
Todd Lipcon
6b0963c53b HDFS-2465. Add HDFS support for fadvise readahead and drop-behind. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190626 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 22:18:42 +00:00
Tsz-wo Sze
9692cfc9ae HDFS-2493. Remove reference to FSNamesystem in blockmanagement classes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190491 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 18:28:26 +00:00
Sanjay Radia
b49c95a5d9 HDFS-2479 HDFS Client Data Types in Protocol Buffers (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190127 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 01:52:00 +00:00
Tsz-wo Sze
4a98639a55 Move HDFS-2355, HDFS-2371 and HDFS-2298 entries from trunk to 0.23 in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190126 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 01:48:12 +00:00
Tsz-wo Sze
8cb0d4b380 HDFS-2432. Webhdfs: response FORBIDDEN when setReplication on non-files; clear umask before creating a flie; throw IllegalArgumentException if setOwner with both owner and group empty; throw FileNotFoundException if getFileStatus on non-existing files; fix bugs in getBlockLocations; and changed getFileChecksum json response root to "FileChecksum". 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190077 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 23:13:26 +00:00
Todd Lipcon
221aadbc5b HDFS-2500. Avoid file system operations in BPOfferService thread while processing deletes. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190071 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 22:47:19 +00:00
Todd Lipcon
646e855f6e HDFS-2507. Allow saveNamespace operations to be canceled. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190060 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 22:11:10 +00:00
Suresh Srinivas
456ca74b96 HDFS-2496. Separate datatypes for DatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189901 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 18:09:42 +00:00
Tsz-wo Sze
10dc6b0927 HDFS-1869. mkdirs should use the supplied permission for all of the created directories. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189546 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 00:02:19 +00:00
Tsz-wo Sze
753c14cf4e Move webhdfs entries from trunk to 0.23 in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189541 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 23:49:45 +00:00
Tsz-wo Sze
758194382c HDFS-2494. Close the streams and DFSClient in DatanodeWebHdfsMethods. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189360 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 18:24:29 +00:00
Jitendra Nath Pandey
8534e70044 HDFS-2411. The auth to local mappings are not respected with webhdfs and security enabled. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189355 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 18:15:58 +00:00
Tsz-wo Sze
8335995630 HDFS-2501. Add version prefix and root methods to webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189028 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 05:16:57 +00:00
Suresh Srinivas
a268a3c0e4 HDFS-2488. Separate datatypes for InterDatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188487 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 01:32:49 +00:00
Suresh Srinivas
4846ca7863 HDFS-2497 Fix TestBackupNode failure. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188436 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 23:07:13 +00:00
Sanjay Radia
0920056f04 HDFS-2481 Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188300 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 19:08:03 +00:00
Suresh Srinivas
2b35e8aa4f HDFS-2489. Move Finalize and Register to separate file out of DatanodeCommand.java. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188282 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 18:40:13 +00:00
Konstantin Shvachko
6e0991704f HDFS-2452. OutOfMemoryError in DataXceiverServer takes down the DataNode. Contributed by Uma Maheswara Rao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187965 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-23 20:17:04 +00:00
Steve Loughran
2690d0db0e HDFS-2485 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187887 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-23 14:13:58 +00:00
Konstantin Shvachko
7dd869c2a9 HDFS-2491. TestBalancer can fail when datanode utilization and avgUtilization is exactly same. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187837 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-23 00:35:55 +00:00
Suresh Srinivas
d2e1a71918 HDFS-2480. Separate datatypes for NamenodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187505 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 19:03:18 +00:00
Tsz-wo Sze
7c48130d41 HDFS-2427. Change the default permission in webhdfs to 755 and add range check/validation for all parameters. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187140 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 00:27:08 +00:00
Suresh Srinivas
520d2502c5 HDFS-2459. Separate datatypes for Journal Protocol. (suresh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186896 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 16:31:57 +00:00
Suresh Srinivas
37137845c8 Merging change r1186579 for HDFS-2471 from 0.23 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186584 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 00:38:42 +00:00
Arun Murthy
a6cc9bafa8 HDFS-2445. Ensure failed tests exit with proper error code. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186550 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 22:51:51 +00:00
Tsz-wo Sze
0bd8f0bd40 HDFS-2453. Fix http response code for partial content in webhdfs, added getDefaultBlockSize() and getDefaultReplication() in WebHdfsFileSystem and cleared content type in ExceptionHandler. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186508 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 21:38:58 +00:00
Alejandro Abdelnur
01d408d5b0 Reverted HDFS-2474 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186501 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 21:29:01 +00:00
Alejandro Abdelnur
2edd042f8a HDFS-2474. Make GlobFilter class public. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186498 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 21:17:35 +00:00
Owen O'Malley
073a13aeb1 HDFS-2467. HftpFileSystem uses incorrect compare for finding delegation 
tokens. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185842 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 20:33:16 +00:00
Jitendra Nath Pandey
8d4842383e HDFS-2188. Make FSEditLog create its journals from a list of URIs rather than NNStorage. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185354 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 20:23:57 +00:00
Tsz-wo Sze
50cb2771e9 HDFS-2439. Fix NullPointerException in webhdfs when opening a non-existing file or creating a file without specifying the replication parameter. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183554 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 23:25:09 +00:00
Konstantin Shvachko
4cb7a4854d HDFS-2012. Balancer incorrectly treats nodes whose utilization equals avgUtilization. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183457 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 18:31:55 +00:00
Jitendra Nath Pandey
002dd6968b MAPREDUCE-2764. Fix renewal of dfs delegation tokens. Contributed by Owen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183187 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 01:24:20 +00:00
Tsz-wo Sze
c46dbedaf9 HDFS-2424. Added a root element "HdfsFileStatuses" for the response of webhdfs listStatus. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183175 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 00:30:30 +00:00
Tsz-wo Sze
5904e00b4f HDFS-2428. Convert com.sun.jersey.api.ParamException$QueryParamException to IllegalArgumentException and response it http BAD_REQUEST in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183098 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 21:06:41 +00:00
Tsz-wo Sze
7d1a5078b7 HDFS-2441. Remove the Content-Type set by HttpServer.QuotingInputFilter in webhdfs responses. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183081 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 20:41:00 +00:00
Mahadev Konar
e123a37bf1 HDFS-2401. Running a set of methods in a Single Test Class. (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182694 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 07:13:54 +00:00
Aaron Myers
c3792b4b3f Move line for HDFS-2422 under 0.23 instead of 0.24. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182220 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 06:26:26 +00:00
Harsh J
532872bf74 HDFS-2349. Corruption detected during block transfers should log WARNs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182205 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 04:48:52 +00:00
Aaron Myers
f527f989af HDFS-2422. The NN should tolerate the same number of low-resource volumes as failed volumes (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181316 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-11 00:37:29 +00:00
Suresh Srinivas
676f488eff HDFS-2404. webhdfs liststatus json response is not correct. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180757 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-10 01:49:37 +00:00
Todd Lipcon
4cf6bc415f HDFS-2414. Fix TestDFSRollback to avoid spurious failures. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180541 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-09 03:59:21 +00:00
Steve Loughran
3ab2e79ad7 HDFS-2209 datanode connection failure logging 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180353 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-08 10:41:56 +00:00
Todd Lipcon
54e81464a3 HDFS-2412. Add backwards-compatibility layer for renamed FSConstants class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180202 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 20:28:39 +00:00
Alejandro Abdelnur
2b157c6b12 HDFS-2322. the build fails in Windows because commons-daemon TAR cannot be fetched. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180094 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 16:34:51 +00:00
Steve Loughran
aace6cb631 HDFS-2209. Make MiniDFS easier to embed in other apps. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180077 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 15:30:32 +00:00
Alejandro Abdelnur
9291197de4 HDFS-2294. Download of commons-daemon TAR should not be under target (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179894 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 23:10:31 +00:00
Sanjay Radia
e4db38bdbe HDFS-2181 Separate HDFS Client wire protocol data types (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179877 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 21:58:22 +00:00
Jitendra Nath Pandey
6f1d18bd47 HDFS-2409. _HOST in dfs.web.authentication.kerberos.principal. Incorporates HDFS-2405 as well. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179861 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 21:30:06 +00:00
Tsz-wo Sze
a2d7287873 HDFS-2403. NamenodeWebHdfsMethods.generateDelegationToken(..) does not use the renewer parameter. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179856 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 21:17:19 +00:00
Tsz-wo Sze
1b1016beeb HDFS-2395. Add a root element in the JSON responses of webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179169 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 11:29:05 +00:00
Todd Lipcon
93e0265af0 Fix CHANGES.txt to include complete subtask list for HDFS-1073. 
Somehow in the merge, some subtasks were lost from CHANGES.txt.
I spot-checked these patches to make sure they were in fact merged,
and it was only CHANGES.txt that was missing them.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178610 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-03 22:05:42 +00:00
Tsz-wo Sze
dc8464f943 HDFS-2348. Support getContentSummary and getFileChecksum in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177905 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-01 04:49:00 +00:00
Doug Cutting
f48280ac56 HDFS-2298. Fix TestDfsOverAvroRpc by changing ClientProtocol to not include multiple methods of the same name. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177757 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 18:01:27 +00:00
Jitendra Nath Pandey
1ae5b5e338 HDFS-2158. Add JournalSet to manage the set of journals. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177473 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 01:14:37 +00:00
Suresh Srinivas
e90a5b4043 HDFS-2371. Refactor BlockSender.java for better readability. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177161 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-29 04:40:15 +00:00
Suresh Srinivas
e9dd78d9fe HDFS-2355. Federation: enable using the same configuration file across all the nodes in the cluster. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177100 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 22:58:10 +00:00
Aaron Myers
484649acfe Removing entry for CHANGES.txt since this was back-ported to 0.23. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177020 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 19:01:32 +00:00
Aaron Myers
08db2a139d HDFS-2346. TestHost2NodesMap & TestReplicasMap will fail depending upon execution order of test methods (Laxman via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176994 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 18:06:26 +00:00
Tsz-wo Sze
96f9fc9199 HDFS-2363. Move datanodes size printing from FSNamesystem.metasave(..) to BlockManager. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176733 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 05:49:17 +00:00
Jitendra Nath Pandey
825f9c80a4 HDFS-2361. hftp is broken, fixed username checks in JspHelper. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176729 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 05:29:09 +00:00
Tsz-wo Sze
59265d6ed8 HDFS-2368. Move SPNEGO conf properties from hdfs-default.xml to hdfs-site.xml. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176719 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 04:51:29 +00:00
Todd Lipcon
eb3a692a57 HDFS-2332. Add test for HADOOP-7629 (using an immutable FsPermission object as an RPC parameter fails). Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176692 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 03:00:59 +00:00
Suresh Srinivas
201b7879ba HDFS-2373. Commands using webhdfs and hftp print unnecessary debug info on the console with security enabled. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176654 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-27 23:16:17 +00:00
Tsz-wo Sze
bf78f15ffb HDFS-2366. Initialize WebHdfsFileSystem.ugi in object construction. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176178 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-27 02:43:37 +00:00
Konstantin Shvachko
5a6f8e38c0 HDFS-2290. Block with corrupt replica is not getting replicated. Contributed by Benoy Antony. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175175 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-24 15:04:34 +00:00
Tsz-wo Sze
83a83d3b73 HDFS-2356. Support case insensitive query parameter names in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175113 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-24 06:15:50 +00:00
Tsz-wo Sze
d773bf0fb5 HDFS-46. Change default namespace quota of root directory from Integer.MAX_VALUE to Long.MAX_VALUE. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173990 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-22 08:25:20 +00:00
Sanjay Radia
7d8e9d6960 HADOOP-7524 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173488 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-21 04:25:55 +00:00
Tsz-wo Sze
4dc4e9e63f HDFS-2340. Support getFileBlockLocations and getDelegationToken in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173468 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-21 02:56:08 +00:00
Matthew Foley
9d14f100c8 HDFS-2347. Fix checkpointTxnCount's comment about editlog size. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172916 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-20 00:26:32 +00:00
Tsz-wo Sze
e34d2c075d HDFS-2330. In NNStorage and FSImagePreTransactionalStorageInspector, IOExceptions of stream closures can mask root exceptions. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172219 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-18 08:30:47 +00:00
Tsz-wo Sze
dafa8f7a77 HDFS-362. FSEditLog should not writes long and short as UTF8, and should not use ArrayWritable for writing non-array items. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171945 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-17 10:53:44 +00:00
Aaron Myers
a89d4609b2 HDFS-2337. DFSClient shouldn't keep multiple RPC proxy references (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171711 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-16 18:38:32 +00:00
Tsz-wo Sze
ff44372895 Revised the entry for HDFS-2318 in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171615 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-16 15:05:25 +00:00
Tsz-wo Sze
78e3821b81 HDFS-2318. Provide authentication to webhdfs using SPNEGO and delegation tokens. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171611 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-16 15:02:30 +00:00
Tsz-wo Sze
cde0e484e7 HDFS-2338. Add configuration option to enable/disable webhdfs. Contributed by jitendra 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171379 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-16 04:01:51 +00:00
Tsz-wo Sze
376a1a2511 HDFS-2333. Change DFSOutputStream back to package private, otherwise, there are two SC_START_IN_CTOR findbugs warnings. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171136 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-15 15:28:23 +00:00
Tsz-wo Sze
be2b0921fa HDFS-2331. Fix WebHdfsFileSystem compilation problems for a bug in JDK version < 1.6.0_26. Contributed by Abhijit Suresh Shingate 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170996 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-15 08:04:46 +00:00
Thomas White
e4dc2e1f56 HDFS-2323. start-dfs.sh script fails for tarball install 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170233 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-13 16:53:57 +00:00
Tsz-wo Sze
6c3b59505b HDFS-2317. Support read access to HDFS in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170085 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-13 08:34:27 +00:00
Tsz-wo Sze
61d0b7530c HDFS-2284. Add a new FileSystem, webhdfs://, for supporting write Http access to HDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167662 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-11 01:41:42 +00:00
Konstantin Shvachko
8b9a2c7487 HDFS-2232. Generalize regular expressions in TestHDFSCLI. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166470 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-07 23:37:56 +00:00
Todd Lipcon
06e84a1bca HDFS-2223. Untangle depencencies between NN components. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166466 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-07 23:23:24 +00:00
Todd Lipcon
42d443fb79 HDFS-2314. MRV1 test compilation broken after HDFS-2197. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165860 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 21:25:35 +00:00
Jitendra Nath Pandey
bdc3720d5b HDFS-2018. Move all journal stream management code into one place. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165826 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 20:27:38 +00:00
Aaron Myers
9e95326a2c HDFS-2313. Rat excludes has a typo for excluding editsStored files. (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165477 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 01:51:30 +00:00
Todd Lipcon
b0632df93a HDFS-2197. Refactor RPC call implementations out of NameNode class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165463 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 00:41:47 +00:00
Todd Lipcon
d1438b501d HDFS-2310. TestBackupNode fails since HADOOP-7524 went in. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165461 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 00:34:57 +00:00
Aaron Myers
8ae98a9d1c HDFS-1620. Rename HdfsConstants -> HdfsServerConstants, FSConstants -> HdfsConstants. (Harsh J Chouraria via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165096 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-04 19:30:12 +00:00
Sanjay Radia
b97a4d40c8 HADOOP-7524 and MapReduce-2887 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164771 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-03 00:31:05 +00:00
Aaron Myers
2566043c2f HDFS-2299. TestOfflineEditsViewer is failing on trunk. (Uma Maheswara Rao G via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164624 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-02 16:47:59 +00:00
Aaron Myers
c5ef34a1e7 Revert 1164192 given review feedback provided after initial commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164199 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 18:25:51 +00:00
Aaron Myers
d873f1155a HDFS-2299. TestOfflineEditsViewer is failing on trunk. (Uma Maheswara Rao G via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164192 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 18:07:38 +00:00
Konstantin Shvachko
4f1a0e36fa HDFS-2258. Reset lease limits to default values in TestLeaseRecovery2. Contributed by Konstantin Shvachko 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163821 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 21:18:37 +00:00
Matthew Foley
1cd3791172 HDFS-1330 and HADOOP-6889. Added additional unit tests. Contributed by John George. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163463 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 00:58:19 +00:00
Tsz-wo Sze
aba0e225fc HDFS-1217. Change some NameNode methods from public to package private. Constributed by Laxman 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163081 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-30 04:02:22 +00:00
Arun Murthy
8b56463315 HDFS-2289. Ensure jsvc is bundled with the HDFS distribution artifact. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162421 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-27 19:07:04 +00:00
Todd Lipcon
23e7fc4f46 HDFS-2287. TestParallelRead has a small off-by-one bug. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162005 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 06:51:57 +00:00
Todd Lipcon
7cf49f5d9c HDFS-2286. DataXceiverServer logs AsynchronousCloseException at shutdown. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162003 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 06:44:13 +00:00
Hairong Kuang
73451ed2d9 HDFS-395. DFS Scalability: Incremental block reports. Contributed by Tomasz Nykiel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161992 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 04:46:42 +00:00
Hairong Kuang
522fe14a89 Move change log for HDFS-395 from 0.23 section to trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161987 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 04:16:20 +00:00
Hairong Kuang
e6339be188 HDFS-349. DFS Scalability: Incremental block reports. Contributed by Tomasz Nykiel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161976 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 03:10:13 +00:00
Arun Murthy
a44ffcc0be Preparing for hadoop-0.24.0 development. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161736 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 20:32:04 +00:00
Arun Murthy
ee05510c42 Preparing for release 0.23.0 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161716 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 19:39:15 +00:00
Arun Murthy
cd7157784e HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161332 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 00:14:24 +00:00