big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,946 Commits 2 Branches 2 Tags 264 MiB
07e0d7730d
Commit Graph

923 Commits

Author SHA1 Message Date
Tsz-wo Sze
a7bcdcc051 HDFS-3373. Change DFSClient input stream socket cache to global static and add a thread to cleanup expired cache entries. Contributed by John George 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390466 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 13:23:21 +00:00
Todd Lipcon
b1ceaac3e6 Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1390199 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 22:43:04 +00:00
Harsh J
9c9b3f09ed HADOOP-8158. Interrupting hadoop fs -put from the command line causes a LeaseExpiredException. Contributed by Daryn Sharp. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389010 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-23 10:50:44 +00:00
Eli Collins
fa6d519657 HDFS-3964. Make NN log of fs.defaultFS debug rather than info. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388335 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 06:17:29 +00:00
Eli Collins
7dee7f11f6 HDFS-3932. NameNode Web UI broken if the rpc-address is set to the wildcard. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388321 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 04:51:43 +00:00
Eli Collins
d26f05b7f5 HDFS-3949. NameNodeRpcServer#join should join on both client and server RPC servers. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387838 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-20 01:33:13 +00:00
Todd Lipcon
8a3e64c77f HDFS-3956. QJM: purge temporary files when no longer within retention period. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387817 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 23:40:59 +00:00
Todd Lipcon
f26c63df21 Amend HFDS-3955. Forgot an import of ImmutableList in previous patch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387740 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 20:24:12 +00:00
Todd Lipcon
3ccd905d8a HDFS-3955. QJM: Make acceptRecovery() atomic. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387706 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 18:57:11 +00:00
Todd Lipcon
663e7484c0 HDFS-3950. QJM: misc TODO cleanup, improved log messages, etc. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387704 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 18:52:15 +00:00
Alejandro Abdelnur
8bf6b80f2b Reverting HADOOP-8805 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387697 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 18:06:42 +00:00
Alejandro Abdelnur
7fb42f8f4b HDFS-3951. datanode web ui does not work over HTTPS when datanode is started in secure mode. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387688 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 17:39:46 +00:00
Todd Lipcon
e9f4de5ced Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387449 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 04:34:55 +00:00
Alejandro Abdelnur
9f6cfe32e4 HADOOP-8805. Move protocol buffer implementation of GetUserMappingProtocol from HDFS to Common. (bowang via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387298 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 18:15:37 +00:00
Eli Collins
a8e4bb81b2 HDFS-3939. NN RPC address cleanup. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387278 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 17:42:09 +00:00
Eli Collins
7e3776ca6e HDFS-3936. MiniDFSCluster shutdown races with BlocksMap usage. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387255 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 16:59:47 +00:00
Todd Lipcon
83c14fbd24 HDFS-3943. QJM: remove currently-unused md5sum field. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1386863 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 21:51:40 +00:00
Thomas White
d89828573d HADOOP-8780. Update DeprecatedProperties apt file. Contributed by Ahmed Radwan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384833 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-14 16:05:30 +00:00
Aaron Myers
86635168fe HDFS-3924. Multi-byte id in HdfsVolumeId. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384602 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-13 23:48:25 +00:00
Suresh Srinivas
d543140089 HDFS-3703. Datanodes are marked stale if heartbeat is not received in configured timeout and are selected as the last location to read from. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384209 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-13 05:46:18 +00:00
Eli Collins
2ba149f85c HDFS-3902. TestDatanodeBlockScanner#testBlockCorruptionPolicy is broken. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384081 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 18:36:01 +00:00
Todd Lipcon
80a8d57ffc HDFS-3925. Prettify PipelineAck#toString() for printing to a log. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384078 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 18:32:57 +00:00
Eli Collins
414abe6918 HDFS-3664. BlockManager race when stopping active services. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383753 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 04:10:58 +00:00
Todd Lipcon
a93ba1648a HDFS-3840. JournalNodes log JournalNotFormattedException backtrace error before being formatted. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383252 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 06:33:47 +00:00
Todd Lipcon
8a8c9c18d3 HDFS-3906. QJM: quorum timeout on failover with large log segment. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383251 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 06:31:42 +00:00
Todd Lipcon
c859e87d1e HDFS-3915. QJM: Failover fails with auth error in secure cluster. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383242 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 04:53:08 +00:00
Todd Lipcon
c5199cace6 HDFS-3914. QJM: acceptRecovery should abort current segment. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383148 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 23:20:49 +00:00
Todd Lipcon
729ec86907 HDFS-3899. Add client side metrics for QJM. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383139 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 22:39:46 +00:00
Todd Lipcon
959afc0fd3 HDFS-3901. QJM: send 'heartbeat' messages to JNs even when they are out-of-sync. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383137 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 22:30:52 +00:00
Todd Lipcon
60c20e559b HDFS-3900. QJM: avoid validating log segments on log rolls. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383041 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:53:41 +00:00
Todd Lipcon
ca4582222e HDFS-3885. QJM: optimize log sync when JN is lagging behind. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383039 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:51:15 +00:00
Todd Lipcon
aa65777ef0 HDFS-3898. QJM: enable TCP_NODELAY for IPC. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383033 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:46:58 +00:00
Eli Collins
e1ffefa860 HDFS-3907. Allow multiple users for local block readers. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383031 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:46:13 +00:00
Todd Lipcon
1cea56d6ef Merge trunk into QJM branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383030 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:45:45 +00:00
Eli Collins
3a4dcfba57 HDFS-2757. Cannot read a local block that's being written to when using the local read short circuit. Contributed by Jean-Daniel Cryans 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382409 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-09 06:37:31 +00:00
Aaron Myers
df801074c9 HDFS-3893. QJM: Make QJM work with security enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381770 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 21:42:14 +00:00
Todd Lipcon
8b88542f60 Amend HDFS-3726. Add previously missing file JournalOutOfSyncException.java 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381681 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 16:59:51 +00:00
Daryn Sharp
82b981cca4 HDFS-3890. filecontext mkdirs doesn't apply umask as expected (Tom Graves via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381606 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 14:06:58 +00:00
Todd Lipcon
cae8116a14 HDFS-3726. If a logger misses an RPC, don't retry that logger until next segment. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381482 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 07:03:57 +00:00
Todd Lipcon
437948ea1c HDFS-3891. Make selectInputStreams throw IOE instead of RTE. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381481 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 06:57:18 +00:00
Eli Collins
01db4d2bb2 HDFS-3828. Block Scanner rescans blocks too frequently. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381472 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 06:19:30 +00:00
Todd Lipcon
99ec5bd8d3 Merge trunk into QJM branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380990 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:57:47 +00:00
Todd Lipcon
31142aa892 HDFS-1490. TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380988 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:53:15 +00:00
Todd Lipcon
c334cc89a8 HDFS-2793. Add an admin command to trigger an edit log roll. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380982 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:40:23 +00:00
Todd Lipcon
13daca1ef6 HDFS-3870. Add metrics to JournalNode. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380980 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:30:51 +00:00
Todd Lipcon
f6b7f067c3 HDFS-3884. Journal format() should reset cached values. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380979 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:27:49 +00:00
Todd Lipcon
72485f3112 HDFS-3869. Expose non-file journal manager details in web UI. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380978 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:16:02 +00:00
Todd Lipcon
8021d9199f HDFS-3863. Track last "committed" txid in QJM. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380976 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 04:13:19 +00:00
Tsz-wo Sze
658e7b5818 HDFS-3888. Clean up BlockPlacementPolicyDefault. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380939 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-04 23:56:10 +00:00
Tsz-wo Sze
f3927595cc HDFS-3887. Remove redundant chooseTarget methods in BlockPlacementPolicy. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380934 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-04 23:48:01 +00:00
Uma Maheswara Rao G
3969bcb7c9 HDFS-3469. start-dfs.sh will start zkfc, but stop-dfs.sh will not stop zkfc similarly. Contributed by Vinay 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380003 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-02 16:20:13 +00:00
Suresh Srinivas
da3bd67138 HDFS-3880. Use Builder to build RPC server in HDFS. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379917 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-02 06:20:41 +00:00
Harsh J
54e612bfb9 HDFS-2580. NameNode#main(...) can make use of GenericOptionsParser. Contributed by harsh. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379828 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-01 19:22:11 +00:00
Tsz-wo Sze
50222ff529 HDFS-3871. Change NameNodeProxies to use RetryUtils. Contributed by Arun C Murthy 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379743 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-01 11:41:15 +00:00
Eli Collins
6f5ae49063 HDFS-3877. QJM: Provide defaults for dfs.journalnode.*address. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1379681 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-01 00:35:19 +00:00
Owen O'Malley
c76a7893f9 HDFS-3466. Get HTTP kerberos principal from the web authentication keytab. 
(omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379646 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 22:31:03 +00:00
Daryn Sharp
3819c964fa HDFS-3873. Hftp assumes security is disabled if token fetch fails (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379615 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 21:24:48 +00:00
Eli Collins
7d1c8d92f9 HDFS-3733. Audit logs should include WebHDFS access. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379278 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 04:08:23 +00:00
Daryn Sharp
bb64f860eb HDFS-3861. Deadlock in DFSClient (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379093 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 19:46:14 +00:00
Aaron Myers
b2d186d865 HDFS-3864. NN does not update internal file mtime for OP_CLOSE when reading from the edit log. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378413 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-29 01:19:07 +00:00
Aaron Myers
d4d2bf73a9 HDFS-3849. When re-loading the FSImage, we should clear the existing genStamp and leases. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378364 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 22:09:27 +00:00
Aaron Myers
8d724dd8b9 HDFS-3860. HeartbeatManager#Monitor may wrongly hold the writelock of namesystem. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378228 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 17:01:38 +00:00
Eli Collins
b29cb2d997 HDFS-3856. TestHDFSServerPorts failure is causing surefire fork failure. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377934 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 01:41:13 +00:00
Todd Lipcon
1e68d4726b HDFS-3845. Fixes for edge cases in QJM recovery protocol. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1377809 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-27 19:55:01 +00:00
Suresh Srinivas
735046ebec HDFS-3851. DFSOutputStream class code cleanup. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377372 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-26 04:00:26 +00:00
Aaron Myers
56285e1bee HDFS-3683. Edit log replay progress indicator shows >100% complete. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377367 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-26 00:31:12 +00:00
Suresh Srinivas
deead78e35 HDFS-3844. Add @Override and remove {@inheritdoc} and unnecessary imports. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377168 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-25 01:03:22 +00:00
Eli Collins
a11042365f HDFS-3731. 2.0 release upgrade must handle blocks being written from 1.0. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377137 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 22:10:38 +00:00
Aaron Myers
a8ff292669 Merge trunk into HDFS-3077 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1377092 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 20:38:08 +00:00
Aaron Myers
92cb6b093c HDFS-3678. Edit log files are never being purged from 2NN. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377046 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 18:52:59 +00:00
Tsz-wo Sze
c46de830da HDFS-3177. Update DFSClient and DataXceiver to handle different checkum types in file checksum computation. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376928 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 14:15:14 +00:00
Eli Collins
c10a73350e Revert HDFS-3837. Fix DataNode.recoverBlock findbugs warning. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376701 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 21:08:19 +00:00
Aaron Myers
de8b34a70e HDFS-3835. Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376188 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 18:47:07 +00:00
Jitendra Nath Pandey
901b1739c6 HDFS-3819. Should check whether invalidate work percentage default value is not greater than 1.0f. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376185 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 18:44:44 +00:00
Suresh Srinivas
380870d544 HDFS-3832. Remove protocol methods related to DistributedUpgrade. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376139 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 16:59:50 +00:00
Eli Collins
89e16be81b HDFS-3837. Fix DataNode.recoverBlock findbugs warning. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376129 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 16:26:50 +00:00
Eli Collins
2b030c6a4a HDFS-3830. test_libhdfs_threaded: use forceNewInstance. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376121 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 16:19:27 +00:00
Suresh Srinivas
a99cfe3ca0 HDFS-3817. Avoid printing SafeModeException stack trace in RPC server. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376054 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 13:59:40 +00:00
Suresh Srinivas
6c0ccb5989 HDFS-2686. Remove DistributedUpgrade related code. Contributed by Suresh Srinivas 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375800 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 21:18:40 +00:00
Tsz-wo Sze
f2dd818201 HADOOP-8239. Add subclasses of MD5MD5CRC32FileChecksum to support file checksum with CRC32C. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375450 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 09:44:46 +00:00
Eli Collins
a6262430ff HDFS-2727. libhdfs should get the default block size from the server. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375383 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 03:48:00 +00:00
Aaron Myers
f9a0d78ef5 HDFS-3826. QJM: Some trivial logging / exception text improvements. Contributed by Todd Lipcon and Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1375356 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 00:48:06 +00:00
Aaron Myers
643608ea57 HDFS-3823. QJM: TestQJMWithFaults fails occasionally because of missed setting of HTTP port. Contributed by Todd Lipcon and Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1375323 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-20 23:44:14 +00:00
Tsz-wo Sze
b0ea77303b HADOOP-8240. Add a new API to allow users to specify a checksum type on FileSystem.create(..). Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374696 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-19 05:46:57 +00:00
Suresh Srinivas
086c855198 HDFS-3816. Invalidate work percentage default value should be 0.32f. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374645 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-18 19:50:15 +00:00
Eli Collins
18c5bc86ca HADOOP-8689. Make trash a server side configuration option. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374472 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 23:22:17 +00:00
Aaron Myers
fccace6116 HDFS-3672. Expose disk-location information for blocks to enable better scheduling. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374355 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 16:52:07 +00:00
Daryn Sharp
8fa10b184e HADOOP-7967. Need generalized multi-token filesystem support (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374271 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 14:05:11 +00:00
Tsz-wo Sze
ffbadbdd36 HDFS-2421. Improve the concurrency of SerialNumberMap in NameNode. Contributed by Jing Zhao and Weiyan Wang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374127 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 01:54:16 +00:00
Tsz-wo Sze
87d87b04e6 HDFS-3788. ByteRangeInputStream should not expect HTTP Content-Length header when chunked transfer-encoding is used. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374122 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 01:42:35 +00:00
Aaron Myers
bbe4584ebf HDFS-3808. fuse_dfs: postpone libhdfs intialization until after fork. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374106 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 23:47:33 +00:00
Eli Collins
cf93dfba4e HDFS-2963. Console Output is confusing while executing metasave (dfsadmin command). Contributed by Andrew Wang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374040 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 20:35:50 +00:00
Eli Collins
4524655afd HDFS-3194. DataNode block scanner is running too frequently. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373928 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 17:13:13 +00:00
Tsz-wo Sze
3cab01ba6e HADOOP-8700. Use enum to define the checksum constants in DataChecksum. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373683 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 01:32:10 +00:00
Eli Collins
f75deca0f9 HDFS-3048. Small race in BlockManager#close. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373664 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 22:43:01 +00:00
Todd Lipcon
d5abe22844 Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373573 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 19:04:24 +00:00
Todd Lipcon
42cdc1b083 HDFS-3797. QJM: add segment txid as a parameter to journal() RPC. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373571 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 18:58:51 +00:00
Todd Lipcon
89153a9c68 HDFS-3796. Speed up edit log tests by avoiding fsync(). Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373567 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 18:53:13 +00:00
Tsz-wo Sze
9dff7876d9 HDFS-3802. StartupOption.name in HdfsServerConstants should be final. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373253 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 08:07:29 +00:00
Tsz-wo Sze
f41497c141 HDFS-3794. WebHDFS OPEN returns the incorrect Content-Length in the HTTP header when offset is specified and length is omitted. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373193 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 02:23:21 +00:00