big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,972 Commits 2 Branches 2 Tags 264 MiB
1734215a10
Commit Graph

1280 Commits

Author SHA1 Message Date
Eli Collins
e074b5816a HDFS-4061. TestBalancer and TestUnderReplicatedBlocks need timeouts. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399010 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 21:59:15 +00:00
Suresh Srinivas
0ef9c6f71a HDFS-4059. Add number of stale DataNodes to metrics. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398949 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 19:39:50 +00:00
Eli Collins
b245adb163 HDFS-3985. Add timeouts to TestMulitipleNNDataBlockScanner. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398874 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 16:29:21 +00:00
Suresh Srinivas
b7887f31fb HDFS-4052. BlockManager#invalidateWork should print log outside the lock. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398631 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 03:37:49 +00:00
Eli Collins
a75673cbd8 HDFS-4058. DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398612 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 02:12:59 +00:00
Aaron Myers
557ffe2101 HDFS-2946. HA: Put a cap on the number of completed edits files retained by the NN. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398609 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 01:59:46 +00:00
Aaron Myers
f5f763eb15 Update CHANGES.txt to have HDFS-3678 under release 2.0.3 instead of 3.0.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398603 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 01:31:26 +00:00
Todd Lipcon
ded304e6a6 HDFS-4049. Fix hflush performance regression due to nagling delays. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398591 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 00:55:29 +00:00
Tsz-wo Sze
698fa5077a HDFS-4036. Remove "throw UnresolvedLinkException" from FSDirectory.unprotectedAddFile(..). Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398293 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-15 14:05:31 +00:00
Tsz-wo Sze
ad06a08713 HDFS-4037. Rename the getReplication() method in BlockCollection to getBlockReplication(). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398288 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-15 13:48:56 +00:00
Jason Darrell Lowe
f8bdac0a1b HADOOP-8906. paths with multiple globs are unreliable. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397704 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 19:49:40 +00:00
Suresh Srinivas
89b66da42c HDFS-4044. Duplicate ChecksumType definition in HDFS .proto files. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397580 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 14:32:16 +00:00
Suresh Srinivas
94ed14c48c HADOOP-8911. CRLF characters in source and text files. Contributed Raja Aluri. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397432 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 04:35:42 +00:00
Suresh Srinivas
4e64e6f860 HDFS-4041. Hadoop HDFS Maven protoc calls must not depend on external sh script. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397362 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 23:10:47 +00:00
Todd Lipcon
7ca007b241 Merge CHANGES for HDFS-3077 into the main CHANGES.txt file 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397352 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 22:51:34 +00:00
Suresh Srinivas
2887bbb33c HDFS-3912. Detect and avoid stale datanodes for writes. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397211 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 18:08:27 +00:00
Todd Lipcon
ff8f84ccf6 Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1396918 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 06:14:26 +00:00
Suresh Srinivas
33c16f2a24 HADOOP-8913. hadoop-metrics2.properties should give units in comment for sampling period. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396904 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 05:17:03 +00:00
Aaron Myers
8078e16015 HDFS-4021. Misleading error message when resources are low on the NameNode. Contributed by Christopher Conner. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396881 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 00:32:46 +00:00
Jason Darrell Lowe
08f35a04c6 HDFS-3224. Bug in check for DN re-registration with different storage ID. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396798 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 21:15:06 +00:00
Eli Collins
c9a1d4dc33 HDFS-4020. TestRBWBlockInvalidation may time out. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396725 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 18:42:54 +00:00
Thomas Graves
a0a96eb142 HDFS-3824. TestHftpDelegationToken fails intermittently with JDK7 (Trevor Robinson via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396705 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 17:35:18 +00:00
Eli Collins
03c96ef29e HDFS-4018. TestDataNodeMultipleRegistrations#testMiniDFSClusterWithMultipleNN is missing some cluster cleanup. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395821 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 00:18:27 +00:00
Todd Lipcon
17b32bb2de HDFS-4007. Rehabilitate bit-rotted unit tests under hadoop-hdfs-project/hadoop-hdfs/src/test/unit/. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395731 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 19:19:21 +00:00
Todd Lipcon
70fc5cf01c HDFS-4017. Unclosed FileInputStream in GetJournalEditServlet. Contributed by Chao Shi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1395727 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 19:11:48 +00:00
Eli Collins
5dcdc8aa58 HDFS-4003. test-patch should build the common native libs before running hdfs tests. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395708 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 18:34:14 +00:00
Eli Collins
3a4cf1c064 HDFS-4008. TestBalancerWithEncryptedTransfer needs a timeout. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395700 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 18:11:53 +00:00
Eli Collins
5a5473b29f HDFS-4006. TestCheckpoint#testSecondaryHasVeryOutOfDateImage occasionally fails due to unexpected exit. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395387 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-07 21:35:51 +00:00
Eli Collins
e32af6034b HDFS-3682. MiniDFSCluster#init should provide more info when it fails. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395385 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-07 21:16:08 +00:00
Aaron Myers
353958dccc HDFS-3483. Better error message when hdfs fsck is run against a ViewFS config. Contributed by Stephen Fritz. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394864 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-06 00:13:28 +00:00
Thomas Graves
d35169d9ba HDFS-3829. TestHftpURLTimeouts fails intermittently with JDK7 (Trevor Robinson via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394609 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 15:51:10 +00:00
Suresh Srinivas
dfb8369c29 HDFS-3735. NameNode WebUI should allow sorting live datanode list by fields Block Pool Used, Block Pool Used(%) and Failed Volumes. Contributed by Brahma Reddy Battula. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394385 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 07:02:52 +00:00
Suresh Srinivas
a41f808c3c HDFS-3995. Use DFSTestUtil.createFile() for file creation and writing in test cases. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394376 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 06:22:26 +00:00
Aaron Myers
6582da034b HDFS-3813. Log error message if security and WebHDFS are enabled but principal/keytab are not configured. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394340 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 00:54:05 +00:00
Alejandro Abdelnur
016b86867b HDFS-3999. HttpFS OPEN operation expects len parameter, it should be length. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394169 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 17:45:42 +00:00
Eli Collins
ee13fb4f69 HDFS-3916. libwebhdfs (C client) code cleanups. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393890 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 02:53:28 +00:00
Eli Collins
38943644e0 HDFS-4000. TestParallelLocalRead fails with "input ByteBuffers must be direct buffers". Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393884 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 02:41:04 +00:00
Eli Collins
2c66a9f5ae HDFS-2127. Add a test that ensure AccessControlExceptions contain a full path. Contributed by Stephen Chu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393878 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 02:06:56 +00:00
Todd Lipcon
10a0eaaf0a HDFS-4004. TestJournalNode#testJournal fails because of test case execution order. Contributed by Chao Shi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1393870 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 01:40:12 +00:00
Eli Collins
5c19b6b7b6 Amend HDFS-3753 to ignore TestHdfsNativeCodeLoader. To be fixed in HDFS-4003. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393830 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 23:38:08 +00:00
Eli Collins
43ae84761f HDFS-3996. Add debug log removed in HDFS-3873 back. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393777 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 21:30:45 +00:00
Eli Collins
f8f79a02aa HDFS-3753. Tests don't run with native libraries. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393113 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-02 19:13:53 +00:00
Robert Joseph Evans
af647bb3ce Preparing for release 0.23.4 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391805 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 14:15:39 +00:00
Harsh J
34becbb019 HADOOP-8386. hadoop script doesn't work if 'cd' prints to stdout (default behavior in Ubuntu). Contributed by Christopher Berner and Andy Isaacson. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391780 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 10:57:53 +00:00
Aaron Myers
648ba4a36b HDFS-3992. Method org.apache.hadoop.hdfs.TestHftpFileSystem.tearDown() sometimes throws NPEs. Contributed by Ivan A. Veselovsky. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391763 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 07:30:45 +00:00
Aaron Myers
e8dc3b3a8a HDFS-3896. Add descriptions for dfs.namenode.rpc-address and dfs.namenode.servicerpc-address to hdfs-default.xml. Contributed by Jeff Lord. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391708 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 00:51:48 +00:00
Todd Lipcon
802ccafcd9 Fix some spurious whitespace changes in branch (per Suresh's review) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1391247 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 22:37:58 +00:00
Robert Joseph Evans
01c0dc98bb HDFS-3831. Failure to renew tokens due to test-sources left in classpath (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391121 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 17:31:48 +00:00
Eli Collins
a33ae4020d HADOOP-8855. SSL-based image transfer does not work when Kerberos is disabled. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390841 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 05:03:42 +00:00
Eli Collins
47dfcf45af HDFS-3972. Trash emptier fails in secure HA cluster. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390729 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 21:25:04 +00:00
Tsz-wo Sze
a7bcdcc051 HDFS-3373. Change DFSClient input stream socket cache to global static and add a thread to cleanup expired cache entries. Contributed by John George 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390466 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 13:23:21 +00:00
Todd Lipcon
b1ceaac3e6 Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1390199 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 22:43:04 +00:00
Suresh Srinivas
248756eac6 Moving HDFS-234 from trunk to Release 2.0.0-alpha section 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389494 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-24 17:44:32 +00:00
Harsh J
9c9b3f09ed HADOOP-8158. Interrupting hadoop fs -put from the command line causes a LeaseExpiredException. Contributed by Daryn Sharp. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389010 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-23 10:50:44 +00:00
Harsh J
bd76d9a827 HADOOP-8833. fs -text should make sure to call inputstream.seek(0) before using input stream. Contributed by Tom White and Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388869 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-22 18:56:07 +00:00
Eli Collins
fa6d519657 HDFS-3964. Make NN log of fs.defaultFS debug rather than info. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388335 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 06:17:29 +00:00
Eli Collins
3ea3508319 HDFS-3931. TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388331 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 05:48:42 +00:00
Eli Collins
7dee7f11f6 HDFS-3932. NameNode Web UI broken if the rpc-address is set to the wildcard. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388321 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 04:51:43 +00:00
Eli Collins
d26f05b7f5 HDFS-3949. NameNodeRpcServer#join should join on both client and server RPC servers. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387838 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-20 01:33:13 +00:00
Todd Lipcon
8a3e64c77f HDFS-3956. QJM: purge temporary files when no longer within retention period. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387817 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 23:40:59 +00:00
Todd Lipcon
f26c63df21 Amend HFDS-3955. Forgot an import of ImmutableList in previous patch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387740 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 20:24:12 +00:00
Todd Lipcon
3ccd905d8a HDFS-3955. QJM: Make acceptRecovery() atomic. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387706 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 18:57:11 +00:00
Todd Lipcon
663e7484c0 HDFS-3950. QJM: misc TODO cleanup, improved log messages, etc. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387704 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 18:52:15 +00:00
Alejandro Abdelnur
8bf6b80f2b Reverting HADOOP-8805 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387697 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 18:06:42 +00:00
Alejandro Abdelnur
7fb42f8f4b HDFS-3951. datanode web ui does not work over HTTPS when datanode is started in secure mode. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387688 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 17:39:46 +00:00
Todd Lipcon
e9f4de5ced Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387449 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 04:34:55 +00:00
Alejandro Abdelnur
9f6cfe32e4 HADOOP-8805. Move protocol buffer implementation of GetUserMappingProtocol from HDFS to Common. (bowang via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387298 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 18:15:37 +00:00
Eli Collins
a8e4bb81b2 HDFS-3939. NN RPC address cleanup. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387278 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 17:42:09 +00:00
Eli Collins
ea6a36e2e7 HADOOP-8812. ExitUtil#terminate should print Exception#toString. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387273 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 17:32:01 +00:00
Eli Collins
7e3776ca6e HDFS-3936. MiniDFSCluster shutdown races with BlocksMap usage. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387255 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 16:59:47 +00:00
Alejandro Abdelnur
c419b1385d HDFS-3944. Httpfs resolveAuthority() is not resolving host correctly. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386994 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 05:45:57 +00:00
Todd Lipcon
83c14fbd24 HDFS-3943. QJM: remove currently-unused md5sum field. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1386863 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 21:51:40 +00:00
Eli Collins
4d2e77bc1c Revert previous commit - accidentally included two changes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386783 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 19:28:14 +00:00
Eli Collins
8a9debd0ef HADOOP-8806. libhadoop.so: dlopen should be better at locating libsnappy.so, etc. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386780 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 19:25:05 +00:00
Alejandro Abdelnur
0de9642514 HDFS-3938. remove current limitations from HttpFS docs. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384842 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-14 16:28:47 +00:00
Thomas White
d89828573d HADOOP-8780. Update DeprecatedProperties apt file. Contributed by Ahmed Radwan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384833 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-14 16:05:30 +00:00
Aaron Myers
d8e386f01a HADOOP-8755. Print thread dump when tests fail due to timeout. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384627 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-14 01:44:23 +00:00
Aaron Myers
86635168fe HDFS-3924. Multi-byte id in HdfsVolumeId. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384602 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-13 23:48:25 +00:00
Aaron Myers
853db9ec24 HDFS-3926. QJM: Add user documentation for QJM. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1384595 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-13 23:02:32 +00:00
Todd Lipcon
40d56f1741 HDFS-3894. QJM: testRecoverAfterDoubleFailures can be flaky due to IPC client caching. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1384592 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-13 23:00:22 +00:00
Suresh Srinivas
d543140089 HDFS-3703. Datanodes are marked stale if heartbeat is not received in configured timeout and are selected as the last location to read from. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384209 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-13 05:46:18 +00:00
Eli Collins
4f312cfa70 HDFS-3928. MiniDFSCluster should reset the first ExitException on shutdown. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384092 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 19:15:38 +00:00
Eli Collins
2ba149f85c HDFS-3902. TestDatanodeBlockScanner#testBlockCorruptionPolicy is broken. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384081 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 18:36:01 +00:00
Todd Lipcon
80a8d57ffc HDFS-3925. Prettify PipelineAck#toString() for printing to a log. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384078 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 18:32:57 +00:00
Eli Collins
f0c3ed79dd HDFS-3919. MiniDFSCluster:waitClusterUp can hang forever. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383759 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 04:21:31 +00:00
Eli Collins
414abe6918 HDFS-3664. BlockManager race when stopping active services. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383753 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 04:10:58 +00:00
Eli Collins
dc1fd84bd1 HDFS-3910. DFSTestUtil#waitReplication should timeout. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383618 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 21:24:12 +00:00
Todd Lipcon
a93ba1648a HDFS-3840. JournalNodes log JournalNotFormattedException backtrace error before being formatted. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383252 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 06:33:47 +00:00
Todd Lipcon
8a8c9c18d3 HDFS-3906. QJM: quorum timeout on failover with large log segment. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383251 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 06:31:42 +00:00
Todd Lipcon
c859e87d1e HDFS-3915. QJM: Failover fails with auth error in secure cluster. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383242 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 04:53:08 +00:00
Todd Lipcon
c5199cace6 HDFS-3914. QJM: acceptRecovery should abort current segment. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383148 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 23:20:49 +00:00
Todd Lipcon
729ec86907 HDFS-3899. Add client side metrics for QJM. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383139 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 22:39:46 +00:00
Todd Lipcon
959afc0fd3 HDFS-3901. QJM: send 'heartbeat' messages to JNs even when they are out-of-sync. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383137 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 22:30:52 +00:00
Todd Lipcon
60c20e559b HDFS-3900. QJM: avoid validating log segments on log rolls. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383041 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:53:41 +00:00
Todd Lipcon
ca4582222e HDFS-3885. QJM: optimize log sync when JN is lagging behind. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383039 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:51:15 +00:00
Todd Lipcon
aa65777ef0 HDFS-3898. QJM: enable TCP_NODELAY for IPC. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383033 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:46:58 +00:00
Eli Collins
e1ffefa860 HDFS-3907. Allow multiple users for local block readers. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383031 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:46:13 +00:00
Todd Lipcon
1cea56d6ef Merge trunk into QJM branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383030 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 18:45:45 +00:00
Tsz-wo Sze
009235f4a9 HDFS-2656. Add libwebhdfs, a pure C client based on WebHDFS. Contributed by Jaimin D Jetly and Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382836 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-10 13:43:28 +00:00
Eli Collins
3a4dcfba57 HDFS-2757. Cannot read a local block that's being written to when using the local read short circuit. Contributed by Jean-Daniel Cryans 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382409 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-09 06:37:31 +00:00