big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,030 Commits 2 Branches 2 Tags 264 MiB
7e4bd89590
Commit Graph

132 Commits

Author SHA1 Message Date
Konstantin Shvachko
7e4bd89590 HDFS-2886. CreateEditLogs should generate a realistic edit log. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241296 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 00:44:27 +00:00
Suresh Srinivas
2a9e430ff9 HDS-2895. Remove Writable wire protocol types and translators to complete transition to protocol buffers. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241007 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 13:33:35 +00:00
Harsh J
da7b0d90c6 HDFS-2868. Expose xceiver counts via the DataNode MXBean. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240897 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 05:25:12 +00:00
Tsz-wo Sze
38ad4b5036 HDFS-2879. Change FSDataset to package private. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240020 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-03 07:26:02 +00:00
Jitendra Nath Pandey
9eb8f4d267 HDFS-2784. Update hftp and hdfs for host-based token support. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239763 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 19:04:40 +00:00
Konstantin Shvachko
191db6a907 HDFS-2718. Optimize OP_ADD in edits loading. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239760 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 18:57:49 +00:00
Jitendra Nath Pandey
c909aedbc1 HDFS-2814 NamenodeMXBean does not account for svn revision in the version information. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239464 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 05:31:46 +00:00
Tsz-wo Sze
dbbfaebb71 HDFS-2864. Remove some redundant methods and the constant METADATA_VERSION from FSDataset. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238969 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 07:46:50 +00:00
Tsz-wo Sze
8dfef7d2dc HDFS-2827. When the parent of a directory is the root, renaming the directory results in leases updated incorrectly. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238700 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 17:36:42 +00:00
Jitendra Nath Pandey
98302971c2 HDFS-2801. Provide a method in client side translators to check for a methods supported in underlying protocol. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237192 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-29 02:01:24 +00:00
Aaron Myers
976c07696d HDFS-2759. Pre-allocate HDFS edit log files after writing version number. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237153 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 20:26:13 +00:00
Todd Lipcon
da91e0d427 HDFS-2791. If block report races with closing of file, replica is incorrectly marked corrupt. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236945 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 00:42:34 +00:00
Harsh J
7c69883917 HDFS-442. dfsthroughput in test jar throws NPE (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235137 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 06:10:28 +00:00
Eli Collins
5dfe62d845 HDFS-2397. Undeprecate SecondaryNameNode. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235135 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 06:05:52 +00:00
Todd Lipcon
1525aae4b3 HDFS-2826. Add test case for HDFS-1476 (safemode can initialize replication queues before exiting) (todd) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235067 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 23:42:17 +00:00
Todd Lipcon
c0016ba85f HDFS-2825. Add test hook to turn off the writer preferring its local DN. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235025 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 22:07:49 +00:00
Todd Lipcon
12645ff6c0 HDFS-2822. processMisReplicatedBlock incorrectly identifies under-construction blocks as under-replicated. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234925 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 18:11:09 +00:00
Todd Lipcon
c840548d6b HDFS-2817. Combine the two TestSafeMode test suites. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234221 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-21 00:42:35 +00:00
Todd Lipcon
520a39ac2d HDFS-2810. Leases not getting renewed properly by clients. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233794 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-20 07:26:19 +00:00
Aaron Myers
a7195bdd14 HDFS-2765. TestNameEditsConfigs is incorrectly swallowing IOE. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229028 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-09 04:53:20 +00:00
Suresh Srinivas
472e971891 HDFS-2710. Add HDFS tests related to HADOOP-7933. Contributed by Siddarth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227756 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 18:57:01 +00:00
Harsh J
075122690c HDFS-1314. Make dfs.blocksize accept size-indicating prefixes (Sho Shimauchi via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227165 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 14:15:15 +00:00
Eli Collins
5e185702ea HDFS-2335. DataNodeCluster and NNStorage always pull fresh entropy. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220510 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-18 18:12:48 +00:00
Suresh Srinivas
95bdb29aaf r1214102 should have removed the file. Committing this to remove empty file. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214103 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 08:25:47 +00:00
Suresh Srinivas
60dd76c6ab HDFS-2676. Remove Avro RPC. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214102 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 08:20:23 +00:00
Jitendra Nath Pandey
3cffe34177 HDFS-2661. Enable protobuf RPC for DatanodeProtocol. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214033 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 02:15:37 +00:00
Tsz-wo Sze
433a6e78f6 HDFS-2545. Change WebHDFS to support multiple namenodes in federation. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214027 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 01:47:57 +00:00
Suresh Srinivas
6a609cb471 Reverting the patch r1213981 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213984 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:27:58 +00:00
Suresh Srinivas
b5229fd19b HDFS-2663. Optional protobuf parameters are not handled correctly. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213981 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:22:28 +00:00
Suresh Srinivas
3001a172c8 Reverting r1213512 because it committed changes that were not part of the patch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213980 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:17:02 +00:00
Eli Collins
43100e9c0e HDFS-1765. Block Replication should respect under-replication block priority. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213537 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 01:58:25 +00:00
Suresh Srinivas
13345f3a85 HDFS-2663. Handle protobuf optional parameters correctly. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213512 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 00:21:48 +00:00
Sanjay Radia
48da033901 HDFS-2651 ClientNameNodeProtocol Translators for Protocol Buffers (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213143 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 05:36:35 +00:00
Suresh Srinivas
2740112bb6 HDFS-2647. Used protobuf based RPC for InterDatanodeProtocol, ClientDatanodeProtocol, JournalProtocol, NamenodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213040 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-11 18:53:21 +00:00
Jitendra Nath Pandey
38a19bc293 HDFS-2642. Protobuf translators for DatanodeProtocol. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212606 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 20:02:33 +00:00
Tsz-wo Sze
9b1f47226b HDFS-2594. Support getDelegationTokens and createSymlink in WebHDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212299 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 09:26:33 +00:00
Aaron Myers
a27adf3de4 HDFS-2430. The number of failed or low-resource volumes the NN can tolerate should be configurable. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211650 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-07 21:47:13 +00:00
Suresh Srinivas
c17bb83644 HDFS-2636. Implement protobuf service for ClientDatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211249 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-07 01:05:56 +00:00
Suresh Srinivas
7a59150bff HDFS-2629. Implement protobuf service for InterDatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211206 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 22:19:10 +00:00
Jitendra Nath Pandey
b981daa07f HDFS-1580. Committing the test case, it was missed in earlier commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210749 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 02:15:56 +00:00
Suresh Srinivas
0a713035f2 HDFS-2618. Implement protobuf service for NamenodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210719 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 00:25:25 +00:00
Suresh Srinivas
c256f8266d HDFS-2581. Implement protobuf service for JournalProtocol. Contributed Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210657 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 21:52:23 +00:00
Sanjay Radia
65200998c0 HADOOP-7862 Move the support for multiple protocols to lower layer so that Writable, PB and Avro can all use it (includes HDFS and MR changes to match) (Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210208 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-04 20:44:36 +00:00
Tsz-wo Sze
0398a9e88d HDFS-2604. Add a log message to show if WebHDFS is enabled and a configuration section in the forrest doc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208140 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 23:38:59 +00:00
Konstantin Shvachko
68f56ca906 HDFS-2287. Fix second assert. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207710 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 00:03:49 +00:00
Eli Collins
b32543d9ae HDFS-2596. TestDirectoryScanner doesn't test parallel scans. (eli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207694 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 23:20:16 +00:00
Tsz-wo Sze
2ab10e29d9 HDFS-2246. Enable reading a block directly from local file system for a client on the same node as the block file. Contributed by Andrew Purtell, Suresh Srinivas and Jitendra Nath Pandey 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204792 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 02:57:04 +00:00
Konstantin Boudnik
a2e66776a9 HDFS-2573. TestFiDataXceiverServer is failing, not testing OOME. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204781 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 02:15:49 +00:00
Suresh Srinivas
5293760973 HDFS-2410. Further cleanup of hardcoded configuration keys and values. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204753 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 23:49:44 +00:00
Todd Lipcon
39ce694d05 HDFS-2566. Move BPOfferService to be a non-inner class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204659 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 19:27:00 +00:00