big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,379 Commits 2 Branches 2 Tags 264 MiB
ae9014ef6a
Commit Graph

277 Commits

Author SHA1 Message Date
Aaron Myers
ae9014ef6a Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293742 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-26 04:57:17 +00:00
Aaron Myers
b57260f848 HDFS-2978. The NameNode should expose name dir statuses via JMX. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293707 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-25 22:14:53 +00:00
Tsz-wo Sze
dacbeb5f67 HDFS-3006. In WebHDFS, when the return body is empty, set the Content-Type to application/octet-stream instead of application/json. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293487 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-25 00:15:37 +00:00
Todd Lipcon
481f84597b HDFS-2904. Client support for getting delegation tokens. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293486 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-25 00:03:26 +00:00
Suresh Srinivas
5293e5d1c5 HDFS-3002. TestNameNodeMetrics need not wait for metrics update. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293482 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 23:52:20 +00:00
Aaron Myers
62c7e2edfc HDFS-3003. Remove getHostPortString() from NameNode, replace it with NetUtils.getHostPortString(). Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293338 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 17:03:17 +00:00
Aaron Myers
f3026e1085 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292838 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 16:06:53 +00:00
Todd Lipcon
90a14f89e1 HDFS-2973. Re-enable NO_ACK optimization for block deletion. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292611 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 01:25:14 +00:00
Todd Lipcon
475db83b87 HDFS-2985. Improve logging when replicas are marked as corrupt. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292609 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 01:16:33 +00:00
Todd Lipcon
c14912785d HDFS-2929. Stress test and fixes for block synchronization. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292494 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-22 20:31:52 +00:00
Tsz-wo Sze
efbc58f30c HDFS-2907. Add a conf property dfs.datanode.fsdataset.factory to make FSDataset in Datanode pluggable. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292419 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-22 17:47:39 +00:00
Aaron Myers
d03dac7432 HDFS-2974. MiniDFSCluster does not delete standby NN name dirs during format. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291126 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-20 04:12:01 +00:00
Aaron Myers
41e56dfece HDFS-2952. NN should not start with upgrade option or with a pending an unfinalized upgrade. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245875 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 07:12:27 +00:00
Todd Lipcon
ef5d7156db Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245834 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 01:27:51 +00:00
Todd Lipcon
9ae4fac8dd HDFS-2968. Protocol translator for BlockRecoveryCommand broken when multiple blocks need recovery. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245832 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 01:18:01 +00:00
Todd Lipcon
a8e7f745cd HDFS-2969. ExtendedBlock.equals is incorrectly implemented. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245830 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 01:13:09 +00:00
Eli Collins
dd732d5a24 Fix TestViewFsFileStatusHdfs per previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245762 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 21:04:20 +00:00
Aaron Myers
53b7d6c6bc Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245690 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 18:19:31 +00:00
Aaron Myers
7933dc5838 HDFS-2586. Add protobuf service and implementation for HAServiceProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245338 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 07:37:43 +00:00
Suresh Srinivas
1a03127385 HDFS-2937. TestDFSHAAdmin needs tests with MiniDFSCluster. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245326 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 06:40:40 +00:00
Aaron Myers
153e0cc37a HDFS-2955. IllegalStateException during standby startup in getCurSegmentTxId. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245230 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 22:45:40 +00:00
Jitendra Nath Pandey
b8448dea82 HDFS-2655. BlockReaderLocal#skip performs unnecessary IO. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245118 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 18:58:19 +00:00
Aaron Myers
833e96534f Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245117 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 18:35:32 +00:00
Todd Lipcon
05151ecf79 HDFS-2934. Allow configs to be scoped to all NNs in the nameservice. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244759 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 22:19:12 +00:00
Jitendra Nath Pandey
3c145d3492 HDFS-2909. HA: Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244753 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 22:00:18 +00:00
Suresh Srinivas
ff91453227 HDFS-2938. Recursive delete of a large directory make namenode unresponsive. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244752 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 22:00:08 +00:00
Aaron Myers
1fb0ab92f8 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244645 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 19:04:17 +00:00
Jitendra Nath Pandey
f82e862e1f HDFS-2525. Race between BlockPoolSliceScanner and append. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244640 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 18:43:01 +00:00
Aaron Myers
011611c765 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244202 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 20:37:10 +00:00
Aaron Myers
a87328dfab HDFS-2943. Expose last checkpoint time and transaction stats as JMX metrics. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243822 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 08:27:15 +00:00
Todd Lipcon
db187cf40e Merge trunk into HA branch. 
Some conflicts around TestBlockRecovery: mocking changed for new heartbeat types/responses


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243691 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 21:00:37 +00:00
Tsz-wo Sze
52004aa8e9 HDFS-776. Fix exception handling in Balancer. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243654 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 19:07:04 +00:00
Aaron Myers
f6e407b436 HDFS-2939. TestHAStateTransitions fails on Windows. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243293 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-12 18:43:39 +00:00
Todd Lipcon
8be9441b9b HDFS-2878. Fix TestBlockRecovery and move it back into main test directory. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242995 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-11 01:20:59 +00:00
Todd Lipcon
c14bb61a82 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242635 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 01:49:08 +00:00
Aaron Myers
467059b4ab HDFS-2912. Namenode not shutting down when shared edits dir is inaccessible. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242564 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 22:23:47 +00:00
Jitendra Nath Pandey
b5d02a63cb HDFS-2915. HA: TestFailureOfSharedDir.testFailureOfSharedDir() has race condition. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242522 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 21:08:17 +00:00
Aaron Myers
bad0a2a4a1 HDFS-2510. Add HA-related metrics. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242410 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 17:39:50 +00:00
Todd Lipcon
e918b91e23 HDFS-2579. Starting delegation token manager during safemode fails. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242225 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 06:12:01 +00:00
Tsz-wo Sze
b6ffb08a46 HDFS-2887. FSVolume, is a part of FSDatasetInterface implementation, should not be referred outside FSDataset. A new FSVolumeInterface is defined. The BlockVolumeChoosingPolicy.chooseVolume(..) method signature is also updated. (szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242087 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 20:58:29 +00:00
Aaron Myers
4d3dc530e8 HDFS-2764. TestBackupNode is racy. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241780 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 05:38:29 +00:00
Jitendra Nath Pandey
b9e74da41b HDFS-2905. HA: Standby NN NPE when shared edits dir is deleted. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1241757 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 03:17:09 +00:00
Jitendra Nath Pandey
acacde55e6 HDFS-2901. Improvements for SBN web UI - not show under-replicated/missing blocks. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1241568 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 19:29:39 +00:00
Suresh Srinivas
28eadb7cd7 HDFS-2899. Service protocol changes in DatanodeProtocol to add multiple storages. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241519 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 16:59:48 +00:00
Todd Lipcon
7f0a99f6e6 HDFS-2794. Active NN may purge edit log files before standby NN has a chance to read them. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1241317 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 01:39:14 +00:00
Konstantin Shvachko
7e4bd89590 HDFS-2886. CreateEditLogs should generate a realistic edit log. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241296 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 00:44:27 +00:00
Suresh Srinivas
2a9e430ff9 HDS-2895. Remove Writable wire protocol types and translators to complete transition to protocol buffers. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241007 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 13:33:35 +00:00
Eli Collins
296b6c0063 HDFS-2894. HA: automatically determine the nameservice Id if only one nameservice is configured. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240917 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 08:25:52 +00:00
Eli Collins
2e4cf977ae HDFS-2752. HA: exit if multiple shared dirs are configured. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240916 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 08:24:11 +00:00
Eli Collins
c17b4f8eef HDFS-2819. Document new HA-related configs in hdfs-default.xml. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240914 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 08:21:06 +00:00