big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,351 Commits 2 Branches 2 Tags 264 MiB
2e9b8df963
Commit Graph

388 Commits

Author SHA1 Message Date
Eli Collins
2e9b8df963 HDFS-2993. HA: BackupNode#checkOperation should permit CHECKPOINT operations. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292688 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 07:58:33 +00:00
Eli Collins
8db31c5972 HDFS-2922. HA: close out operation categories. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292620 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 02:08:54 +00:00
Todd Lipcon
90a14f89e1 HDFS-2973. Re-enable NO_ACK optimization for block deletion. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292611 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 01:25:14 +00:00
Todd Lipcon
7527e943e6 HDFS-2972. Small optimization building incremental block report. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292497 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-22 20:37:28 +00:00
Todd Lipcon
c14912785d HDFS-2929. Stress test and fixes for block synchronization. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292494 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-22 20:31:52 +00:00
Aaron Myers
f0db867292 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291400 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-20 18:33:37 +00:00
Steve Loughran
a57b9b8335 HDFS-2725 script to mention dfs command 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245943 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 15:25:11 +00:00
Aaron Myers
41e56dfece HDFS-2952. NN should not start with upgrade option or with a pending an unfinalized upgrade. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245875 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 07:12:27 +00:00
Todd Lipcon
ef5d7156db Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245834 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 01:27:51 +00:00
Todd Lipcon
9ae4fac8dd HDFS-2968. Protocol translator for BlockRecoveryCommand broken when multiple blocks need recovery. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245832 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 01:18:01 +00:00
Todd Lipcon
a8e7f745cd HDFS-2969. ExtendedBlock.equals is incorrectly implemented. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245830 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 01:13:09 +00:00
Aaron Myers
53b7d6c6bc Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245690 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 18:19:31 +00:00
Aaron Myers
7933dc5838 HDFS-2586. Add protobuf service and implementation for HAServiceProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245338 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 07:37:43 +00:00
Aaron Myers
153e0cc37a HDFS-2955. IllegalStateException during standby startup in getCurSegmentTxId. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245230 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 22:45:40 +00:00
Jitendra Nath Pandey
b8448dea82 HDFS-2655. BlockReaderLocal#skip performs unnecessary IO. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245118 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 18:58:19 +00:00
Aaron Myers
833e96534f Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245117 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 18:35:32 +00:00
Aaron Myers
83a922b55e ConfiguredFailoverProxyProvider should not create a NameNode proxy with an underlying retry proxy. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244845 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 03:59:09 +00:00
Todd Lipcon
0663b51ed4 Amend HDFS-2948. NN throws NPE during shutdown if it fails to startup 
Previous patch missed the case where the NN fails to start up when it's starting in standby state.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244813 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 00:58:03 +00:00
Todd Lipcon
f7f2ef4447 HDFS-2935. Shared edits dir property should be suffixed with nameservice and namenodeID. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244761 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 22:20:37 +00:00
Todd Lipcon
05151ecf79 HDFS-2934. Allow configs to be scoped to all NNs in the nameservice. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244759 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 22:19:12 +00:00
Jitendra Nath Pandey
3c145d3492 HDFS-2909. HA: Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244753 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 22:00:18 +00:00
Suresh Srinivas
ff91453227 HDFS-2938. Recursive delete of a large directory make namenode unresponsive. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244752 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 22:00:08 +00:00
Aaron Myers
1fb0ab92f8 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244645 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 19:04:17 +00:00
Jitendra Nath Pandey
f82e862e1f HDFS-2525. Race between BlockPoolSliceScanner and append. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244640 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 18:43:01 +00:00
Todd Lipcon
3bd230af11 HDFS-2950. Secondary NN HTTPS address should be listed as a NAMESERVICE_SPECIFIC_KEY. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244635 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 18:27:37 +00:00
Aaron Myers
011611c765 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244202 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 20:37:10 +00:00
Todd Lipcon
439490f915 HDFS-2948. NN throws NPE during shutdown if it fails to startup. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244186 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 19:38:02 +00:00
Aaron Myers
1b2ecc6336 HDFS-2947. On startup NN throws an NPE in the metrics system. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243826 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 08:42:25 +00:00
Aaron Myers
a87328dfab HDFS-2943. Expose last checkpoint time and transaction stats as JMX metrics. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243822 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 08:27:15 +00:00
Todd Lipcon
db187cf40e Merge trunk into HA branch. 
Some conflicts around TestBlockRecovery: mocking changed for new heartbeat types/responses


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243691 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 21:00:37 +00:00
Aaron Myers
2acafd1783 HDFS-2944. Typo in hdfs-default.xml causes dfs.client.block.write.replace-datanode-on-failure.enable to be mistakenly disabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243690 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 20:57:48 +00:00
Suresh Srinivas
a70bc6c6a2 HDFS-2815. Namenode sometimes oes not come out of safemode during NN crash + restart. Contributed by Uma Maheswara Rao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243673 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 20:11:43 +00:00
Tsz-wo Sze
52004aa8e9 HDFS-776. Fix exception handling in Balancer. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243654 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 19:07:04 +00:00
Harsh J
8b730c867f HDFS-2869. Fix an error in the webhdfs docs for the mkdir op (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243104 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-11 17:13:30 +00:00
Todd Lipcon
8be9441b9b HDFS-2878. Fix TestBlockRecovery and move it back into main test directory. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242995 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-11 01:20:59 +00:00
Tsz-wo Sze
83fd3160da HDFS-2931. Switch DataNode's BlockVolumeChoosingPolicy to private-audience. Contributed by harsh 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242891 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 19:15:15 +00:00
Todd Lipcon
a626fa04f9 Revert HDFS-2922 via svn merge -c -1242572 
The patch broke a lot of unit tests in the nightly build. Will recommit after it is fixed.



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242874 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 18:17:21 +00:00
Aaron Myers
05d56e5e7e Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242871 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 18:01:01 +00:00
Tsz-wo Sze
dc847b39fd HDFS-2486. Remove unnecessary priority level checks in UnderReplicatedBlocks. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242636 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 02:05:38 +00:00
Todd Lipcon
c14bb61a82 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242635 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 01:49:08 +00:00
Eli Collins
8af96c7b22 HDFS-2917. HA: haadmin should not work if run by regular user. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242626 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 00:46:17 +00:00
Eli Collins
a63e12c4c8 HDFS-2922. HA: close out operation categories. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242572 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 22:33:20 +00:00
Aaron Myers
467059b4ab HDFS-2912. Namenode not shutting down when shared edits dir is inaccessible. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242564 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 22:23:47 +00:00
Todd Lipcon
5e26de982b HDFS-2924. Standby checkpointing fails to authenticate in secure cluster. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242439 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 18:22:02 +00:00
Aaron Myers
bad0a2a4a1 HDFS-2510. Add HA-related metrics. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242410 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 17:39:50 +00:00
Todd Lipcon
e918b91e23 HDFS-2579. Starting delegation token manager during safemode fails. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242225 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 06:12:01 +00:00
Todd Lipcon
a1574e1715 HDFS-2923. Namenode IPC handler count uses the wrong configuration key. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242220 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 05:28:40 +00:00
Jitendra Nath Pandey
987449b9b8 HDFS-2908. Add apache license header for StorageReport.java. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242192 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 00:24:06 +00:00
Tsz-wo Sze
b6ffb08a46 HDFS-2887. FSVolume, is a part of FSDatasetInterface implementation, should not be referred outside FSDataset. A new FSVolumeInterface is defined. The BlockVolumeChoosingPolicy.chooseVolume(..) method signature is also updated. (szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242087 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 20:58:29 +00:00
Jitendra Nath Pandey
11db1b855f HDFS-2786. Fix host-based token incompatibilities in DFSUtil. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241766 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 03:55:36 +00:00