2011-08-04 17:23:57 +00:00
Changes for HDFS-1623 branch.
This change list will be merged into the trunk CHANGES.txt when the HDFS-1623
branch is merged.
------------------------------
2011-08-04 17:24:57 +00:00
HDFS-2179. Add fencing framework and mechanisms for NameNode HA. (todd)
2011-08-11 00:44:05 +00:00
HDFS-1974. Introduce active and standy states to the namenode. (suresh)
2011-10-06 16:14:50 +00:00
HDFS-2407. getServerDefaults and getStats don't check operation category (atm)
2011-10-06 23:26:14 +00:00
HDFS-1973. HA: HDFS clients must handle namenode failover and switch over to the new active namenode. (atm)
2011-10-11 20:44:34 +00:00
HDFS-2301. Start/stop appropriate namenode services when transition to active and standby states. (suresh)
2011-10-13 00:09:55 +00:00
HDFS-2231. Configuration changes for HA namenode. (suresh)
2011-10-27 23:15:07 +00:00
HDFS-2418. Change ConfiguredFailoverProxyProvider to take advantage of HDFS-2231. (atm)
2011-10-27 23:26:44 +00:00
HDFS-2393. Mark appropriate methods of ClientProtocol with the idempotent annotation. (atm)
2011-11-01 01:29:59 +00:00
HDFS-2523. Small NN fixes to include HAServiceProtocol and prevent NPE on shutdown. (todd)
2011-11-24 00:55:37 +00:00
HDFS-2577. NN fails to start since it tries to start secret manager in safemode. (todd)
2011-11-29 02:27:45 +00:00
HDFS-2582. Scope dfs.ha.namenodes config by nameservice (todd)
2011-11-30 06:49:30 +00:00
HDFS-2591. MiniDFSCluster support to mix and match federation with HA (todd)
2011-11-30 21:46:22 +00:00
HDFS-1975. Support for sharing the namenode state from active to standby. (jitendra, atm, todd)
2011-12-01 01:10:28 +00:00
HDFS-1971. Send block report from datanode to both active and standby namenodes. (sanjay, todd via suresh)
2011-12-01 08:03:41 +00:00
HDFS-2616. Change DatanodeProtocol#sendHeartbeat() to return HeartbeatResponse. (suresh)
2011-12-01 20:38:46 +00:00
HDFS-2622. Fix TestDFSUpgrade in HA branch. (todd)
2011-12-01 21:26:08 +00:00
HDFS-2612. Handle refreshNameNodes in federated HA clusters (todd)
2011-12-01 21:37:08 +00:00
HDFS-2623. Add test case for hot standby capability (todd)
2011-12-05 06:36:00 +00:00
HDFS-2626. BPOfferService.verifyAndSetNamespaceInfo needs to be synchronized (todd)
2011-12-05 06:37:46 +00:00
HDFS-2624. ConfiguredFailoverProxyProvider doesn't correctly stop ProtocolTranslators (todd)
2011-12-05 06:38:52 +00:00
HDFS-2625. TestDfsOverAvroRpc failing after introduction of HeartbeatResponse type (todd)
2011-12-08 02:00:20 +00:00
HDFS-2627. Determine DN's view of which NN is active based on heartbeat responses (todd)
2011-12-08 23:55:40 +00:00
HDFS-2634. Standby needs to ingest latest edit logs before transitioning to active (todd)
2011-12-14 08:56:21 +00:00
HDFS-2671. NN should throw StandbyException in response to RPCs in STANDBY state (todd)
2011-12-14 21:41:31 +00:00
HDFS-2680. DFSClient should construct failover proxy with exponential backoff (todd)
2011-12-15 00:42:50 +00:00
HDFS-2683. Authority-based lookup of proxy provider fails if path becomes canonicalized (todd)
2011-12-15 21:54:00 +00:00
HDFS-2689. HA: BookKeeperEditLogInputStream doesn't implement isInProgress() (atm)
2011-12-16 04:18:58 +00:00
HDFS-2602. NN should log newly-allocated blocks without losing BlockInfo (atm)
2011-12-16 04:25:13 +00:00
HDFS-2667. Fix transition from active to standby (todd)
2011-12-16 18:36:24 +00:00
HDFS-2684. Fix up some failing unit tests on HA branch (todd)
2011-12-19 05:24:32 +00:00
HDFS-2679. Add interface to query current state to HAServiceProtocol (eli via todd)
2011-12-19 05:26:07 +00:00
HDFS-2677. Web UI should indicate the NN state. (eli via todd)
2011-12-19 20:57:13 +00:00
HDFS-2678. When a FailoverProxyProvider is used, DFSClient should not retry connection ten times before failing over (atm via todd)
2011-12-19 21:49:39 +00:00
HDFS-2682. When a FailoverProxyProvider is used, Client should not retry for 45 times if it is timing out to connect to server. (Uma Maheswara Rao G via todd)
2011-12-21 03:03:23 +00:00
HDFS-2693. Fix synchronization issues around state transition (todd)
2011-12-21 04:32:40 +00:00
HDFS-1972. Fencing mechanism for block invalidations and replications (todd)
2011-12-30 00:25:21 +00:00
HDFS-2714. Fix test cases which use standalone FSNamesystems (todd)
2011-12-30 00:30:27 +00:00
HDFS-2692. Fix bugs related to failover from/into safe mode. (todd)
2011-12-31 01:53:23 +00:00
HDFS-2716. Configuration needs to allow different dfs.http.addresses for each HA NN (todd)
2012-01-04 19:50:41 +00:00
HDFS-2720. Fix MiniDFSCluster HA support to work properly on Windows. (Uma Maheswara Rao G via todd)
2012-01-05 00:22:54 +00:00
HDFS-2291. Allow the StandbyNode to make checkpoints in an HA setup. (todd)
2012-01-06 20:44:05 +00:00
HDFS-2709. Appropriately handle error conditions in EditLogTailer (atm via todd)
2012-01-09 04:12:37 +00:00
HDFS-2730. Refactor shared HA-related test code into HATestUtil class (todd)
2012-01-10 03:29:02 +00:00
HDFS-2762. Fix TestCheckpoint timing out on HA branch. (Uma Maheswara Rao G via todd)
2012-01-10 03:46:05 +00:00
HDFS-2724. NN web UI can throw NPE after startup, before standby state is entered. (todd)
2012-01-11 05:55:32 +00:00
HDFS-2753. Fix standby getting stuck in safemode when blocks are written while SBN is down. (Hari Mankude and todd via todd)
2012-01-11 06:08:13 +00:00
HDFS-2773. Reading edit logs from an earlier version should not leave blocks in under-construction state. (todd)
2012-01-11 06:14:13 +00:00
HDFS-2775. Fix TestStandbyCheckpoints.testBothNodesInStandbyState failing intermittently. (todd)
2012-01-11 08:26:18 +00:00
HDFS-2766. Test for case where standby partially reads log and then performs checkpoint. (atm)
2012-01-11 08:32:10 +00:00
HDFS-2738. FSEditLog.selectinputStreams is reading through in-progress streams even when non-in-progress are requested. (atm)
2012-01-14 20:19:55 +00:00
HDFS-2789. TestHAAdmin.testFailover is failing (eli)
2012-01-16 21:46:05 +00:00
HDFS-2747. Entering safe mode after starting SBN can NPE. (Uma Maheswara Rao G via todd)
2012-01-16 22:16:15 +00:00
HDFS-2772. On transition to active, standby should not swallow ELIE. (atm)
2012-01-17 03:10:25 +00:00
HDFS-2767. ConfiguredFailoverProxyProvider should support NameNodeProtocol. (Uma Maheswara Rao G via todd)
2012-01-17 03:21:08 +00:00
HDFS-2795. Standby NN takes a long time to recover from a dead DN starting up. (todd)
2012-01-17 18:39:09 +00:00
HDFS-2592. Balancer support for HA namenodes. (Uma Maheswara Rao G via todd)
2012-01-19 19:41:48 +00:00
HDFS-2367. Enable the configuration of multiple HA cluster addresses. (atm)
2012-01-19 22:35:04 +00:00
HDFS-2812. When becoming active, the NN should treat all leases as freshly renewed. (todd)
2012-01-21 03:17:26 +00:00
HDFS-2737. Automatically trigger log rolls periodically on the active NN. (todd and atm)
2012-01-23 21:49:43 +00:00
HDFS-2820. Add a simple sanity check for HA config (todd)
2012-01-23 21:57:00 +00:00
HDFS-2688. Add tests for quota tracking in an HA cluster. (todd)
2012-01-23 22:22:46 +00:00
HDFS-2804. Should not mark blocks under-replicated when exiting safemode (todd)
2012-01-24 19:31:49 +00:00
HDFS-2807. Service level authorizartion for HAServiceProtocol. (jitendra)
2012-01-24 21:06:27 +00:00
HDFS-2809. Add test to verify that delegation tokens are honored after failover. (jitendra and atm)
2012-01-26 23:48:08 +00:00
HDFS-2838. NPE in FSNamesystem when in safe mode. (Gregory Chanan via eli)
2012-01-27 00:34:37 +00:00
HDFS-2805. Add a test for a federated cluster with HA NNs. (Brandon Li via jitendra)
2012-01-30 02:52:27 +00:00
HDFS-2841. HAAdmin does not work if security is enabled. (atm)
2012-01-30 19:16:15 +00:00
HDFS-2691. Fixes for pipeline recovery in an HA cluster: report RBW replicas immediately upon pipeline creation. (todd)
2012-01-30 23:05:18 +00:00
HDFS-2824. Fix failover when prior NN died just after creating an edit log segment. (atm via todd)
2012-01-31 02:17:53 +00:00
HDFS-2853. HA: NN fails to start if the shared edits dir is marked required (atm via eli)
2012-02-01 01:29:06 +00:00
HDFS-2845. SBN should not allow browsing of the file system via web UI. (Bikas Saha via atm)
2012-02-01 05:16:49 +00:00
HDFS-2742. HA: observed dataloss in replication stress test. (todd via eli)
2012-02-01 19:23:28 +00:00
HDFS-2870. Fix log level for block debug info in processMisReplicatedBlocks (todd)
2012-02-01 22:02:29 +00:00
HDFS-2859. LOCAL_ADDRESS_MATCHER.match has NPE when called from DFSUtil.getSuffixIDs when the host is incorrect (Bikas Saha via todd)
2012-02-02 22:21:57 +00:00
HDFS-2861. checkpointing should verify that the dfs.http.address has been configured to a non-loopback for peer NN (todd)
2012-02-03 01:09:05 +00:00
HDFS-2860. TestDFSRollback#testRollback is failing. (atm)
2012-02-03 03:10:57 +00:00
HDFS-2769. HA: When HA is enabled with a shared edits dir, that dir should be
marked required. (atm via eli)
2012-02-03 18:04:21 +00:00
HDFS-2863. Failures observed if dfs.edits.dir and shared.edits.dir have same directories. (Bikas Saha via atm)
2012-02-04 02:52:53 +00:00
HDFS-2874. Edit log should log to shared dirs before local dirs. (todd)
2012-02-04 03:00:17 +00:00
HDFS-2890. DFSUtil#getSuffixIDs should skip unset configurations. (atm)
2012-02-04 03:10:39 +00:00
HDFS-2792. Make fsck work. (atm)
2012-02-04 20:12:51 +00:00
HDFS-2808. HA: haadmin should use namenode ids. (eli)
2012-02-06 08:21:06 +00:00
HDFS-2819. Document new HA-related configs in hdfs-default.xml. (eli)
2012-02-06 08:24:11 +00:00
HDFS-2752. HA: exit if multiple shared dirs are configured. (eli)
2012-02-06 08:25:52 +00:00
HDFS-2894. HA: automatically determine the nameservice Id if only one nameservice is configured. (eli)
2012-02-06 21:18:11 +00:00
HDFS-2733. Document HA configuration and CLI. (atm)
2012-02-07 01:39:14 +00:00
HDFS-2794. Active NN may purge edit log files before standby NN has a chance to read them (todd)
2012-02-07 19:29:39 +00:00
HDFS-2901. Improvements for SBN web UI - not show under-replicated/missing blocks. (Brandon Li via jitendra)
2012-02-08 03:17:09 +00:00
HDFS-2905. HA: Standby NN NPE when shared edits dir is deleted. (Bikas Saha via jitendra)
2012-02-09 06:12:01 +00:00
HDFS-2579. Starting delegation token manager during safemode fails. (todd)
2012-02-09 17:39:50 +00:00
HDFS-2510. Add HA-related metrics. (atm)
2012-02-09 18:22:02 +00:00
HDFS-2924. Standby checkpointing fails to authenticate in secure cluster. (todd)
2012-02-09 21:08:17 +00:00
HDFS-2915. HA: TestFailureOfSharedDir.testFailureOfSharedDir() has race condition. (Bikas Saha via jitendra)
2012-02-09 22:23:47 +00:00
HDFS-2912. Namenode not shutting down when shared edits dir is inaccessible. (Bikas Saha via atm)
2012-02-09 22:33:20 +00:00
2012-02-10 00:46:17 +00:00
HDFS-2917. HA: haadmin should not work if run by regular user (eli)
2012-02-12 18:43:39 +00:00
HDFS-2939. TestHAStateTransitions fails on Windows. (Uma Maheswara Rao G via atm)
2012-02-14 08:42:25 +00:00
HDFS-2947. On startup NN throws an NPE in the metrics system. (atm)
2012-02-14 08:43:58 +00:00
HDFS-2942. TestActiveStandbyElectorRealZK fails if build dir does not exist. (atm)
2012-02-14 19:38:02 +00:00
HDFS-2948. NN throws NPE during shutdown if it fails to startup (todd)
2012-02-15 22:00:18 +00:00
HDFS-2909. HA: Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error. (Bikas Saha via jitendra)
2012-02-15 22:19:12 +00:00
HDFS-2934. Allow configs to be scoped to all NNs in the nameservice. (todd)
2012-02-15 22:20:37 +00:00
HDFS-2935. Shared edits dir property should be suffixed with nameservice and namenodeID (todd)
2012-02-16 03:59:09 +00:00
HDFS-2928. ConfiguredFailoverProxyProvider should not create a NameNode proxy with an underlying retry proxy. (Uma Maheswara Rao G via atm)
2012-02-16 22:45:40 +00:00
HDFS-2955. IllegalStateException during standby startup in getCurSegmentTxId. (Hari Mankude via atm)
2012-02-17 06:40:40 +00:00
HDFS-2937. TestDFSHAAdmin needs tests with MiniDFSCluster. (Brandon Li via suresh)
2012-02-17 07:37:43 +00:00
HDFS-2586. Add protobuf service and implementation for HAServiceProtocol. (suresh via atm)
2012-02-18 07:12:27 +00:00
HDFS-2952. NN should not start with upgrade option or with a pending an unfinalized upgrade. (atm)
2012-02-20 04:12:01 +00:00
HDFS-2974. MiniDFSCluster does not delete standby NN name dirs during format. (atm)
2012-02-22 20:31:52 +00:00
HDFS-2929. Stress test and fixes for block synchronization (todd)
2012-02-22 20:37:28 +00:00
HDFS-2972. Small optimization building incremental block report (todd)
2012-02-23 01:25:14 +00:00
HDFS-2973. Re-enable NO_ACK optimization for block deletion. (todd)
2012-02-23 02:08:54 +00:00
HDFS-2922. HA: close out operation categories (eli)
2012-02-23 07:58:33 +00:00
HDFS-2993. HA: BackupNode#checkOperation should permit CHECKPOINT operations (eli)
2012-02-25 00:03:26 +00:00
HDFS-2904. Client support for getting delegation tokens. (todd)
2012-02-28 00:43:54 +00:00
HDFS-3013. HA: NameNode format doesn't pick up dfs.namenode.name.dir.NameServiceId configuration (Mingjie Lai via todd)
2012-02-28 18:38:40 +00:00
HDFS-3019. Fix silent failure of TestEditLogJournalFailures (todd)
2012-02-28 20:09:18 +00:00
HDFS-2958. Sweep for remaining proxy construction which doesn't go through failover path. (atm)
2012-02-29 01:09:07 +00:00
HDFS-2920. fix remaining TODO items. (atm and todd)
2012-02-29 21:57:56 +00:00
HDFS-3027. Implement a simple NN health check. (atm)
2012-02-29 23:42:52 +00:00
2012-03-01 00:37:09 +00:00
HDFS-3023. Optimize entries in edits log for persistBlocks call. (todd)
2012-03-01 08:50:10 +00:00
HDFS-2979. Balancer should use logical uri for creating failover proxy with HA enabled. (atm)
2012-03-01 18:57:58 +00:00
HDFS-3035. Fix failure of TestFileAppendRestart due to OP_UPDATE_BLOCKS (todd)
2012-03-02 01:32:49 +00:00
HDFS-3039. Address findbugs and javadoc warnings on branch. (todd via atm)
