Moving HDFS-1623 and HADOOP-7454 to 0.23.3 section in CHANGES.txt files
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299417 13f79535-47bb-0310-9956-ffa450edef68
This commit is contained in:
Suresh Srinivas
parent
c8f2889bde
commit
46a88ded0d
@ -9,11 +9,6 @@ Trunk (unreleased changes)
|
|||||||
|
|
||||||
NEW FEATURES
|
NEW FEATURES
|
||||||
|
|
||||||
HADOOP-7454. Common side of High Availability Framework (HDFS-1623)
|
|
||||||
Contributed by Todd Lipcon, Aaron T. Myers, Eli Collins, Uma Maheswara Rao G,
|
|
||||||
Bikas Saha, Suresh Srinivas, Jitendra Nath Pandey, Hari Mankude, Brandon Li,
|
|
||||||
Sanjay Radia, Mingjie Lai, and Gregory Chanan
|
|
||||||
|
|
||||||
HADOOP-8135. Add ByteBufferReadable interface to FSDataInputStream. (Henry
|
HADOOP-8135. Add ByteBufferReadable interface to FSDataInputStream. (Henry
|
||||||
Robinson via atm)
|
Robinson via atm)
|
||||||
|
|
||||||
@ -109,58 +104,6 @@ Trunk (unreleased changes)
|
|||||||
|
|
||||||
HADOOP-7761. Improve the performance of raw comparisons. (todd)
|
HADOOP-7761. Improve the performance of raw comparisons. (todd)
|
||||||
|
|
||||||
BREAKDOWN OF HADOOP-7454 SUBTASKS
|
|
||||||
|
|
||||||
HADOOP-7455. HA: Introduce HA Service Protocol Interface. (suresh)
|
|
||||||
|
|
||||||
HADOOP-7774. HA: Administrative CLI to control HA daemons. (todd)
|
|
||||||
|
|
||||||
HADOOP-7896. HA: if both NNs are in Standby mode, client needs to try failing
|
|
||||||
back and forth several times with sleeps. (atm)
|
|
||||||
|
|
||||||
HADOOP-7922. Improve some logging for client IPC failovers and
|
|
||||||
StandbyExceptions (todd)
|
|
||||||
|
|
||||||
HADOOP-7921. StandbyException should extend IOException (todd)
|
|
||||||
|
|
||||||
HADOOP-7928. HA: Client failover policy is incorrectly trying to fail over all
|
|
||||||
IOExceptions (atm)
|
|
||||||
|
|
||||||
HADOOP-7925. Add interface and update CLI to query current state to
|
|
||||||
HAServiceProtocol (eli via todd)
|
|
||||||
|
|
||||||
HADOOP-7932. Make client connection retries on socket time outs configurable.
|
|
||||||
(Uma Maheswara Rao G via todd)
|
|
||||||
|
|
||||||
HADOOP-7924. FailoverController for client-based configuration (eli)
|
|
||||||
|
|
||||||
HADOOP-7961. Move HA fencing to common. (eli)
|
|
||||||
|
|
||||||
HADOOP-7970. HAServiceProtocol methods must throw IOException. (Hari Mankude
|
|
||||||
via suresh).
|
|
||||||
|
|
||||||
HADOOP-7992. Add ZKClient library to facilitate leader election. (Bikas Saha
|
|
||||||
via suresh).
|
|
||||||
|
|
||||||
HADOOP-7983. HA: failover should be able to pass args to fencers. (eli)
|
|
||||||
|
|
||||||
HADOOP-7938. HA: the FailoverController should optionally fence the active
|
|
||||||
during failover. (eli)
|
|
||||||
|
|
||||||
HADOOP-7991. HA: the FailoverController should check the standby is ready
|
|
||||||
before failing over. (eli)
|
|
||||||
|
|
||||||
HADOOP-8038. Add 'ipc.client.connect.max.retries.on.timeouts' entry in
|
|
||||||
core-default.xml file. (Uma Maheswara Rao G via atm)
|
|
||||||
|
|
||||||
HADOOP-8041. Log a warning when a failover is first attempted (todd)
|
|
||||||
|
|
||||||
HADOOP-8068. void methods can swallow exceptions when going through failover
|
|
||||||
path (todd)
|
|
||||||
|
|
||||||
HADOOP-8116. RetriableCommand is using RetryPolicy incorrectly after
|
|
||||||
HADOOP-7896. (atm)
|
|
||||||
|
|
||||||
Release 0.23.3 - UNRELEASED
|
Release 0.23.3 - UNRELEASED
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
INCOMPATIBLE CHANGES
|
||||||
@ -175,6 +118,11 @@ Release 0.23.3 - UNRELEASED
|
|||||||
HADOOP-7875. Add helper class to unwrap protobuf ServiceException.
|
HADOOP-7875. Add helper class to unwrap protobuf ServiceException.
|
||||||
(suresh)
|
(suresh)
|
||||||
|
|
||||||
|
HADOOP-7454. Common side of High Availability Framework (HDFS-1623)
|
||||||
|
Contributed by Todd Lipcon, Aaron T. Myers, Eli Collins, Uma Maheswara Rao G,
|
||||||
|
Bikas Saha, Suresh Srinivas, Jitendra Nath Pandey, Hari Mankude, Brandon Li,
|
||||||
|
Sanjay Radia, Mingjie Lai, and Gregory Chanan
|
||||||
|
|
||||||
IMPROVEMENTS
|
IMPROVEMENTS
|
||||||
|
|
||||||
HADOOP-7524. Change RPC to allow multiple protocols including multuple
|
HADOOP-7524. Change RPC to allow multiple protocols including multuple
|
||||||
@ -278,6 +226,58 @@ Release 0.23.3 - UNRELEASED
|
|||||||
HADOOP-8154. DNS#getIPs shouldn't silently return the local host
|
HADOOP-8154. DNS#getIPs shouldn't silently return the local host
|
||||||
IP for bogus interface names. (eli)
|
IP for bogus interface names. (eli)
|
||||||
|
|
||||||
|
BREAKDOWN OF HADOOP-7454 SUBTASKS
|
||||||
|
|
||||||
|
HADOOP-7455. HA: Introduce HA Service Protocol Interface. (suresh)
|
||||||
|
|
||||||
|
HADOOP-7774. HA: Administrative CLI to control HA daemons. (todd)
|
||||||
|
|
||||||
|
HADOOP-7896. HA: if both NNs are in Standby mode, client needs to try failing
|
||||||
|
back and forth several times with sleeps. (atm)
|
||||||
|
|
||||||
|
HADOOP-7922. Improve some logging for client IPC failovers and
|
||||||
|
StandbyExceptions (todd)
|
||||||
|
|
||||||
|
HADOOP-7921. StandbyException should extend IOException (todd)
|
||||||
|
|
||||||
|
HADOOP-7928. HA: Client failover policy is incorrectly trying to fail over all
|
||||||
|
IOExceptions (atm)
|
||||||
|
|
||||||
|
HADOOP-7925. Add interface and update CLI to query current state to
|
||||||
|
HAServiceProtocol (eli via todd)
|
||||||
|
|
||||||
|
HADOOP-7932. Make client connection retries on socket time outs configurable.
|
||||||
|
(Uma Maheswara Rao G via todd)
|
||||||
|
|
||||||
|
HADOOP-7924. FailoverController for client-based configuration (eli)
|
||||||
|
|
||||||
|
HADOOP-7961. Move HA fencing to common. (eli)
|
||||||
|
|
||||||
|
HADOOP-7970. HAServiceProtocol methods must throw IOException. (Hari Mankude
|
||||||
|
via suresh).
|
||||||
|
|
||||||
|
HADOOP-7992. Add ZKClient library to facilitate leader election. (Bikas Saha
|
||||||
|
via suresh).
|
||||||
|
|
||||||
|
HADOOP-7983. HA: failover should be able to pass args to fencers. (eli)
|
||||||
|
|
||||||
|
HADOOP-7938. HA: the FailoverController should optionally fence the active
|
||||||
|
during failover. (eli)
|
||||||
|
|
||||||
|
HADOOP-7991. HA: the FailoverController should check the standby is ready
|
||||||
|
before failing over. (eli)
|
||||||
|
|
||||||
|
HADOOP-8038. Add 'ipc.client.connect.max.retries.on.timeouts' entry in
|
||||||
|
core-default.xml file. (Uma Maheswara Rao G via atm)
|
||||||
|
|
||||||
|
HADOOP-8041. Log a warning when a failover is first attempted (todd)
|
||||||
|
|
||||||
|
HADOOP-8068. void methods can swallow exceptions when going through failover
|
||||||
|
path (todd)
|
||||||
|
|
||||||
|
HADOOP-8116. RetriableCommand is using RetryPolicy incorrectly after
|
||||||
|
HADOOP-7896. (atm)
|
||||||
|
|
||||||
Release 0.23.2 - UNRELEASED
|
Release 0.23.2 - UNRELEASED
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
INCOMPATIBLE CHANGES
|
||||||
|
|||||||
@ -11,11 +11,6 @@ Trunk (unreleased changes)
|
|||||||
HDFS-234. Integration with BookKeeper logging system. (Ivan Kelly
|
HDFS-234. Integration with BookKeeper logging system. (Ivan Kelly
|
||||||
via jitendra)
|
via jitendra)
|
||||||
|
|
||||||
HDFS-1623. High Availability Framework for HDFS NN. Contributed by Todd
|
|
||||||
Lipcon, Aaron T. Myers, Eli Collins, Uma Maheswara Rao G, Bikas Saha,
|
|
||||||
Suresh Srinivas, Jitendra Nath Pandey, Hari Mankude, Brandon Li, Sanjay
|
|
||||||
Radia, Mingjie Lai, and Gregory Chanan
|
|
||||||
|
|
||||||
IMPROVEMENTS
|
IMPROVEMENTS
|
||||||
|
|
||||||
HDFS-1620. Rename HdfsConstants -> HdfsServerConstants, FSConstants ->
|
HDFS-1620. Rename HdfsConstants -> HdfsServerConstants, FSConstants ->
|
||||||
@ -94,6 +89,201 @@ Trunk (unreleased changes)
|
|||||||
|
|
||||||
HDFS-2966 TestNameNodeMetrics tests can fail under load. (stevel)
|
HDFS-2966 TestNameNodeMetrics tests can fail under load. (stevel)
|
||||||
|
|
||||||
|
Release 0.23.3 - UNRELEASED
|
||||||
|
|
||||||
|
INCOMPATIBLE CHANGES
|
||||||
|
|
||||||
|
HDFS-2676. Remove Avro RPC. (suresh)
|
||||||
|
|
||||||
|
NEW FEATURES
|
||||||
|
|
||||||
|
HDFS-2978. The NameNode should expose name dir statuses via JMX. (atm)
|
||||||
|
|
||||||
|
HDFS-395. DFS Scalability: Incremental block reports. (Tomasz Nykiel
|
||||||
|
via hairong)
|
||||||
|
|
||||||
|
HDFS-2517. Add protobuf service for JounralProtocol. (suresh)
|
||||||
|
|
||||||
|
HDFS-2518. Add protobuf service for NamenodeProtocol. (suresh)
|
||||||
|
|
||||||
|
HDFS-2520. Add protobuf service for InterDatanodeProtocol. (suresh)
|
||||||
|
|
||||||
|
HDFS-2519. Add protobuf service for DatanodeProtocol. (suresh)
|
||||||
|
|
||||||
|
HDFS-2581. Implement protobuf service for JournalProtocol. (suresh)
|
||||||
|
|
||||||
|
HDFS-2618. Implement protobuf service for NamenodeProtocol. (suresh)
|
||||||
|
|
||||||
|
HDFS-2629. Implement protobuf service for InterDatanodeProtocol. (suresh)
|
||||||
|
|
||||||
|
HDFS-2636. Implement protobuf service for ClientDatanodeProtocol. (suresh)
|
||||||
|
|
||||||
|
HDFS-2642. Protobuf translators for DatanodeProtocol. (jitendra)
|
||||||
|
|
||||||
|
HDFS-2647. Used protobuf based RPC for InterDatanodeProtocol,
|
||||||
|
ClientDatanodeProtocol, JournalProtocol, NamenodeProtocol. (suresh)
|
||||||
|
|
||||||
|
HDFS-2661. Enable protobuf RPC for DatanodeProtocol. (jitendra)
|
||||||
|
|
||||||
|
HDFS-2697. Move RefreshAuthPolicy, RefreshUserMappings, GetUserMappings
|
||||||
|
protocol to protocol buffers. (jitendra)
|
||||||
|
|
||||||
|
HDFS-2880. Protobuf changes in DatanodeProtocol to add multiple storages.
|
||||||
|
(suresh)
|
||||||
|
|
||||||
|
HDFS-2899. Service protocol changes in DatanodeProtocol to add multiple
|
||||||
|
storages. (suresh)
|
||||||
|
|
||||||
|
HDFS-2430. The number of failed or low-resource volumes the NN can tolerate
|
||||||
|
should be configurable. (atm)
|
||||||
|
|
||||||
|
HDFS-1623. High Availability Framework for HDFS NN. Contributed by Todd
|
||||||
|
Lipcon, Aaron T. Myers, Eli Collins, Uma Maheswara Rao G, Bikas Saha,
|
||||||
|
Suresh Srinivas, Jitendra Nath Pandey, Hari Mankude, Brandon Li, Sanjay
|
||||||
|
Radia, Mingjie Lai, and Gregory Chanan
|
||||||
|
|
||||||
|
IMPROVEMENTS
|
||||||
|
|
||||||
|
HDFS-2018. Move all journal stream management code into one place.
|
||||||
|
(Ivan Kelly via jitendra)
|
||||||
|
|
||||||
|
HDFS-2223. Untangle depencencies between NN components (todd)
|
||||||
|
|
||||||
|
HDFS-2351. Change Namenode and Datanode to register each of their protocols
|
||||||
|
seperately (sanjay)
|
||||||
|
|
||||||
|
HDFS-2337. DFSClient shouldn't keep multiple RPC proxy references (atm)
|
||||||
|
|
||||||
|
HDFS-2181. Separate HDFS Client wire protocol data types (sanjay)
|
||||||
|
|
||||||
|
HDFS-2459. Separate datatypes for Journal Protocol. (suresh)
|
||||||
|
|
||||||
|
HDFS-2480. Separate datatypes for NamenodeProtocol. (suresh)
|
||||||
|
|
||||||
|
HDFS-2489. Move Finalize and Register to separate file out of
|
||||||
|
DatanodeCommand.java. (suresh)
|
||||||
|
|
||||||
|
HDFS-2488. Separate datatypes for InterDatanodeProtocol. (suresh)
|
||||||
|
|
||||||
|
HDFS-2496. Separate datatypes for DatanodeProtocol. (suresh)
|
||||||
|
|
||||||
|
HDFS-2479. HDFS Client Data Types in Protocol Buffers (sanjay)
|
||||||
|
|
||||||
|
HADOOP-7862. Hdfs changes to work with HADOOP-7862: Move the support for
|
||||||
|
multiple protocols to lower layer so that Writable, PB and Avro can all
|
||||||
|
use it. (sanjay)
|
||||||
|
|
||||||
|
HDFS-2597. ClientNameNodeProtocol in Protocol Buffers. (sanjay)
|
||||||
|
|
||||||
|
HDFS-2651. ClientNameNodeProtocol Translators for Protocol Buffers. (sanjay)
|
||||||
|
|
||||||
|
HDFS-2650. Replace @inheritDoc with @Override. (Hari Mankude via suresh).
|
||||||
|
|
||||||
|
HDFS-2669. Enable protobuf rpc for ClientNamenodeProtocol. (sanjay)
|
||||||
|
|
||||||
|
HDFS-2801. Provide a method in client side translators to check for a
|
||||||
|
methods supported in underlying protocol. (jitendra)
|
||||||
|
|
||||||
|
HDFS-2895. Remove Writable wire protocol types and translators to
|
||||||
|
complete transition to protocol buffers. (suresh)
|
||||||
|
|
||||||
|
HDFS-2992. Edit log failure trace should include transaction ID of
|
||||||
|
error. (Colin Patrick McCabe via eli)
|
||||||
|
|
||||||
|
HDFS-2507. Allow saveNamespace operations to be canceled. (todd)
|
||||||
|
|
||||||
|
HDFS-2410. Further cleanup of hardcoded configuration keys and values.
|
||||||
|
(suresh)
|
||||||
|
|
||||||
|
HDFS-208. name node should warn if only one dir is listed in dfs.name.dir.
|
||||||
|
(Uma Maheswara Rao G via eli)
|
||||||
|
|
||||||
|
HDFS-3003. Remove getHostPortString() from NameNode, replace it with
|
||||||
|
NetUtils.getHostPortString(). (Brandon Li via atm)
|
||||||
|
|
||||||
|
HDFS-3014. FSEditLogOp and its subclasses should have toString() method.
|
||||||
|
(Sho Shimauchi via atm)
|
||||||
|
|
||||||
|
HDFS-3036. Remove unused method DFSUtil#isDefaultNamenodeAddress. (atm)
|
||||||
|
|
||||||
|
HDFS-2158. Add JournalSet to manage the set of journals. (jitendra)
|
||||||
|
|
||||||
|
HDFS-2334. Add Closeable to JournalManager. (Ivan Kelly via jitendra)
|
||||||
|
|
||||||
|
HDFS-1580. Add interface for generic Write Ahead Logging mechanisms.
|
||||||
|
(Ivan Kelly via jitendra)
|
||||||
|
|
||||||
|
HDFS-3060. Bump TestDistributedUpgrade#testDistributedUpgrade timeout (eli)
|
||||||
|
|
||||||
|
HDFS-3021. Use generic type to declare FSDatasetInterface. (szetszwo)
|
||||||
|
|
||||||
|
HDFS-3056. Add a new interface RollingLogs for DataBlockScanner logging.
|
||||||
|
(szetszwo)
|
||||||
|
|
||||||
|
OPTIMIZATIONS
|
||||||
|
|
||||||
|
HDFS-3024. Improve performance of stringification in addStoredBlock (todd)
|
||||||
|
|
||||||
|
HDFS-2477. Optimize computing the diff between a block report and the
|
||||||
|
namenode state. (Tomasz Nykiel via hairong)
|
||||||
|
|
||||||
|
HDFS-2495. Increase granularity of write operations in ReplicationMonitor
|
||||||
|
thus reducing contention for write lock. (Tomasz Nykiel via hairong)
|
||||||
|
|
||||||
|
HDFS-2476. More CPU efficient data structure for under-replicated,
|
||||||
|
over-replicated, and invalidated blocks. (Tomasz Nykiel via todd)
|
||||||
|
|
||||||
|
BUG FIXES
|
||||||
|
|
||||||
|
HDFS-2481. Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol.
|
||||||
|
(sanjay)
|
||||||
|
|
||||||
|
HDFS-2497. Fix TestBackupNode failure. (suresh)
|
||||||
|
|
||||||
|
HDFS-2499. RPC client is created incorrectly introduced in HDFS-2459.
|
||||||
|
(suresh)
|
||||||
|
|
||||||
|
HDFS-2526. (Client)NamenodeProtocolTranslatorR23 do not need to keep a
|
||||||
|
reference to rpcProxyWithoutRetry (atm)
|
||||||
|
|
||||||
|
HDFS-2532. TestDfsOverAvroRpc timing out in trunk (Uma Maheswara Rao G
|
||||||
|
via todd)
|
||||||
|
|
||||||
|
HDFS-2666. Fix TestBackupNode failure. (suresh)
|
||||||
|
|
||||||
|
HDFS-2663. Optional protobuf parameters are not handled correctly. (suresh)
|
||||||
|
|
||||||
|
HDFS-2694. Removal of Avro broke non-PB NN services. (atm)
|
||||||
|
|
||||||
|
HDFS-2687. Tests failing with ClassCastException post protobuf RPC
|
||||||
|
changes. (suresh)
|
||||||
|
|
||||||
|
HDFS-2700. Fix failing TestDataNodeMultipleRegistrations in trunk
|
||||||
|
(Uma Maheswara Rao G via todd)
|
||||||
|
|
||||||
|
HDFS-2739. SecondaryNameNode doesn't start up. (jitendra)
|
||||||
|
|
||||||
|
HDFS-2768. BackupNode stop can not close proxy connections because
|
||||||
|
it is not a proxy instance. (Uma Maheswara Rao G via eli)
|
||||||
|
|
||||||
|
HDFS-2968. Protocol translator for BlockRecoveryCommand broken when
|
||||||
|
multiple blocks need recovery. (todd)
|
||||||
|
|
||||||
|
HDFS-3020. Fix editlog to automatically sync when buffer is full. (todd)
|
||||||
|
|
||||||
|
HDFS-3038. Add FSEditLog.metrics to findbugs exclude list. (todd via atm)
|
||||||
|
|
||||||
|
HDFS-2285. BackupNode should reject requests to modify namespace.
|
||||||
|
(shv and Uma Maheswara Rao)
|
||||||
|
|
||||||
|
HDFS-2764. TestBackupNode is racy. (atm)
|
||||||
|
|
||||||
|
HDFS-2188. Make FSEditLog create its journals from a list of URIs rather
|
||||||
|
than NNStorage. (Ivan Kelly via jitendra)
|
||||||
|
|
||||||
|
HDFS-1765. Block Replication should respect under-replication
|
||||||
|
block priority. (Uma Maheswara Rao G via eli)
|
||||||
|
|
||||||
BREAKDOWN OF HDFS-1623 SUBTASKS
|
BREAKDOWN OF HDFS-1623 SUBTASKS
|
||||||
|
|
||||||
HDFS-2179. Add fencing framework and mechanisms for NameNode HA. (todd)
|
HDFS-2179. Add fencing framework and mechanisms for NameNode HA. (todd)
|
||||||
@ -410,196 +600,6 @@ Trunk (unreleased changes)
|
|||||||
|
|
||||||
HDFS-3039. Address findbugs and javadoc warnings on branch. (todd via atm)
|
HDFS-3039. Address findbugs and javadoc warnings on branch. (todd via atm)
|
||||||
|
|
||||||
Release 0.23.3 - UNRELEASED
|
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
|
||||||
|
|
||||||
HDFS-2676. Remove Avro RPC. (suresh)
|
|
||||||
|
|
||||||
NEW FEATURES
|
|
||||||
|
|
||||||
HDFS-2978. The NameNode should expose name dir statuses via JMX. (atm)
|
|
||||||
|
|
||||||
HDFS-395. DFS Scalability: Incremental block reports. (Tomasz Nykiel
|
|
||||||
via hairong)
|
|
||||||
|
|
||||||
HDFS-2517. Add protobuf service for JounralProtocol. (suresh)
|
|
||||||
|
|
||||||
HDFS-2518. Add protobuf service for NamenodeProtocol. (suresh)
|
|
||||||
|
|
||||||
HDFS-2520. Add protobuf service for InterDatanodeProtocol. (suresh)
|
|
||||||
|
|
||||||
HDFS-2519. Add protobuf service for DatanodeProtocol. (suresh)
|
|
||||||
|
|
||||||
HDFS-2581. Implement protobuf service for JournalProtocol. (suresh)
|
|
||||||
|
|
||||||
HDFS-2618. Implement protobuf service for NamenodeProtocol. (suresh)
|
|
||||||
|
|
||||||
HDFS-2629. Implement protobuf service for InterDatanodeProtocol. (suresh)
|
|
||||||
|
|
||||||
HDFS-2636. Implement protobuf service for ClientDatanodeProtocol. (suresh)
|
|
||||||
|
|
||||||
HDFS-2642. Protobuf translators for DatanodeProtocol. (jitendra)
|
|
||||||
|
|
||||||
HDFS-2647. Used protobuf based RPC for InterDatanodeProtocol,
|
|
||||||
ClientDatanodeProtocol, JournalProtocol, NamenodeProtocol. (suresh)
|
|
||||||
|
|
||||||
HDFS-2661. Enable protobuf RPC for DatanodeProtocol. (jitendra)
|
|
||||||
|
|
||||||
HDFS-2697. Move RefreshAuthPolicy, RefreshUserMappings, GetUserMappings
|
|
||||||
protocol to protocol buffers. (jitendra)
|
|
||||||
|
|
||||||
HDFS-2880. Protobuf changes in DatanodeProtocol to add multiple storages.
|
|
||||||
(suresh)
|
|
||||||
|
|
||||||
HDFS-2899. Service protocol changes in DatanodeProtocol to add multiple
|
|
||||||
storages. (suresh)
|
|
||||||
|
|
||||||
HDFS-2430. The number of failed or low-resource volumes the NN can tolerate
|
|
||||||
should be configurable. (atm)
|
|
||||||
|
|
||||||
IMPROVEMENTS
|
|
||||||
|
|
||||||
HDFS-2018. Move all journal stream management code into one place.
|
|
||||||
(Ivan Kelly via jitendra)
|
|
||||||
|
|
||||||
HDFS-2223. Untangle depencencies between NN components (todd)
|
|
||||||
|
|
||||||
HDFS-2351. Change Namenode and Datanode to register each of their protocols
|
|
||||||
seperately (sanjay)
|
|
||||||
|
|
||||||
HDFS-2337. DFSClient shouldn't keep multiple RPC proxy references (atm)
|
|
||||||
|
|
||||||
HDFS-2181. Separate HDFS Client wire protocol data types (sanjay)
|
|
||||||
|
|
||||||
HDFS-2459. Separate datatypes for Journal Protocol. (suresh)
|
|
||||||
|
|
||||||
HDFS-2480. Separate datatypes for NamenodeProtocol. (suresh)
|
|
||||||
|
|
||||||
HDFS-2489. Move Finalize and Register to separate file out of
|
|
||||||
DatanodeCommand.java. (suresh)
|
|
||||||
|
|
||||||
HDFS-2488. Separate datatypes for InterDatanodeProtocol. (suresh)
|
|
||||||
|
|
||||||
HDFS-2496. Separate datatypes for DatanodeProtocol. (suresh)
|
|
||||||
|
|
||||||
HDFS-2479. HDFS Client Data Types in Protocol Buffers (sanjay)
|
|
||||||
|
|
||||||
HADOOP-7862. Hdfs changes to work with HADOOP-7862: Move the support for
|
|
||||||
multiple protocols to lower layer so that Writable, PB and Avro can all
|
|
||||||
use it. (sanjay)
|
|
||||||
|
|
||||||
HDFS-2597. ClientNameNodeProtocol in Protocol Buffers. (sanjay)
|
|
||||||
|
|
||||||
HDFS-2651. ClientNameNodeProtocol Translators for Protocol Buffers. (sanjay)
|
|
||||||
|
|
||||||
HDFS-2650. Replace @inheritDoc with @Override. (Hari Mankude via suresh).
|
|
||||||
|
|
||||||
HDFS-2669. Enable protobuf rpc for ClientNamenodeProtocol. (sanjay)
|
|
||||||
|
|
||||||
HDFS-2801. Provide a method in client side translators to check for a
|
|
||||||
methods supported in underlying protocol. (jitendra)
|
|
||||||
|
|
||||||
HDFS-2895. Remove Writable wire protocol types and translators to
|
|
||||||
complete transition to protocol buffers. (suresh)
|
|
||||||
|
|
||||||
HDFS-2992. Edit log failure trace should include transaction ID of
|
|
||||||
error. (Colin Patrick McCabe via eli)
|
|
||||||
|
|
||||||
HDFS-2507. Allow saveNamespace operations to be canceled. (todd)
|
|
||||||
|
|
||||||
HDFS-2410. Further cleanup of hardcoded configuration keys and values.
|
|
||||||
(suresh)
|
|
||||||
|
|
||||||
HDFS-208. name node should warn if only one dir is listed in dfs.name.dir.
|
|
||||||
(Uma Maheswara Rao G via eli)
|
|
||||||
|
|
||||||
HDFS-3003. Remove getHostPortString() from NameNode, replace it with
|
|
||||||
NetUtils.getHostPortString(). (Brandon Li via atm)
|
|
||||||
|
|
||||||
HDFS-3014. FSEditLogOp and its subclasses should have toString() method.
|
|
||||||
(Sho Shimauchi via atm)
|
|
||||||
|
|
||||||
HDFS-3036. Remove unused method DFSUtil#isDefaultNamenodeAddress. (atm)
|
|
||||||
|
|
||||||
HDFS-2158. Add JournalSet to manage the set of journals. (jitendra)
|
|
||||||
|
|
||||||
HDFS-2334. Add Closeable to JournalManager. (Ivan Kelly via jitendra)
|
|
||||||
|
|
||||||
HDFS-1580. Add interface for generic Write Ahead Logging mechanisms.
|
|
||||||
(Ivan Kelly via jitendra)
|
|
||||||
|
|
||||||
HDFS-3060. Bump TestDistributedUpgrade#testDistributedUpgrade timeout (eli)
|
|
||||||
|
|
||||||
HDFS-3021. Use generic type to declare FSDatasetInterface. (szetszwo)
|
|
||||||
|
|
||||||
HDFS-3056. Add a new interface RollingLogs for DataBlockScanner logging.
|
|
||||||
(szetszwo)
|
|
||||||
|
|
||||||
OPTIMIZATIONS
|
|
||||||
|
|
||||||
HDFS-3024. Improve performance of stringification in addStoredBlock (todd)
|
|
||||||
|
|
||||||
HDFS-2477. Optimize computing the diff between a block report and the
|
|
||||||
namenode state. (Tomasz Nykiel via hairong)
|
|
||||||
|
|
||||||
HDFS-2495. Increase granularity of write operations in ReplicationMonitor
|
|
||||||
thus reducing contention for write lock. (Tomasz Nykiel via hairong)
|
|
||||||
|
|
||||||
HDFS-2476. More CPU efficient data structure for under-replicated,
|
|
||||||
over-replicated, and invalidated blocks. (Tomasz Nykiel via todd)
|
|
||||||
|
|
||||||
BUG FIXES
|
|
||||||
|
|
||||||
HDFS-2481. Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol.
|
|
||||||
(sanjay)
|
|
||||||
|
|
||||||
HDFS-2497. Fix TestBackupNode failure. (suresh)
|
|
||||||
|
|
||||||
HDFS-2499. RPC client is created incorrectly introduced in HDFS-2459.
|
|
||||||
(suresh)
|
|
||||||
|
|
||||||
HDFS-2526. (Client)NamenodeProtocolTranslatorR23 do not need to keep a
|
|
||||||
reference to rpcProxyWithoutRetry (atm)
|
|
||||||
|
|
||||||
HDFS-2532. TestDfsOverAvroRpc timing out in trunk (Uma Maheswara Rao G
|
|
||||||
via todd)
|
|
||||||
|
|
||||||
HDFS-2666. Fix TestBackupNode failure. (suresh)
|
|
||||||
|
|
||||||
HDFS-2663. Optional protobuf parameters are not handled correctly. (suresh)
|
|
||||||
|
|
||||||
HDFS-2694. Removal of Avro broke non-PB NN services. (atm)
|
|
||||||
|
|
||||||
HDFS-2687. Tests failing with ClassCastException post protobuf RPC
|
|
||||||
changes. (suresh)
|
|
||||||
|
|
||||||
HDFS-2700. Fix failing TestDataNodeMultipleRegistrations in trunk
|
|
||||||
(Uma Maheswara Rao G via todd)
|
|
||||||
|
|
||||||
HDFS-2739. SecondaryNameNode doesn't start up. (jitendra)
|
|
||||||
|
|
||||||
HDFS-2768. BackupNode stop can not close proxy connections because
|
|
||||||
it is not a proxy instance. (Uma Maheswara Rao G via eli)
|
|
||||||
|
|
||||||
HDFS-2968. Protocol translator for BlockRecoveryCommand broken when
|
|
||||||
multiple blocks need recovery. (todd)
|
|
||||||
|
|
||||||
HDFS-3020. Fix editlog to automatically sync when buffer is full. (todd)
|
|
||||||
|
|
||||||
HDFS-3038. Add FSEditLog.metrics to findbugs exclude list. (todd via atm)
|
|
||||||
|
|
||||||
HDFS-2285. BackupNode should reject requests to modify namespace.
|
|
||||||
(shv and Uma Maheswara Rao)
|
|
||||||
|
|
||||||
HDFS-2764. TestBackupNode is racy. (atm)
|
|
||||||
|
|
||||||
HDFS-2188. Make FSEditLog create its journals from a list of URIs rather
|
|
||||||
than NNStorage. (Ivan Kelly via jitendra)
|
|
||||||
|
|
||||||
HDFS-1765. Block Replication should respect under-replication
|
|
||||||
block priority. (Uma Maheswara Rao G via eli)
|
|
||||||
|
|
||||||
Release 0.23.2 - UNRELEASED
|
Release 0.23.2 - UNRELEASED
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
INCOMPATIBLE CHANGES
|
||||||
|
|||||||
Loading…
Reference in New Issue
Block a user