Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619203 13f79535-47bb-0310-9956-ffa450edef68
This commit is contained in:
parent
ef32d09030
commit
b0f0ef17f0
@ -1,61 +0,0 @@
|
|||||||
Hadoop Common Change Log for HDFS-6134 and HADOOP-10150
|
|
||||||
|
|
||||||
fs-encryption (Unreleased)
|
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
|
||||||
|
|
||||||
NEW FEATURES
|
|
||||||
|
|
||||||
HADOOP-10734. Implement high-performance secure random number sources.
|
|
||||||
(Yi Liu via Colin Patrick McCabe)
|
|
||||||
|
|
||||||
IMPROVEMENTS
|
|
||||||
|
|
||||||
HADOOP-10603. Crypto input and output streams implementing Hadoop stream
|
|
||||||
interfaces. (Yi Liu and Charles Lamb)
|
|
||||||
|
|
||||||
HADOOP-10628. Javadoc and few code style improvement for Crypto
|
|
||||||
input and output streams. (Yi Liu via clamb)
|
|
||||||
|
|
||||||
HADOOP-10632. Minor improvements to Crypto input and output streams.
|
|
||||||
(Yi Liu)
|
|
||||||
|
|
||||||
HADOOP-10635. Add a method to CryptoCodec to generate SRNs for IV. (Yi Liu)
|
|
||||||
|
|
||||||
HADOOP-10653. Add a new constructor for CryptoInputStream that
|
|
||||||
receives current position of wrapped stream. (Yi Liu)
|
|
||||||
|
|
||||||
HADOOP-10662. NullPointerException in CryptoInputStream while wrapped
|
|
||||||
stream is not ByteBufferReadable. Add tests using normal stream. (Yi Liu)
|
|
||||||
|
|
||||||
HADOOP-10713. Refactor CryptoCodec#generateSecureRandom to take a byte[].
|
|
||||||
(wang via yliu)
|
|
||||||
|
|
||||||
HADOOP-10693. Implementation of AES-CTR CryptoCodec using JNI to OpenSSL.
|
|
||||||
(Yi Liu via cmccabe)
|
|
||||||
|
|
||||||
HADOOP-10803. Update OpensslCipher#getInstance to accept CipherSuite#name
|
|
||||||
format. (Yi Liu)
|
|
||||||
|
|
||||||
HADOOP-10735. Fall back AesCtrCryptoCodec implementation from OpenSSL to
|
|
||||||
JCE if non native support. (Yi Liu)
|
|
||||||
|
|
||||||
HADOOP-10870. Failed to load OpenSSL cipher error logs on systems with old
|
|
||||||
openssl versions (cmccabe)
|
|
||||||
|
|
||||||
HADOOP-10853. Refactor get instance of CryptoCodec and support create via
|
|
||||||
algorithm/mode/padding. (Yi Liu)
|
|
||||||
|
|
||||||
HADOOP-10919. Copy command should preserve raw.* namespace
|
|
||||||
extended attributes. (clamb)
|
|
||||||
|
|
||||||
HDFS-6873. Constants in CommandWithDestination should be static. (clamb)
|
|
||||||
|
|
||||||
OPTIMIZATIONS
|
|
||||||
|
|
||||||
BUG FIXES
|
|
||||||
|
|
||||||
HADOOP-10871. incorrect prototype in OpensslSecureRandom.c (cmccabe)
|
|
||||||
|
|
||||||
HADOOP-10886. CryptoCodec#getCodecclasses throws NPE when configurations not
|
|
||||||
loaded. (umamahesh)
|
|
@ -442,6 +442,56 @@ Trunk (Unreleased)
|
|||||||
|
|
||||||
HADOOP-8589. ViewFs tests fail when tests and home dirs are nested (sanjay Radia)
|
HADOOP-8589. ViewFs tests fail when tests and home dirs are nested (sanjay Radia)
|
||||||
|
|
||||||
|
BREAKDOWN OF HDFS-6134 AND HADOOP-10150 SUBTASKS AND RELATED JIRAS
|
||||||
|
|
||||||
|
HADOOP-10734. Implement high-performance secure random number sources.
|
||||||
|
(Yi Liu via Colin Patrick McCabe)
|
||||||
|
|
||||||
|
HADOOP-10603. Crypto input and output streams implementing Hadoop stream
|
||||||
|
interfaces. (Yi Liu and Charles Lamb)
|
||||||
|
|
||||||
|
HADOOP-10628. Javadoc and few code style improvement for Crypto
|
||||||
|
input and output streams. (Yi Liu via clamb)
|
||||||
|
|
||||||
|
HADOOP-10632. Minor improvements to Crypto input and output streams.
|
||||||
|
(Yi Liu)
|
||||||
|
|
||||||
|
HADOOP-10635. Add a method to CryptoCodec to generate SRNs for IV. (Yi Liu)
|
||||||
|
|
||||||
|
HADOOP-10653. Add a new constructor for CryptoInputStream that
|
||||||
|
receives current position of wrapped stream. (Yi Liu)
|
||||||
|
|
||||||
|
HADOOP-10662. NullPointerException in CryptoInputStream while wrapped
|
||||||
|
stream is not ByteBufferReadable. Add tests using normal stream. (Yi Liu)
|
||||||
|
|
||||||
|
HADOOP-10713. Refactor CryptoCodec#generateSecureRandom to take a byte[].
|
||||||
|
(wang via yliu)
|
||||||
|
|
||||||
|
HADOOP-10693. Implementation of AES-CTR CryptoCodec using JNI to OpenSSL.
|
||||||
|
(Yi Liu via cmccabe)
|
||||||
|
|
||||||
|
HADOOP-10803. Update OpensslCipher#getInstance to accept CipherSuite#name
|
||||||
|
format. (Yi Liu)
|
||||||
|
|
||||||
|
HADOOP-10735. Fall back AesCtrCryptoCodec implementation from OpenSSL to
|
||||||
|
JCE if non native support. (Yi Liu)
|
||||||
|
|
||||||
|
HADOOP-10870. Failed to load OpenSSL cipher error logs on systems with old
|
||||||
|
openssl versions (cmccabe)
|
||||||
|
|
||||||
|
HADOOP-10853. Refactor get instance of CryptoCodec and support create via
|
||||||
|
algorithm/mode/padding. (Yi Liu)
|
||||||
|
|
||||||
|
HADOOP-10919. Copy command should preserve raw.* namespace
|
||||||
|
extended attributes. (clamb)
|
||||||
|
|
||||||
|
HDFS-6873. Constants in CommandWithDestination should be static. (clamb)
|
||||||
|
|
||||||
|
HADOOP-10871. incorrect prototype in OpensslSecureRandom.c (cmccabe)
|
||||||
|
|
||||||
|
HADOOP-10886. CryptoCodec#getCodecclasses throws NPE when configurations not
|
||||||
|
loaded. (umamahesh)
|
||||||
|
|
||||||
Release 2.6.0 - UNRELEASED
|
Release 2.6.0 - UNRELEASED
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
INCOMPATIBLE CHANGES
|
||||||
|
@ -1,102 +0,0 @@
|
|||||||
Hadoop HDFS Change Log for HDFS-6134 and HADOOP-10150
|
|
||||||
|
|
||||||
fs-encryption (Unreleased)
|
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
|
||||||
|
|
||||||
NEW FEATURES
|
|
||||||
|
|
||||||
IMPROVEMENTS
|
|
||||||
|
|
||||||
HDFS-6387. HDFS CLI admin tool for creating & deleting an
|
|
||||||
encryption zone. (clamb)
|
|
||||||
|
|
||||||
HDFS-6386. HDFS Encryption Zones (clamb)
|
|
||||||
|
|
||||||
HDFS-6388. HDFS integration with KeyProvider. (clamb)
|
|
||||||
|
|
||||||
HDFS-6473. Protocol and API for Encryption Zones (clamb)
|
|
||||||
|
|
||||||
HDFS-6392. Wire crypto streams for encrypted files in
|
|
||||||
DFSClient. (clamb and yliu)
|
|
||||||
|
|
||||||
HDFS-6476. Print out the KeyProvider after finding KP successfully on
|
|
||||||
startup. (Juan Yu via wang)
|
|
||||||
|
|
||||||
HDFS-6391. Get the Key/IV from the NameNode for encrypted files in
|
|
||||||
DFSClient. (Charles Lamb and wang)
|
|
||||||
|
|
||||||
HDFS-6389. Rename restrictions for encryption zones. (clamb)
|
|
||||||
|
|
||||||
HDFS-6605. Client server negotiation of cipher suite. (wang)
|
|
||||||
|
|
||||||
HDFS-6625. Remove the Delete Encryption Zone function (clamb)
|
|
||||||
|
|
||||||
HDFS-6516. List of Encryption Zones should be based on inodes (clamb)
|
|
||||||
|
|
||||||
HDFS-6629. Not able to create symlinks after HDFS-6516 (umamaheswararao)
|
|
||||||
|
|
||||||
HDFS-6635. Refactor encryption zone functionality into new
|
|
||||||
EncryptionZoneManager class. (wang)
|
|
||||||
|
|
||||||
HDFS-6474. Namenode needs to get the actual keys and iv from the
|
|
||||||
KeyProvider. (wang)
|
|
||||||
|
|
||||||
HDFS-6619. Clean up encryption-related tests. (wang)
|
|
||||||
|
|
||||||
HDFS-6405. Test Crypto streams in HDFS. (yliu via wang)
|
|
||||||
|
|
||||||
HDFS-6490. Fix the keyid format for generated keys in
|
|
||||||
FSNamesystem.createEncryptionZone (clamb)
|
|
||||||
|
|
||||||
HDFS-6716. Update usage of KeyProviderCryptoExtension APIs on NameNode.
|
|
||||||
(wang)
|
|
||||||
|
|
||||||
HDFS-6718. Remove EncryptionZoneManager lock. (wang)
|
|
||||||
|
|
||||||
HDFS-6720. Remove KeyProvider in EncryptionZoneManager. (wang)
|
|
||||||
|
|
||||||
HDFS-6738. Remove unnecessary getEncryptionZoneForPath call in
|
|
||||||
EZManager#createEncryptionZone. (clamb)
|
|
||||||
|
|
||||||
HDFS-6724. Decrypt EDEK before creating
|
|
||||||
CryptoInputStream/CryptoOutputStream. (wang)
|
|
||||||
|
|
||||||
HDFS-6509. Create a special /.reserved/raw directory for raw access to
|
|
||||||
encrypted data. (clamb via wang)
|
|
||||||
|
|
||||||
HDFS-6771. Require specification of an encryption key when creating
|
|
||||||
an encryption zone. (wang)
|
|
||||||
|
|
||||||
HDFS-6730. Create a .RAW extended attribute namespace. (clamb)
|
|
||||||
|
|
||||||
HDFS-6692. Add more HDFS encryption tests. (wang)
|
|
||||||
|
|
||||||
HDFS-6780. Batch the encryption zones listing API. (wang)
|
|
||||||
|
|
||||||
HDFS-6394. HDFS encryption documentation. (wang)
|
|
||||||
|
|
||||||
HDFS-6834. Improve the configuration guidance in DFSClient when there
|
|
||||||
are no Codec classes found in configs. (umamahesh)
|
|
||||||
|
|
||||||
HDFS-6546. Add non-superuser capability to get the encryption zone
|
|
||||||
for a specific path. (clamb)
|
|
||||||
|
|
||||||
OPTIMIZATIONS
|
|
||||||
|
|
||||||
BUG FIXES
|
|
||||||
|
|
||||||
HDFS-6733. Creating encryption zone results in NPE when
|
|
||||||
KeyProvider is null. (clamb)
|
|
||||||
|
|
||||||
HDFS-6785. Should not be able to create encryption zone using path
|
|
||||||
to a non-directory file. (clamb)
|
|
||||||
|
|
||||||
HDFS-6807. Fix TestReservedRawPaths. (clamb)
|
|
||||||
|
|
||||||
HDFS-6814. Mistakenly dfs.namenode.list.encryption.zones.num.responses configured
|
|
||||||
as boolean. (umamahesh)
|
|
||||||
|
|
||||||
HDFS-6817. Fix findbugs and other warnings. (yliu)
|
|
||||||
|
|
||||||
HDFS-6839. Fix TestCLI to expect new output. (clamb)
|
|
@ -255,6 +255,97 @@ Trunk (Unreleased)
|
|||||||
HDFS-6657. Remove link to 'Legacy UI' in trunk's Namenode UI.
|
HDFS-6657. Remove link to 'Legacy UI' in trunk's Namenode UI.
|
||||||
(Vinayakumar B via wheat 9)
|
(Vinayakumar B via wheat 9)
|
||||||
|
|
||||||
|
BREAKDOWN OF HDFS-6134 AND HADOOP-10150 SUBTASKS AND RELATED JIRAS
|
||||||
|
|
||||||
|
HDFS-6387. HDFS CLI admin tool for creating & deleting an
|
||||||
|
encryption zone. (clamb)
|
||||||
|
|
||||||
|
HDFS-6386. HDFS Encryption Zones (clamb)
|
||||||
|
|
||||||
|
HDFS-6388. HDFS integration with KeyProvider. (clamb)
|
||||||
|
|
||||||
|
HDFS-6473. Protocol and API for Encryption Zones (clamb)
|
||||||
|
|
||||||
|
HDFS-6392. Wire crypto streams for encrypted files in
|
||||||
|
DFSClient. (clamb and yliu)
|
||||||
|
|
||||||
|
HDFS-6476. Print out the KeyProvider after finding KP successfully on
|
||||||
|
startup. (Juan Yu via wang)
|
||||||
|
|
||||||
|
HDFS-6391. Get the Key/IV from the NameNode for encrypted files in
|
||||||
|
DFSClient. (Charles Lamb and wang)
|
||||||
|
|
||||||
|
HDFS-6389. Rename restrictions for encryption zones. (clamb)
|
||||||
|
|
||||||
|
HDFS-6605. Client server negotiation of cipher suite. (wang)
|
||||||
|
|
||||||
|
HDFS-6625. Remove the Delete Encryption Zone function (clamb)
|
||||||
|
|
||||||
|
HDFS-6516. List of Encryption Zones should be based on inodes (clamb)
|
||||||
|
|
||||||
|
HDFS-6629. Not able to create symlinks after HDFS-6516 (umamaheswararao)
|
||||||
|
|
||||||
|
HDFS-6635. Refactor encryption zone functionality into new
|
||||||
|
EncryptionZoneManager class. (wang)
|
||||||
|
|
||||||
|
HDFS-6474. Namenode needs to get the actual keys and iv from the
|
||||||
|
KeyProvider. (wang)
|
||||||
|
|
||||||
|
HDFS-6619. Clean up encryption-related tests. (wang)
|
||||||
|
|
||||||
|
HDFS-6405. Test Crypto streams in HDFS. (yliu via wang)
|
||||||
|
|
||||||
|
HDFS-6490. Fix the keyid format for generated keys in
|
||||||
|
FSNamesystem.createEncryptionZone (clamb)
|
||||||
|
|
||||||
|
HDFS-6716. Update usage of KeyProviderCryptoExtension APIs on NameNode.
|
||||||
|
(wang)
|
||||||
|
|
||||||
|
HDFS-6718. Remove EncryptionZoneManager lock. (wang)
|
||||||
|
|
||||||
|
HDFS-6720. Remove KeyProvider in EncryptionZoneManager. (wang)
|
||||||
|
|
||||||
|
HDFS-6738. Remove unnecessary getEncryptionZoneForPath call in
|
||||||
|
EZManager#createEncryptionZone. (clamb)
|
||||||
|
|
||||||
|
HDFS-6724. Decrypt EDEK before creating
|
||||||
|
CryptoInputStream/CryptoOutputStream. (wang)
|
||||||
|
|
||||||
|
HDFS-6509. Create a special /.reserved/raw directory for raw access to
|
||||||
|
encrypted data. (clamb via wang)
|
||||||
|
|
||||||
|
HDFS-6771. Require specification of an encryption key when creating
|
||||||
|
an encryption zone. (wang)
|
||||||
|
|
||||||
|
HDFS-6730. Create a .RAW extended attribute namespace. (clamb)
|
||||||
|
|
||||||
|
HDFS-6692. Add more HDFS encryption tests. (wang)
|
||||||
|
|
||||||
|
HDFS-6780. Batch the encryption zones listing API. (wang)
|
||||||
|
|
||||||
|
HDFS-6394. HDFS encryption documentation. (wang)
|
||||||
|
|
||||||
|
HDFS-6834. Improve the configuration guidance in DFSClient when there
|
||||||
|
are no Codec classes found in configs. (umamahesh)
|
||||||
|
|
||||||
|
HDFS-6546. Add non-superuser capability to get the encryption zone
|
||||||
|
for a specific path. (clamb)
|
||||||
|
|
||||||
|
HDFS-6733. Creating encryption zone results in NPE when
|
||||||
|
KeyProvider is null. (clamb)
|
||||||
|
|
||||||
|
HDFS-6785. Should not be able to create encryption zone using path
|
||||||
|
to a non-directory file. (clamb)
|
||||||
|
|
||||||
|
HDFS-6807. Fix TestReservedRawPaths. (clamb)
|
||||||
|
|
||||||
|
HDFS-6814. Mistakenly dfs.namenode.list.encryption.zones.num.responses configured
|
||||||
|
as boolean. (umamahesh)
|
||||||
|
|
||||||
|
HDFS-6817. Fix findbugs and other warnings. (yliu)
|
||||||
|
|
||||||
|
HDFS-6839. Fix TestCLI to expect new output. (clamb)
|
||||||
|
|
||||||
Release 2.6.0 - UNRELEASED
|
Release 2.6.0 - UNRELEASED
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
INCOMPATIBLE CHANGES
|
||||||
|
@ -1,20 +0,0 @@
|
|||||||
Hadoop MapReduce Change Log
|
|
||||||
|
|
||||||
fs-encryption (Unreleased)
|
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
|
||||||
|
|
||||||
NEW FEATURES
|
|
||||||
|
|
||||||
MAPREDUCE-5890. Support for encrypting Intermediate
|
|
||||||
data and spills in local filesystem. (asuresh via tucu)
|
|
||||||
|
|
||||||
IMPROVEMENTS
|
|
||||||
|
|
||||||
MAPREDUCE-6007. Add support to distcp to preserve raw.* namespace
|
|
||||||
extended attributes. (clamb)
|
|
||||||
|
|
||||||
HDFS-6872. Fix TestOptionsParser. (clamb)
|
|
||||||
|
|
||||||
BUG FIXES
|
|
||||||
|
|
@ -154,6 +154,16 @@ Trunk (Unreleased)
|
|||||||
MAPREDUCE-5867. Fix NPE in KillAMPreemptionPolicy related to
|
MAPREDUCE-5867. Fix NPE in KillAMPreemptionPolicy related to
|
||||||
ProportionalCapacityPreemptionPolicy (Sunil G via devaraj)
|
ProportionalCapacityPreemptionPolicy (Sunil G via devaraj)
|
||||||
|
|
||||||
|
BREAKDOWN OF HDFS-6134 AND HADOOP-10150 SUBTASKS AND RELATED JIRAS
|
||||||
|
|
||||||
|
MAPREDUCE-5890. Support for encrypting Intermediate
|
||||||
|
data and spills in local filesystem. (asuresh via tucu)
|
||||||
|
|
||||||
|
MAPREDUCE-6007. Add support to distcp to preserve raw.* namespace
|
||||||
|
extended attributes. (clamb)
|
||||||
|
|
||||||
|
MAPREDUCE-6041. Fix TestOptionsParser. (clamb)
|
||||||
|
|
||||||
Release 2.6.0 - UNRELEASED
|
Release 2.6.0 - UNRELEASED
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
INCOMPATIBLE CHANGES
|
||||||
|
Loading…
Reference in New Issue
Block a user