hadoop/hadoop-common-project/hadoop-common
Ben Roling a36274d699
HADOOP-16085. S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite.
Contributed by Ben Roling.

S3Guard will now track the etag of uploaded files and, if an S3
bucket is versioned, the object version.

You can then control how to react to a mismatch between the data
in the DynamoDB table and that in the store: warn, fail, or, when
using versions, return the original value.

This adds two new columns to the table: etag and version.
This is transparent to older S3A clients -but when such clients
add/update data to the S3Guard table, they will not add these values.
As a result, the etag/version checks will not work with files uploaded by older clients.

For a consistent experience, upgrade all clients to use the latest hadoop version.
2019-05-19 22:29:54 +01:00
..
dev-support HADOOP-16293. AuthenticationFilterInitializer doc has speudo instead of pseudo. 2019-05-08 10:18:20 +01:00
src HADOOP-16085. S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite. 2019-05-19 22:29:54 +01:00
HadoopCommon.cmake HDFS-14394: Add -std=c99 / -std=gnu99 to libhdfs compile flags 2019-04-03 10:56:33 -07:00
HadoopJNI.cmake HDFS-13822. speedup libhdfs++ build (enable parallel build). Contributed by Allen Wittenauer and Pradeep Ambati 2018-08-17 12:25:36 -05:00
pom.xml HADOOP-16050: s3a SSL connections should use OpenSSL 2019-05-16 08:57:54 -06:00