Go to file
Ben Roling a36274d699
HADOOP-16085. S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite.
Contributed by Ben Roling.

S3Guard will now track the etag of uploaded files and, if an S3
bucket is versioned, the object version.

You can then control how to react to a mismatch between the data
in the DynamoDB table and that in the store: warn, fail, or, when
using versions, return the original value.

This adds two new columns to the table: etag and version.
This is transparent to older S3A clients -but when such clients
add/update data to the S3Guard table, they will not add these values.
As a result, the etag/version checks will not work with files uploaded by older clients.

For a consistent experience, upgrade all clients to use the latest hadoop version.
2019-05-19 22:29:54 +01:00
dev-support HADOOP-16052. Remove Subversion and Forrest from Dockerfile 2019-04-11 19:56:15 +09:00
hadoop-assemblies YARN-9016 DocumentStore as a backend for ATSv2. Contributed by Sushil Ks. 2019-03-13 16:45:23 -07:00
hadoop-build-tools HADOOP-16232. Fix errors in the checkstyle configration xmls. Contributed by Wanqiang Ji. 2019-04-03 19:35:02 +09:00
hadoop-client-modules HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki. 2019-01-29 18:29:56 -08:00
hadoop-cloud-storage-project Changed version in trunk to 3.3.0-SNAPSHOT. 2018-10-02 22:41:41 +05:30
hadoop-common-project HADOOP-16085. S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite. 2019-05-19 22:29:54 +01:00
hadoop-dist Changed version in trunk to 3.3.0-SNAPSHOT. 2018-10-02 22:41:41 +05:30
hadoop-hdds HDDS-1422. Exception during DataNode shutdown. Contributed by Arpit A… (#725) 2019-05-18 11:47:19 +02:00
hadoop-hdfs-project HDFS-14323. Distcp fails in Hadoop 3.x when 2.x source webhdfs url has special characters in hdfs file path. Contributed by Srinivasu Majeti. 2019-05-17 19:20:28 +02:00
hadoop-mapreduce-project MAPREDUCE-7200. Remove stale eclipse templates. Contributed by Wanqiang Ji. 2019-04-25 11:18:39 +09:00
hadoop-maven-plugins HADOOP-15935. [JDK 11] Update maven.plugin-tools.version to 3.6.0. Contributed by Dinesh Chitlangia. 2018-12-20 14:17:32 +09:00
hadoop-minicluster YARN-8899. Fixed minicluster dependency on yarn-server-web-proxy. 2018-10-18 15:46:15 -04:00
hadoop-ozone HDDS-1527. HDDS Datanode start fails due to datanode.id file read error. Contributed by Siddharth Wagle. 2019-05-16 15:13:10 -07:00
hadoop-project HADOOP-16299. [JDK 11] Build fails without specifying -Djavac.version=11 2019-05-09 14:49:46 +09:00
hadoop-project-dist Make 3.2.0 aware to other branches - jdiff 2019-01-21 22:41:26 +05:30
hadoop-submarine SUBMARINE-58. Submarine client needs to generate fat jar. Contributed by Zac Zhou. 2019-05-19 21:18:33 +08:00
hadoop-tools HADOOP-16085. S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite. 2019-05-19 22:29:54 +01:00
hadoop-yarn-project YARN-9505. Add container allocation latency for Opportunistic Scheduler. Contributed by Abhishek Modi. 2019-05-17 12:03:21 -07:00
.gitattributes HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin. 2016-09-14 11:14:31 +09:00
.gitignore HDDS-1115. Provide ozone specific top-level pom.xml. 2019-02-24 14:40:52 -08:00
BUILDING.txt HDFS-14213. Remove Jansson from BUILDING.txt. Contributed by Dinesh Chitlangia. 2019-01-18 15:31:45 +09:00
Jenkinsfile HADOOP-16183. Use latest Yetus to support ozone specific build process 2019-05-02 16:48:30 +02:00
LICENSE.txt HADOOP-15881. Remove JUnit from LICENSE.txt 2019-04-17 20:22:41 +09:00
NOTICE.txt YARN-8914. Add xtermjs to YARN UI2. Contributed by Eric Yang and Akhil PB 2018-12-07 10:56:17 -08:00
pom.ozone.xml HDDS-1115. Provide ozone specific top-level pom.xml. 2019-02-24 14:40:52 -08:00
pom.xml HADOOP-16227. Upgrade checkstyle to 8.19 2019-04-15 10:46:10 +09:00
README.txt HADOOP-15832. Addendum: Upgrade BouncyCastle to 1.60. Contributed by Robert Kanter 2018-10-12 09:40:34 -07:00
start-build-env.sh HADOOP-16240. start-build-env.sh can consume all disk space during image creation. 2019-04-10 08:48:11 -07:00

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   http://wiki.apache.org/hadoop/

This distribution includes cryptographic software.  The country in 
which you currently reside may have restrictions on the import, 
possession, use, and/or re-export to another country, of 
encryption software.  BEFORE using any encryption software, please 
check your country's laws, regulations and policies concerning the
import, possession, or use, and re-export of encryption software, to 
see if this is permitted.  See <http://www.wassenaar.org/> for more
information.

The U.S. Government Department of Commerce, Bureau of Industry and
Security (BIS), has classified this software as Export Commodity 
Control Number (ECCN) 5D002.C.1, which includes information security
software using or performing cryptographic functions with asymmetric
algorithms.  The form and manner of this Apache Software Foundation
distribution makes it eligible for export under the License Exception
ENC Technology Software Unrestricted (TSU) exception (see the BIS 
Export Administration Regulations, Section 740.13) for both object 
code and source code.

The following provides more details on the included cryptographic
software:
  Hadoop Core uses the SSL libraries from the Jetty project written 
by mortbay.org.
  Hadoop Yarn Server Web Proxy uses the BouncyCastle Java
cryptography APIs written by the Legion of the Bouncy Castle Inc.