hadoop/hadoop-common-project
Petre Bogdan Stolojan 664075f35d
HADOOP-17198. Support S3 Access Points (#3260)
Add support for S3 Access Points. This provides extra security as it
ensures applications are not working with buckets belong to third parties.

To bind a bucket to an access point, set the access point (ap) ARN,
which must be done for each specific bucket, using the pattern

fs.s3a.bucket.$BUCKET.accesspoint.arn = ARN

* The global/bucket option `fs.s3a.accesspoint.required` to
mandate that buckets must declare their access point.
* This is not compatible with S3Guard.

Consult the documentation for further details.

Contributed by Bogdan Stolojan

(this commit contains the changes to TestArnResource from HADOOP-18068,
 "upgrade AWS SDK to 1.12.132" so that it works with the later SDK.)

Change-Id: I3fac213e52ca6ec1c813effb8496c353964b8e1b
2022-02-04 16:21:35 +00:00
..
hadoop-annotations Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-auth Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-auth-examples Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-common HADOOP-17198. Support S3 Access Points (#3260) 2022-02-04 16:21:35 +00:00
hadoop-kms HADOOP-18040. Use maven.test.failure.ignore instead of ignoreTestFailure (#3774) 2021-12-10 01:38:26 +09:00
hadoop-minikdc Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-nfs Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-registry HADOOP-18040. Use maven.test.failure.ignore instead of ignoreTestFailure (#3774) 2021-12-10 01:38:26 +09:00
pom.xml Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00