Ewan Higgs
|
c1d24f8483
|
HDFS-13713. Add specification of Multipart Upload API to FS specification, with contract tests.
Contributed by Ewan Higgs and Steve Loughran.
|
2018-11-29 15:12:17 +00:00 |
|
Sean Mackrory
|
085f10e75d
|
HADOOP-15947. Fix ITestDynamoDBMetadataStore test error issues. Contributed by Gabor Bota.
|
2018-11-28 10:45:09 -07:00 |
|
Sean Mackrory
|
e148c3ff09
|
HADOOP-15798. LocalMetadataStore put() does not retain isDeleted in parent listing. Contributed by Gabor Bota.
|
2018-11-28 10:45:09 -07:00 |
|
Sean Mackrory
|
5d96b74f33
|
HADOOP-15370. S3A log message on rm s3a://bucket/ not intuitive. Contributed by Gabor Bota.
|
2018-11-28 10:45:09 -07:00 |
|
Steve Loughran
|
4c106fca0c
|
HADOOP-15932. Oozie unable to create sharelib in s3a filesystem.
Contributed by Steve Loughran.
|
2018-11-27 20:39:54 +00:00 |
|
Steve Loughran
|
d59ca43bff
|
HADOOP-15826. @Retries annotation of putObject() call & uses wrong.
Contributed by Steve Loughran and Ewan Higgs.
|
2018-10-16 20:02:54 +01:00 |
|
Steve Loughran
|
ee816f1fd7
|
HADOOP-15837. DynamoDB table Update can fail S3A FS init.
Contributed by Steve Loughran.
|
2018-10-11 14:57:38 +01:00 |
|
Steve Loughran
|
7ba1cfdea7
|
HADOOP-15827. NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth S3Guard.
Contributed by Gabor Bota
|
2018-10-09 10:46:41 +01:00 |
|
Aaron Fabbri
|
4f752d442b
|
HADOOP-15621 2/2 S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing. Contributed by Gabor Bota
|
2018-10-03 00:24:29 -07:00 |
|
Aaron Fabbri
|
046b8768af
|
HADOOP-15621 S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing. Contributed by Gabor Bota
|
2018-10-02 21:22:49 -07:00 |
|
Sunil G
|
d060cbea48
|
HDFS-13937. Multipart Uploader APIs to be marked as private/unstable in 3.2.0. Contributed by Steve Loughran.
|
2018-09-24 21:19:47 +05:30 |
|
Steve Loughran
|
d7c0a08a1c
|
HADOOP-15426 Make S3guard client resilient to DDB throttle events and network failures (Contributed by Steve Loughran)
|
2018-09-12 21:04:49 -07:00 |
|
Aaron Fabbri
|
d32a8d5d58
|
HADOOP-14734 add option to tag DDB table(s) created. (Contributed by Gabor Bota and Abe Fine)
|
2018-09-12 16:36:01 -07:00 |
|
Sean Mackrory
|
47b72c87eb
|
HADOOP-15635. s3guard set-capacity command to fail fast if bucket is unguarded.
Contributed by Gabor Bota.
|
2018-09-12 09:12:38 -06:00 |
|
Mingliang Liu
|
87f63b6479
|
HADOOP-14833. Remove s3a user:secret authentication. Contributed by Steve Loughran
|
2018-09-11 17:18:42 -07:00 |
|
Gabor Bota
|
36c7c78260
|
HADOOP-15709 Move S3Guard LocalMetadataStore constants to org.apache.hadoop.fs.s3a.Constants (Contributed by Gabor Bota)
|
2018-09-07 10:25:20 -07:00 |
|
Steve Loughran
|
5a0babf765
|
HADOOP-15107. Stabilize/tune S3A committers; review correctness & docs.
Contributed by Steve Loughran.
|
2018-08-30 14:49:53 +01:00 |
|
Steve Loughran
|
2e6c1109dc
|
HADOOP-15667. FileSystemMultipartUploader should verify that UploadHandle has non-0 length.
Contributed by Ewan Higgs
|
2018-08-30 14:33:16 +01:00 |
|
Aaron Fabbri
|
d7232857d8
|
HADOOP-14154 Persist isAuthoritative bit in DynamoDBMetaStore (Contributed by Gabor Bota)
|
2018-08-17 10:15:39 -07:00 |
|
Steve Loughran
|
da9a39eed1
|
HADOOP-15583. Stabilize S3A Assumed Role support.
Contributed by Steve Loughran.
|
2018-08-08 22:57:24 -07:00 |
|
Ewan Higgs
|
2ec97abb2e
|
HADOOP-15576. S3A Multipart Uploader to work with S3Guard and encryption Originally contributed by Ewan Higgs with refinements by Steve Loughran.
|
2018-08-08 13:50:23 +02:00 |
|
Sean Mackrory
|
a08812a1b1
|
HADOOP-15349. S3Guard DDB retryBackoff to be more informative on limits exceeded. Contributed by Gabor Bota.
|
2018-07-12 17:24:01 +02:00 |
|
Sean Mackrory
|
d503f65b66
|
HADOOP-15541. [s3a] Shouldn't try to drain stream before aborting
connection in case of timeout.
|
2018-07-10 17:52:57 +02:00 |
|
Aaron Fabbri
|
93ac01cb59
|
HADOOP-15215 s3guard set-capacity command to fail on read/write of 0 (Gabor Bota)
|
2018-07-03 13:50:11 -07:00 |
|
Akira Ajisaka
|
2b2399d623
|
HADOOP-15495. Upgrade commons-lang version to 3.7 in hadoop-common-project and hadoop-tools. Contributed by Takanobu Asanuma.
|
2018-06-28 14:37:22 +09:00 |
|
Sean Mackrory
|
c687a6617d
|
HADOOP-15423. Merge fileCache and dirCache into ine single cache in LocalMetadataStore. Contributed by Gabor Bota.
|
2018-06-25 14:59:41 -06:00 |
|
Sean Mackrory
|
55fad6a3de
|
HADOOP-15416. Clear error message in S3Guard diff if source not found. Contributed by Gabor Bota.
|
2018-06-22 11:36:56 -06:00 |
|
Sean Mackrory
|
b089a06793
|
HADOOP-14918. Remove the Local Dynamo DB test option. Contributed by Gabor Bota.
|
2018-06-20 16:45:08 -06:00 |
|
Chris Douglas
|
980031bb04
|
HADOOP-13186. Multipart Uploader API. Contributed by Ewan Higgs
|
2018-06-17 11:54:26 -07:00 |
|
Steve Loughran
|
cc3600aabd
|
HADOOP-15469. S3A directory committer commit job fails if _temporary directory created under dest.
Contributed by Steve Loughran.
(cherry picked from commit 170f1040d46f9b1a084e6637def91e9864446acc)
|
2018-05-17 19:08:55 +01:00 |
|
Steve Loughran
|
b670837469
|
HADOOP-15442. ITestS3AMetrics.testMetricsRegister can't know metrics source's name.
Contributed by Sean Mackrory.
|
2018-05-15 16:13:56 +01:00 |
|
Aaron Fabbri
|
8981674bbc
|
HADOOP-15420 s3guard ITestS3GuardToolLocal failures in diff tests (Gabor Bota)
|
2018-05-08 18:58:42 -07:00 |
|
Aaron Fabbri
|
69aac696d9
|
HADOOP-13649 s3guard: implement time-based (TTL) expiry for LocalMetadataStore (Gabor Bota)
|
2018-05-08 15:29:54 -07:00 |
|
Aaron Fabbri
|
919865a34b
|
HADOOP-15239 S3ABlockOutputStream.flush() be no-op when stream closed. Contributed by Gabor Bota.
|
2018-04-30 16:02:57 -07:00 |
|
Aaron Fabbri
|
7d8bcf534a
|
HADOOP-13756 LocalMetadataStore#put(DirListingMetadata) should also put file metadata into fileHash. (Gabor Bota)
|
2018-04-26 20:41:29 -07:00 |
|
Aaron Fabbri
|
989a3929a9
|
HADOOP-14756 S3Guard: expose capability query in MetadataStore and add tests of authoritative mode (Gabor Bota)
|
2018-04-23 15:26:53 -07:00 |
|
Aaron Fabbri
|
b0aff8a962
|
HADOOP-15346 S3ARetryPolicy for 400/BadArgument to be "fail". Contributed by Steve Loughran.
|
2018-04-10 23:55:38 -07:00 |
|
Aaron Fabbri
|
ea3849f0cc
|
HADOOP-14759 S3GuardTool prune to prune specific bucket entries. Contributed by Gabor Bota.
|
2018-04-05 20:23:17 -07:00 |
|
Steve Loughran
|
5a174f8ac6
|
HADOOP-14758. S3GuardTool.prune to handle UnsupportedOperationException.
Contributed by Gabor Bota.
|
2018-04-03 16:31:34 +01:00 |
|
Steve Loughran
|
dd05871b8b
|
HADOOP-15297. Make S3A etag => checksum feature optional.
Contributed by Steve Loughran.
|
2018-03-12 14:01:42 +00:00 |
|
Steve Loughran
|
e0307e53e2
|
HADOOP-15267. S3A multipart upload fails when SSE-C encryption is enabled.
Contributed by Anis Elleuch.
(cherry picked from commit 1dedc68f9d8d8544d715e67ee77cd3f017c21699)
|
2018-03-07 18:51:10 +00:00 |
|
Steve Loughran
|
8110d6a0d5
|
HADOOP-13761. S3Guard: implement retries for DDB failures and throttling; translate exceptions.
Contributed by Aaron Fabbri.
|
2018-03-05 14:06:20 +00:00 |
|
fang zhenyi
|
4d4dde5112
|
HADOOP-15223. Replace Collections.EMPTY* with empty* when available
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-02-18 22:19:39 +09:00 |
|
Steve Loughran
|
7ac88244c5
|
HADOOP-14507. Extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret.key.
Contributed by Steve Loughran.
|
2018-02-16 16:37:06 +00:00 |
|
Steve Loughran
|
9a013b255f
|
HADOOP-15176. Enhance IAM Assumed Role support in S3A client.
Contributed by Steve Loughran
(cherry picked from commit 96c047fbb98c2378eed9693a724d4cbbd03c00fd)
|
2018-02-15 15:57:10 +00:00 |
|
Steve Loughran
|
1093a73689
|
HADOOP-13974. S3Guard CLI to support list/purge of pending multipart commits.
Contributed by Aaron Fabbri
|
2018-01-18 13:13:58 +00:00 |
|
Steve Loughran
|
f274fe33ea
|
Revert "HADOOP-13974. S3Guard CLI to support list/purge of pending multipart commits."
This reverts commit 35ad9b1dd2.
|
2018-01-18 12:35:57 +00:00 |
|
Aaron Fabbri
|
268ab4e027
|
HADOOP-15141 Support IAM Assumed roles in S3A. Contributed by Steve Loughran.
|
2018-01-17 00:05:24 -08:00 |
|
Steve Loughran
|
a0c71dcc33
|
HADOOP-15079. ITestS3AFileOperationCost#testFakeDirectoryDeletion failing
after OutputCommitter patch.
Contributed by Steve Loughran
|
2018-01-15 11:33:32 +00:00 |
|
Mukul Kumar Singh
|
2e1e9017aa
|
HADOOP-15172. Fix the javadoc warning in WriteOperationHelper.java
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-01-15 15:45:51 +09:00 |
|