Mingliang Liu
|
1f6c4545cf
|
HADOOP-15750. Remove obsolete S3A test ITestS3ACredentialsInURL. Contributed by Steve Loughran
|
2018-09-12 10:58:39 -07:00 |
|
Sean Mackrory
|
47b72c87eb
|
HADOOP-15635. s3guard set-capacity command to fail fast if bucket is unguarded.
Contributed by Gabor Bota.
|
2018-09-12 09:12:38 -06:00 |
|
bibinchundatt
|
c44088ac19
|
YARN-8739. Fix jenkins issues for Node Attributes branch. Contributed by Sunil Govindan.
|
2018-09-12 16:01:01 +05:30 |
|
Naganarasimha
|
eb08543c7a
|
YARN-8103. Add CLI interface to query node attributes. Contributed by Bibin A Chundatt.
|
2018-09-12 16:01:01 +05:30 |
|
Sunil G
|
89b3ebd11e
|
YARN-8092. Expose Node Attributes info via RM nodes REST API. Contributed by Weiwei Yang.
|
2018-09-12 16:01:00 +05:30 |
|
Mingliang Liu
|
87f63b6479
|
HADOOP-14833. Remove s3a user:secret authentication. Contributed by Steve Loughran
|
2018-09-11 17:18:42 -07:00 |
|
Steve Loughran
|
1eef0acfe5
|
HADOOP-15677. WASB: Add support for StreamCapabilities.
Contributed by Thomas Marquardt.
|
2018-09-10 14:24:41 +01:00 |
|
Gabor Bota
|
36c7c78260
|
HADOOP-15709 Move S3Guard LocalMetadataStore constants to org.apache.hadoop.fs.s3a.Constants (Contributed by Gabor Bota)
|
2018-09-07 10:25:20 -07:00 |
|
Steve Loughran
|
5a0babf765
|
HADOOP-15107. Stabilize/tune S3A committers; review correctness & docs.
Contributed by Steve Loughran.
|
2018-08-30 14:49:53 +01:00 |
|
Steve Loughran
|
e8d138ca7c
|
HADOOP-15680. ITestNativeAzureFileSystemConcurrencyLive times out.
Contributed by Andras Bokor.
|
2018-08-30 14:36:00 +01:00 |
|
Steve Loughran
|
2e6c1109dc
|
HADOOP-15667. FileSystemMultipartUploader should verify that UploadHandle has non-0 length.
Contributed by Ewan Higgs
|
2018-08-30 14:33:16 +01:00 |
|
Yufei Gu
|
8563fd67be
|
YARN-8632. Threads in SLS quit without logging exception. Contributed by Xianghao Lu.
|
2018-08-24 11:23:17 -07:00 |
|
Surendra Singh Lilhore
|
96c4575d73
|
HDFS-13805. Journal Nodes should allow to format non-empty directories with -force option. Contributed by Surendra Singh Lilhore.
|
2018-08-24 08:14:57 +05:30 |
|
Aaron Fabbri
|
d7232857d8
|
HADOOP-14154 Persist isAuthoritative bit in DynamoDBMetaStore (Contributed by Gabor Bota)
|
2018-08-17 10:15:39 -07:00 |
|
Steve Loughran
|
0e832e7a74
|
HADOOP-15642. Update aws-sdk version to 1.11.375.
Contributed by Steve Loughran.
|
2018-08-16 09:58:46 -07:00 |
|
Akira Ajisaka
|
3e3963b035
|
HADOOP-15552. Move logging APIs over to slf4j in hadoop-tools - Part2. Contributed by Ian Pickering.
|
2018-08-16 00:31:59 +09:00 |
|
Ewan Higgs
|
a13929ddcb
|
HADOOP-15645. ITestS3GuardToolLocal.testDiffCommand fails if bucket has per-bucket binding to DDB. Contributed by Steve Loughran.
|
2018-08-13 12:57:45 +02:00 |
|
Steve Loughran
|
da9a39eed1
|
HADOOP-15583. Stabilize S3A Assumed Role support.
Contributed by Steve Loughran.
|
2018-08-08 22:57:24 -07:00 |
|
Ewan Higgs
|
2ec97abb2e
|
HADOOP-15576. S3A Multipart Uploader to work with S3Guard and encryption Originally contributed by Ewan Higgs with refinements by Steve Loughran.
|
2018-08-08 13:50:23 +02:00 |
|
Sean Mackrory
|
7862f1523f
|
HADOOP-15400. Improve S3Guard documentation on Authoritative Mode implementation. (Contributed by Gabor Bota)
|
2018-08-07 20:13:09 -06:00 |
|
Steve Loughran
|
48673bc2a8
|
HADOOP-15626. FileContextMainOperationsBaseTest.testBuilderCreateAppendExistingFile fails on filesystems without append.
Contributed by Steve Loughran.
|
2018-08-03 16:06:00 -07:00 |
|
Inigo Goiri
|
9fea5c9ee7
|
YARN-8175. Add support for Node Labels in SLS. Contributed by Abhishek Modi.
|
2018-07-31 09:36:34 -07:00 |
|
Sammi Chen
|
0857f116b7
|
HADOOP-15607. AliyunOSS: fix duplicated partNumber issue in AliyunOSSBlockOutputStream. Contributed by Jinhu Wu.
|
2018-07-30 10:53:44 +08:00 |
|
Sean Mackrory
|
59adeb8d7f
|
HADOOP-15636. Follow-up from HADOOP-14918; restoring test under new name. Contributed by Gabor Bota.
|
2018-07-27 18:23:29 -06:00 |
|
bibinchundatt
|
3d3158cea4
|
YARN-8577. Fix the broken anchor in SLS site-doc. Contributed by Weiwei Yang.
|
2018-07-25 18:59:05 +05:30 |
|
Steve Loughran
|
45d9568aaa
|
HADOOP-15547/ WASB: improve listStatus performance.
Contributed by Thomas Marquardt.
(cherry picked from commit 749fff577ed9afb4ef8a54b8948f74be083cc620)
|
2018-07-19 12:31:19 -07:00 |
|
Wangda Tan
|
752dcce5f4
|
YARN-8511. When AM releases a container, RM removes allocation tags before it is released by NM. (Weiwei Yang via wangda)
Change-Id: I6f9f409f2ef685b405cbff547dea9623bf3322d9
|
2018-07-16 10:54:41 -07:00 |
|
Sean Mackrory
|
a08812a1b1
|
HADOOP-15349. S3Guard DDB retryBackoff to be more informative on limits exceeded. Contributed by Gabor Bota.
|
2018-07-12 17:24:01 +02:00 |
|
Sean Mackrory
|
d503f65b66
|
HADOOP-15541. [s3a] Shouldn't try to drain stream before aborting
connection in case of timeout.
|
2018-07-10 17:52:57 +02:00 |
|
Steve Loughran
|
ca8b80bf59
|
HADOOP-15384. distcp numListstatusThreads option doesn't get to -delete scan.
Contributed by Steve Loughran.
|
2018-07-10 10:43:59 +01:00 |
|
Aaron Fabbri
|
93ac01cb59
|
HADOOP-15215 s3guard set-capacity command to fail on read/write of 0 (Gabor Bota)
|
2018-07-03 13:50:11 -07:00 |
|
Inigo Goiri
|
1804a31515
|
HDFS-13536. [PROVIDED Storage] HA for InMemoryAliasMap. Contributed by Virajith Jalaparti.
|
2018-07-02 10:48:20 -07:00 |
|
Inigo Goiri
|
73746c5da7
|
HDFS-13707. [PROVIDED Storage] Fix failing integration tests in ITestProvidedImplementation. Contributed by Virajith Jalaparti.
|
2018-06-29 09:56:13 -07:00 |
|
Akira Ajisaka
|
2b2399d623
|
HADOOP-15495. Upgrade commons-lang version to 3.7 in hadoop-common-project and hadoop-tools. Contributed by Takanobu Asanuma.
|
2018-06-28 14:37:22 +09:00 |
|
Todd Lipcon
|
7a3c6e9c3c
|
HADOOP-15550. Avoid static initialization of ObjectMappers
|
2018-06-25 15:36:45 -07:00 |
|
Sean Mackrory
|
c687a6617d
|
HADOOP-15423. Merge fileCache and dirCache into ine single cache in LocalMetadataStore. Contributed by Gabor Bota.
|
2018-06-25 14:59:41 -06:00 |
|
Anu Engineer
|
e16e5b307d
|
HDDS-177. Create a releasable ozonefs artifact
Contributed by Marton, Elek.
|
2018-06-24 01:05:04 -07:00 |
|
Anu Engineer
|
ca14fec02f
|
HDDS-184. Upgrade common-langs version to 3.7 in hadoop-tools/hadoop-ozone.
Contributed by Takanobu Asanuma.
|
2018-06-23 15:49:44 -07:00 |
|
Sean Mackrory
|
55fad6a3de
|
HADOOP-15416. Clear error message in S3Guard diff if source not found. Contributed by Gabor Bota.
|
2018-06-22 11:36:56 -06:00 |
|
Sean Mackrory
|
b089a06793
|
HADOOP-14918. Remove the Local Dynamo DB test option. Contributed by Gabor Bota.
|
2018-06-20 16:45:08 -06:00 |
|
Chris Douglas
|
f34744603e
|
HADOOP-15533. Make WASB listStatus messages consistent. Contributed by Esfandiar Manii
|
2018-06-17 23:12:18 -07:00 |
|
Chris Douglas
|
980031bb04
|
HADOOP-13186. Multipart Uploader API. Contributed by Ewan Higgs
|
2018-06-17 11:54:26 -07:00 |
|
Jitendra Pandey
|
f4c7c91123
|
HADOOP-15483. Upgrade jquery to version 3.3.1. Contributed by Lokesh Jain, Mukul Kumar Singh and Sunil Govindan.
|
2018-06-13 00:36:02 -07:00 |
|
Inigo Goiri
|
c35481594f
|
YARN-8422. TestAMSimulator failing with NPE. Contributed by Giovanni Matteo Fumarola.
|
2018-06-12 10:59:50 -07:00 |
|
Steve Loughran
|
d901be6795
|
HADOOP-15506. Upgrade Azure Storage Sdk version to 7.0.0 and update corresponding code blocks.
Contributed by Esfandiar Manii.
|
2018-06-06 18:28:14 +01:00 |
|
Anu Engineer
|
3b34148c4f
|
HDDS-88. Create separate message structure to represent ports in DatanodeDetails.
Contributed by Nanda Kumar.
|
2018-05-30 08:52:07 -07:00 |
|
Aaron Fabbri
|
5f6769f796
|
HADOOP-15480 AbstractS3GuardToolTestBase.testDiffCommand fails when using dynamo (Gabor Bota)
|
2018-05-29 19:20:22 -07:00 |
|
Aaron Fabbri
|
30284d020d
|
HADOOP-14946 S3Guard testPruneCommandCLI can fail. Contributed by Gabor Bota.
|
2018-05-29 13:38:15 -07:00 |
|
Inigo Goiri
|
8fdc993a99
|
HADOOP-15498. TestHadoopArchiveLogs (#testGenerateScript, #testPrepareWorkingDir) fails on Windows. Contributed by Anbang Hu.
|
2018-05-28 16:45:42 -07:00 |
|
Johan Gustavsson
|
d14e26b31f
|
HADOOP-15477. Make unjar in RunJar overrideable
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-05-28 17:29:59 +09:00 |
|
Steve Loughran
|
ba842847c9
|
HADOOP-15478. WASB: hflush() and hsync() regression.
Contributed by Thomas Marquardt.
|
2018-05-21 11:12:34 +01:00 |
|
Steve Loughran
|
cc3600aabd
|
HADOOP-15469. S3A directory committer commit job fails if _temporary directory created under dest.
Contributed by Steve Loughran.
(cherry picked from commit 170f1040d46f9b1a084e6637def91e9864446acc)
|
2018-05-17 19:08:55 +01:00 |
|
Steve Loughran
|
b670837469
|
HADOOP-15442. ITestS3AMetrics.testMetricsRegister can't know metrics source's name.
Contributed by Sean Mackrory.
|
2018-05-15 16:13:56 +01:00 |
|
Steve Loughran
|
ba051b0686
|
HADOOP-15354. hadoop-aliyun & hadoop-azure modules to mark hadoop-common as provided
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-05-10 18:38:08 +09:00 |
|
Anu Engineer
|
46e0f27862
|
HDDS-18. Ozone Shell should use RestClient and RpcClient. Contributed by Lokesh Jain.
|
2018-05-09 23:00:13 -07:00 |
|
Sean Mackrory
|
1cfe7506f7
|
HADOOP-15356. Make HTTP timeout configurable in ADLS connector. Contributed by Atul Sikaria and Sean Mackrory.
|
2018-05-09 15:15:51 -06:00 |
|
Mukul Kumar Singh
|
343b51dcf4
|
HDDS-28. Ozone:Duplicate declaration in hadoop-tools/hadoop-ozone/pom.xml. Contributed by Tsz Wo Nicholas Sze.
|
2018-05-09 20:20:21 +05:30 |
|
Mukul Kumar Singh
|
208b97e969
|
HDDS-20. Ozone: Add support for rename key within a bucket for rpc client. Contributed by Lokesh Jain.
|
2018-05-09 19:06:07 +05:30 |
|
Aaron Fabbri
|
8981674bbc
|
HADOOP-15420 s3guard ITestS3GuardToolLocal failures in diff tests (Gabor Bota)
|
2018-05-08 18:58:42 -07:00 |
|
Aaron Fabbri
|
69aac696d9
|
HADOOP-13649 s3guard: implement time-based (TTL) expiry for LocalMetadataStore (Gabor Bota)
|
2018-05-08 15:29:54 -07:00 |
|
Steve Loughran
|
5b11b9fd41
|
HADOOP-15446. WASB: PageBlobInputStream.skip breaks HBASE replication.
Contributed by Thomas Marquardt
|
2018-05-07 11:54:08 +01:00 |
|
Aaron Fabbri
|
96c843f64b
|
HADOOP-15444 ITestS3GuardToolDynamo should only run with -Ddynamo (Aaron Fabbri)
|
2018-05-04 11:34:45 -07:00 |
|
Sean Mackrory
|
85381c7b60
|
HADOOP-15434. Upgrade to ADLS SDK that exposes current timeout.
|
2018-05-02 21:30:31 -06:00 |
|
Aaron Fabbri
|
919865a34b
|
HADOOP-15239 S3ABlockOutputStream.flush() be no-op when stream closed. Contributed by Gabor Bota.
|
2018-04-30 16:02:57 -07:00 |
|
Weiwei Yang
|
ba2db39c65
|
YARN-8152. Add chart in SLS to illustrate the throughput of the scheduler. Contributed by Tao Yang.
|
2018-04-27 15:36:21 +08:00 |
|
Aaron Fabbri
|
7d8bcf534a
|
HADOOP-13756 LocalMetadataStore#put(DirListingMetadata) should also put file metadata into fileHash. (Gabor Bota)
|
2018-04-26 20:41:29 -07:00 |
|
Owen O'Malley
|
2adda92de1
|
HDFS-7240 git commit fixup
Signed-off-by: Owen O'Malley <omalley@apache.org>
|
2018-04-26 13:52:17 -07:00 |
|
Mukul Kumar Singh
|
ae8ac7f082
|
HDFS-13424. Ozone: Refactor MiniOzoneClassicCluster. Contributed by Nanda Kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Nanda kumar
|
025058f251
|
HDFS-13446. Ozone: Fix OzoneFileSystem contract test failures. Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
8b832f3c35
|
HDFS-13405. Ozone: Rename HDSL to HDDS.
Contributed by Ajay Kumar, Elek Marton, Mukul Kumar Singh, Shashikant Banerjee and Anu Engineer.
|
2018-04-26 05:36:04 -07:00 |
|
Nanda kumar
|
7ae9543a57
|
HDFS-13391. Ozone: Make dependency of internal sub-module scope as provided in maven. Contributed by Nanda kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
04e1287771
|
HDFS-13298. Ozone: Make ozone/hdsl/cblock modules turned off by default. Contributed by Elek, Marton.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
4e61bc431e
|
HDFS-13258. Ozone: restructure Hdsl/Ozone code to separated maven subprojects.
Contributed by Elek Marton, Mukul Kumar Singh, Xiaoyu Yao, Ajay Kumar, Anu Engineer, Lokesh Jain, Nanda Kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
5e7164c614
|
HDFS-13137. Ozone: Ozonefs read fails because ChunkGroupInputStream#read does not iterate through all the blocks in the key.
Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
61651dcf5c
|
HDFS-13108. Ozone: OzoneFileSystem: Simplified url schema for Ozone File System. Contributed by Elek, Marton.
|
2018-04-26 05:36:04 -07:00 |
|
Mukul Kumar Singh
|
cd807c9890
|
HDFS-13133. Ozone: OzoneFileSystem: Calling delete with non-existing path shouldn't be logged on ERROR level. Contributed by Elek, Marton.
|
2018-04-26 05:36:04 -07:00 |
|
Mukul Kumar Singh
|
9272e1021d
|
HDFS-12636. Ozone: OzoneFileSystem: Implement seek functionality for rpc client. Contributed by Lokesh Jain.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
4460ac9c57
|
HDFS-12756. Ozone: Add datanodeID to heartbeat responses and container protocol. Contributed by Anu Engineer.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
740a06cdd7
|
HDFS-12719. Ozone: Fix checkstyle, javac, whitespace issues in HDFS-7240 branch. Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
|
Chen Liang
|
e395244e95
|
HDFS-12758. Ozone: Correcting assertEquals argument order in test cases. Contributed by Bharat Viswanadham.
|
2018-04-26 05:36:04 -07:00 |
|
Xiaoyu Yao
|
2ec24a7542
|
HDFS-12774. Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client. Contributed by Nanda kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Chen Liang
|
895a4cc60a
|
HDFS-12632. Ozone: OzoneFileSystem: Add contract tests to OzoneFileSystem. Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
d90ab3365d
|
HDFS-12608. Ozone: Remove Warnings when building. Contributed by Bharat Viswanadham.
|
2018-04-26 05:36:04 -07:00 |
|
Xiaoyu Yao
|
9445a9267f
|
HDFS-12572. Ozone: OzoneFileSystem: delete/list status/rename/mkdir APIs. Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
0b3270a8de
|
HDFS-12513. Ozone: Create UI page to show Ozone configs by tag. Contributed by Ajay Kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Xiaoyu Yao
|
5e4a6b686c
|
HDFS-12425. Ozone: OzoneFileSystem: read/write/create/open/getFileInfo APIs. Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
|
Xiaoyu Yao
|
f2d9360b9d
|
HDFS-12199. Ozone: OzoneFileSystem: OzoneFileystem initialization code. Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
|
Akira Ajisaka
|
3e2ca23a53
|
HADOOP-14400. Fix warnings from spotbugs in hadoop-tools. Contributed by Weiwei Yang.
|
2018-04-26 05:36:04 -07:00 |
|
Aaron Fabbri
|
989a3929a9
|
HADOOP-14756 S3Guard: expose capability query in MetadataStore and add tests of authoritative mode (Gabor Bota)
|
2018-04-23 15:26:53 -07:00 |
|
Inigo Goiri
|
fd24fd0ff7
|
YARN-8137. Parallelize node addition in SLS. Contributed by Abhishek Modi.
|
2018-04-20 09:09:12 -07:00 |
|
Yiqun Lin
|
1312f9ae4c
|
HADOOP-15391. Add missing css file in hadoop-aws, hadoop-aliyun, hadoop-azure and hadoop-azure-datalake modules.
|
2018-04-18 16:04:00 +08:00 |
|
Inigo Goiri
|
78860372bd
|
YARN-8134. Support specifying node resources in SLS. Contributed by Abhishek Modi.
|
2018-04-17 13:11:34 -07:00 |
|
Aaron Fabbri
|
b0aff8a962
|
HADOOP-15346 S3ARetryPolicy for 400/BadArgument to be "fail". Contributed by Steve Loughran.
|
2018-04-10 23:55:38 -07:00 |
|
Xiao Chen
|
7c9cdad6d0
|
HDFS-13056. Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts. Contributed by Dennis Huo.
|
2018-04-10 21:31:48 -07:00 |
|
Aaron Fabbri
|
ea3849f0cc
|
HADOOP-14759 S3GuardTool prune to prune specific bucket entries. Contributed by Gabor Bota.
|
2018-04-05 20:23:17 -07:00 |
|
Steve Loughran
|
5a174f8ac6
|
HADOOP-14758. S3GuardTool.prune to handle UnsupportedOperationException.
Contributed by Gabor Bota.
|
2018-04-03 16:31:34 +01:00 |
|
Sammi Chen
|
6542d17ea4
|
HADOOP-14999. AliyunOSS: provide one asynchronous multi-part based uploading mechanism. Contributed by Genmao Yu.
|
2018-03-30 20:23:05 +08:00 |
|
Sean Mackrory
|
9d7a9031a5
|
HADOOP-15342. Updating ADLS connector to use the current SDK version (2.2.7). Contributed by Atul Sikaria.
|
2018-03-29 10:13:40 -06:00 |
|
Chris Douglas
|
081c350188
|
HADOOP-15320. Remove customized getFileBlockLocations for hadoop-azure and hadoop-azure-datalake. Contributed by Shanyu Zhao
|
2018-03-28 11:58:59 -07:00 |
|
Haibo Chen
|
fcea5a4d79
|
YARN-7794. SLSRunner is not loading timeline service jars, causing failure. (Yufei Gu via Haibo Chen)
|
2018-03-26 14:30:11 -07:00 |
|