big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
20,360 Commits 2 Branches 2 Tags 264 MiB
2202e00ba8
Commit Graph

20360 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Anu Engineer
48319d6eee HDDS-483. Update ozone Documentation to fix below issues. 
Contributed by  Namit Maheshwari.
 2018-09-18 10:23:36 -07:00
Steve Loughran
df2166a643
HADOOP-15719. Fail-fast when using OAuth over http. 
Contributed by Da Zhou.
 2018-09-18 12:20:52 +01:00
Steve Loughran
51d368982b
HADOOP-15714. Tune abfs/wasb parallel and sequential test execution. 
Contributed by Da Zhou.
 2018-09-18 12:09:25 +01:00
Steve Loughran
524776625d
HADOOP-15715. ITestAzureBlobFileSystemE2E timing out with non-scale timeout of 10 min. 
Contributed by Da Zhou
 2018-09-18 11:48:46 +01:00
Sammi Chen
e4fca6aae4 HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu. 2018-09-18 18:37:49 +08:00
Steve Loughran
1cf38a38da
HADOOP-15744. AbstractContractAppendTest fails against HDFS on HADOOP-15407 branch. 
Contributed by Steve Loughran.
 2018-09-18 10:56:56 +01:00
Takanobu Asanuma
f796cfde76 HADOOP-15304. [JDK10] Migrate from com.sun.tools.doclets to the replacement. Contributed by Akira Ajisaka. 2018-09-18 18:48:25 +09:00
Weiwei Yang
78a0d173e4 YARN-8787. Fix broken list items in PlacementConstraints documentation. Contributed by Masahiro Tanaka. 2018-09-18 17:19:39 +08:00
Márton Elek
b6ad84ebb1 HDDS-468. Add version number to datanode plugin and ozone file system jar. Contributed by Bharat Viswanadham. 
(cherry picked from commit a71aea732315ffc5c99c011369adfbeddb9a8c01)
 2018-09-18 11:01:52 +02:00
Márton Elek
001611cca3 HDDS-481. Classes are missing from the shaded ozonefs jar. Contributed by Bharat Viswanadham. 
(cherry picked from commit e043783917ed58a1a967ca67b7240b1b3e846a69)
 2018-09-18 10:32:36 +02:00
Sunil G
bbeca0107e YARN-8652. [UI2] YARN UI2 breaks if getUserInfo REST API is not available in older versions. Contributed by Akhil PB. 2018-09-18 12:44:21 +05:30
Sunil G
0cc6e03945 YARN-8726. [UI2] YARN UI2 is not accessible when config.env file failed to load. Contributed by Akhil PB. 2018-09-18 12:31:55 +05:30
Bharat Viswanadham
51fda2d773 HDDS-491. Minor typos in README.md in smoketest. Contributed by chencan. 2018-09-17 22:22:56 -07:00
Yiqun Lin
ee051ef9fe HADOOP-15742. Log if ipc backoff is enabled in CallQueueManager. Contributed by Ryan Wu. 2018-09-18 11:10:33 +08:00
Takanobu Asanuma
281c192e7f
[JDK10] Upgrade Maven Javadoc Plugin from 3.0.0-M1 to 3.0.1. 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-09-18 09:32:27 +09:00
Bharat Viswanadham
8b2f5e60fa HDDS-352. Separate install and testing phases in acceptance tests. Contributed by Elek Marton. 2018-09-17 17:13:52 -07:00
Arpit Agarwal
0a26c521f0 HDDS-487. Doc files are missing ASF license headers. Contributed by Namit Maheshwari. 2018-09-17 16:21:10 -07:00
Inigo Goiri
d1541932db HDFS-13844. Fix the fmt_bytes function in the dfs-dust.js. Contributed by yanghuafeng. 2018-09-17 14:42:03 -07:00
Anu Engineer
23a6137a40 HDDS-475. Block Allocation returns same BlockID on different keys creation. 
Contributed by Nanda Kumar.
 2018-09-17 14:41:17 -07:00
Steve Loughran
26d0c63a1e
HADOOP-15754. s3guard: testDynamoTableTagging should clear existing config. 
Contributed by Gabor Bota.
 2018-09-17 22:40:08 +01:00
Thomas Marquardt
b4c23043d3 HADOOP-15757. ABFS: remove dependency on common-codec Base64. 
Contributed by Da Zhou.
 2018-09-17 19:54:01 +00:00
Thomas Marquardt
26211019c8 HADOOP-15753. ABFS: support path "abfs://mycluster/file/path" 
Contributed by Da Zhou.
 2018-09-17 19:54:01 +00:00
Thomas Marquardt
e5593cbd83 HADOOP-15694. ABFS: Allow OAuth credentials to not be tied to accounts. 
Contributed by Sean Mackrory.
 2018-09-17 19:54:01 +00:00
Thomas Marquardt
13c70e9ba3 HADOOP-15740. ABFS: Check variable names during initialization of AbfsClientThrottlingIntercept. 
Contributed by Sneha Varma.
 2018-09-17 19:54:01 +00:00
Sean Mackrory
9475fd902a HADOOP-15745. ABFS: Add ABFS configuration to ConfigRedactor. 2018-09-17 19:54:01 +00:00
Thomas Marquardt
6801b30733 HADOOP-15728. ABFS: Add backward compatibility to handle Unsupported Operation 
for storage account with no namespace feature.

Contributed by Da Zhou.
 2018-09-17 19:54:01 +00:00
Thomas Marquardt
347a52a866 Fixing findbugs and license issues related to: 
HADOOP-15703. ABFS - Implement client-side throttling.
Contributed by Sneha Varma and Thomas Marquardt.
 2018-09-17 19:54:01 +00:00
Thomas Marquardt
97f06b3fc7 HADOOP-15703. ABFS - Implement client-side throttling. 
Contributed by Sneha Varma and Thomas Marquardt.
 2018-09-17 19:54:01 +00:00
Thomas Marquardt
4410eacba7 HADOOP-15664. ABFS: Reduce test run time via parallelization and grouping. 
Contributed by Da Zhou.
 2018-09-17 19:54:01 +00:00
Thomas Marquardt
81dc4a995c HADOOP-15663. ABFS: Simplify configuration. 
Contributed by Da Zhou.
 2018-09-17 19:54:01 +00:00
Thomas Marquardt
df57c6c3b1 HADOOP-15692. ABFS: extensible support for custom oauth. 
Contributed by Junhua Gu and Rajeev Bansal.
 2018-09-17 19:54:01 +00:00
Thomas Marquardt
dd2b22fa31 HADOOP-15682. ABFS: Add support for StreamCapabilities. Fix javadoc and checkstyle. 
Contributed by Thomas Marquardt.
 2018-09-17 19:54:01 +00:00
Thomas Marquardt
6b6f8cc2be HADOOP 15688. ABFS: InputStream wrapped in FSDataInputStream twice. 
Contributed by Sean Mackrory.
 2018-09-17 19:54:01 +00:00
Thomas Marquardt
9c1e4e8139 HADOOP-15661. ABFS: Add support for ACL. 
Contributed by Junhua Gu and Da Zhou.
 2018-09-17 19:54:01 +00:00
Thomas Marquardt
9149b9703e HADOOP-15660. ABFS: Add support for OAuth 
Contributed by Da Zhou, Rajeev Bansal, and Junhua Gu.
 2018-09-17 19:54:01 +00:00
Thomas Marquardt
d6a4f39bd5 HADOOP-15669. ABFS: Improve HTTPS Performance. 
Contributed by Vishwajeet Dusane.
 2018-09-17 19:54:01 +00:00
Thomas Marquardt
cc5cc60c41 Fixing issue due to commit 2b2399d6 after rebase onto trunk. 2018-09-17 19:54:01 +00:00
Thomas Marquardt
b54b0c1b67 HADOOP-15659. Code changes for bug fix and new tests. 
Contributed by Da Zhou.
 2018-09-17 19:54:01 +00:00
Thomas Marquardt
ce03a93f78 HADOOP-15446. ABFS: tune imports & javadocs; stabilise tests. 
Contributed by Steve Loughran and Da Zhou.
 2018-09-17 19:54:01 +00:00
Steve Loughran
a271fd0eca HADOOP-15560. ABFS: removed dependency injection and unnecessary dependencies. 
Contributed by Da Zhou.
 2018-09-17 19:54:01 +00:00
Steve Loughran
f044deedbb HADOOP-15407. HADOOP-15540. Support Windows Azure Storage - Blob file system "ABFS" in Hadoop: Core Commit. 
Contributed by Shane Mainali, Thomas Marquardt, Zichen Sun, Georgi Chalakov, Esfandiar Manii, Amit Singh, Dana Kaban, Da Zhou, Junhua Gu, Saher Ahwal, Saurabh Pant, James Baker, Shaoyu Zhang, Lawrence Chen, Kevin Chen and Steve Loughran
 2018-09-17 19:54:01 +00:00
Bharat Viswanadham
3d89c3e73e HDDS-463. Fix the release packaging of the ozone distribution. Contributed by Elek Marton. 2018-09-17 11:49:09 -07:00
Anu Engineer
8af8453589 HDDS-435. Enhance the existing ozone documentation. 
Contributed by Elek, Marton.
 2018-09-17 10:46:28 -07:00
Anu Engineer
fdf5a3fd63 HDFS-13919. Documentation: Improper formatting in Disk Balancer for Settings. 
Contributed by Ayush Saxena.
 2018-09-17 10:08:23 -07:00
Nanda kumar
846936698b HDDS-399. Persist open pipeline information across SCM restart. Contributed by Mukul Kumar Singh. 2018-09-17 21:51:54 +05:30
Weiwei Yang
9a265fa673 YARN-8782. Fix exception message in Resource.throwExceptionWhenArrayOutOfBound. Contributed by Gergely Pollak. 2018-09-17 22:15:24 +08:00
Sunil G
33d8327cff YARN-8715. Make allocation tags in the placement spec optional for node-attributes. Contributed by Weiwei Yang. 2018-09-17 10:07:45 +05:30
Xiaoyu Yao
95231f1749 HDDS-362. Modify functions impacted by SCM chill mode in ScmBlockLocationProtocol. Contributed by Ajay Kumar. 2018-09-16 17:55:46 -07:00
Arpit Agarwal
07385f886e HDDS-470. Ozone acceptance tests are failing. Contributed by Elek, Marton. 
(cherry picked from commit dca8d0c2615d142bca55d367a0bc988ce9860368)
 2018-09-16 14:31:29 -07:00
Arpit Agarwal
82fbbd546c HDDS-469. Rename 'ozone oz' to 'ozone sh'. Contributed by Arpit Agarwal. 2018-09-15 22:12:47 -07:00