big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
26,779 Commits 2 Branches 2 Tags 264 MiB
ad001c93cf
Commit Graph

672 Commits

Author SHA1 Message Date
Akira Ajisaka
2de7240d4f
HADOOP-17269. [JDK 11] Upgrade SpotBugs to 4.1.3 to fix false-positive warnings. (#2374) 2020-10-10 00:28:05 +09:00
Doroszlai, Attila
1cfe5916e2 HADOOP-16990. Update Mockserver. Contributed by Attila Doroszlai. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2020-10-06 14:58:42 -07:00
Liang-Chi Hsieh
c9ea344f98
HADOOP-17125. Use snappy-java in SnappyCodec (#2297) 
This switches the SnappyCodec to use the java-snappy codec, rather than the native one. 

To use the codec, snappy-java.jar (from org.xerial.snappy) needs to be on the classpath.

This comesin as an avro dependency,  so it is already on the hadoop-common classpath,
as well as in hadoop-common/lib.
The version used is now managed in the hadoop-project POM; initially 1.1.7.7

Contributed by DB Tsai and Liang-Chi Hsieh
 2020-10-06 17:07:54 +01:00
Szilard Nemeth
6e3d7050a9 YARN-10386. Create new JSON schema for Placement Rules. Contributed by Peter Bacsko and Benjamin Teke 2020-08-28 17:09:31 +02:00
Brahma Reddy Battula
15a0fed637 HADOOP-17220. Upgrade slf4j to 1.7.30 ( To Address: CVE-2018-8088). Contributed by Brahma Reddy Battula. 2020-08-24 19:03:22 +05:30
Akira Ajisaka
ed3ab4b87d
HADOOP-17179. [JDK 11] Fix javadoc error while detecting Java API link (#2186) 
Signed-off-by: Mingliang Liu <liuml07@apache.org>
 2020-08-04 12:09:14 -07:00
Akira Ajisaka
c40cbc57fa
HADOOP-17091. [JDK11] Fix Javadoc errors (#2098) 2020-08-03 10:46:51 +09:00
Masatake Iwasaki
2ba44a73bf
HADOOP-16866. Upgrade spotbugs to 4.0.6. (#2146) 2020-07-17 19:58:44 +09:00
Thomas Marquardt
4b5b54c73f
HADOOP-17089: WASB: Update azure-storage-java SDK 
Contributed by Thomas Marquardt

DETAILS: WASB depends on the Azure Storage Java SDK. There is a concurrency
bug in the Azure Storage Java SDK that can cause the results of a list blobs
operation to appear empty. This causes the Filesystem listStatus and similar
APIs to return empty results. This has been seen in Spark work loads when jobs
use more than one executor core.

See Azure/azure-storage-java#546 for details on the bug in the Azure Storage SDK.

TESTS: A new test was added to validate the fix. All tests are passing:

wasb:
mvn -T 1C -Dparallel-tests=wasb -Dscale -DtestsThreadCount=8 clean verify
Tests run: 248, Failures: 0, Errors: 0, Skipped: 11
Tests run: 651, Failures: 0, Errors: 0, Skipped: 65

abfs:
mvn -T 1C -Dparallel-tests=abfs -Dscale -DtestsThreadCount=8 clean verify
Tests run: 64, Failures: 0, Errors: 0, Skipped: 0
Tests run: 437, Failures: 0, Errors: 0, Skipped: 33
Tests run: 206, Failures: 0, Errors: 0, Skipped: 24
 2020-06-25 02:32:42 +00:00
Yiqun Lin
9cbd76cc77 HDFS-15346. FedBalance tool implementation. Contributed by Jinglun. 2020-06-18 13:33:25 +08:00
Akira Ajisaka
52b21de1d8
HADOOP-17049. javax.activation-api and jakarta.activation-api define overlapping classes (#2027) 
* Removed javax.activation-api from dependency
 2020-05-22 11:19:11 +09:00
Surendra Singh Lilhore
1958cb7c2b YARN-10265. Upgrade Netty-all dependency to latest version 4.1.50 to fix ARM support issue. Contributed by liusheng 2020-05-14 15:09:34 +05:30
Ayush Saxena
0918433b4d YARN-9898. Dependency netty-all-4.1.27.Final doesn't support ARM platform. Contributed by liusheng. 2020-05-14 00:36:20 +05:30
Wei-Chiu Chuang
bd342bef64
HADOOP-17033. Update commons-codec from 1.11 to 1.14. (#2000) 2020-05-11 08:41:14 -07:00
Sammi Chen
82ff7bc9ab HADOOP-16959. Resolve hadoop-cos dependency conflict. Contributed by Yang Yu. 2020-04-20 18:14:11 +08:00
sunlisheng
ae474e1ae5 HADOOP-16982. Update Netty to 4.1.48.Final. Contributed by Lisheng Sun. 
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
 2020-04-15 06:41:32 +09:00
Akira Ajisaka
e53d472bb0
HADOOP-14836. Upgrade maven-clean-plugin to 3.1.0 (#1933) 2020-04-09 01:47:31 +09:00
Brahma Reddy Battula
3eeb2466e9 upate the hadoop.version property in the root pom.xml and hadoop.assemblies.version in hadoop-project/pom.xml (see HADOOP-15369) 2020-03-29 23:44:20 +05:30
Brahma Reddy Battula
8914cf9167 Preparing for 3.4.0 development 2020-03-29 23:24:25 +05:30
Vinayakumar B
f02d5abacd
HADOOP-16927. Update hadoop-thirdparty dependency version to 1.0.0 (#1900). Contributed by Vinayakumar B. 2020-03-20 15:13:07 +05:30
Wei-Chiu Chuang
cd91ef649e
YARN-10195. Dependency divergence building Timeline Service on HBase 2.2.0 and above. (#1895) 2020-03-13 11:20:28 -07:00
Brahma Reddy Battula
c6b8a30386 HADOOP-16871. Upgrade Netty version to 4.1.45.Final to handle CVE-2019-20444,CVE-2019-16869 2020-03-09 19:21:58 +05:30
John Zhuge
999096d82e
HADOOP-14206. TestSFTPFileSystem#testFileExists failure: Invalid encoding for signature. Contributed by Jim Brennan. 2020-03-07 22:56:11 -08:00
Wei-Chiu Chuang
69faaa1d58
HADOOP-16905. Update jackson-databind to 2.10.3 to relieve us from the endless CVE patches. (#1876) 2020-03-07 12:18:01 +09:00
Siyao Meng
e36b272608
HADOOP-16891. Upgrade jackson-databind to 2.9.10.3 (#1865) 2020-02-28 17:02:41 -08:00
Akira Ajisaka
7f35676f90
HADOOP-16869. Upgrade findbugs-maven-plugin to 3.0.5 to fix mvn findbugs:findbugs failure (#1855) 2020-02-21 12:22:16 +09:00
Akira Ajisaka
d6d7f8d8c5
YARN-8374. Upgrade objenesis to 2.6 (#1798) 2020-02-19 09:50:37 +09:00
Vinayakumar B
7dac7e1d13
HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency (#1635). Contributed by Vinayakumar B. 2020-02-07 14:51:24 +05:30
Sahil Takiar
f206b736f0
HADOOP-16346. Stabilize S3A OpenSSL support. 
Introduces `openssl` as an option for `fs.s3a.ssl.channel.mode`.
The new option is documented and marked as experimental.

For details on how to use this, consult the peformance document
in the s3a documentation.

This patch is the successor to HADOOP-16050 "S3A SSL connections
should use OpenSSL" -which was reverted because of
incompatibilities between the wildfly OpenSSL client and the AWS
HTTPS servers (HADOOP-16347). With the Wildfly release moved up
to 1.0.7.Final (HADOOP-16405) everything should now work.

Related issues:

* HADOOP-15669. ABFS: Improve HTTPS Performance
* HADOOP-16050: S3A SSL connections should use OpenSSL
* HADOOP-16371: Option to disable GCM for SSL connections when running on Java 8
* HADOOP-16405: Upgrade Wildfly Openssl version to 1.0.7.Final

Contributed by Sahil Takiar

Change-Id: I80a4bc5051519f186b7383b2c1cea140be42444e
 2020-01-21 16:37:51 +00:00
Masatake Iwasaki
7f3510048d HADOOP-16803. Upgrade jackson-databind to 2.9.10.2. (#1805) 2020-01-15 19:50:25 +09:00
Adam Antal
20a90c0b5b
YARN-10071. Sync Mockito version with other modules 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2020-01-10 17:41:04 +09:00
Akira Ajisaka
a40dc9ee31 HADOOP-15993. Upgrade Kafka to 2.4.0 in hadoop-kafka module. (#1796) 2020-01-09 16:24:58 +09:00
Tamás Pénzes
f1f3f23c3c HADOOP-16772. Extract version numbers to head of pom.xml (addendum) (#1773) 
Follow up task of HADOOP-16729, extract even more version numbers.

Change-Id: I2aba142657f3978b24be2560ed6161f1132a8f9e
 2020-01-08 12:25:01 +01:00
Ayush Saxena
1b04bcc0d9 HADOOP-16784. Update the year to 2020. Contributed by Ayush Saxena. 2020-01-02 21:42:36 +05:30
Mate Szalay-Beko
578bd101a6 HADOOP-16765. Fix curator dependencies for gradle projects using hadoop-minicluster. (#1763) 
Gradle behaves differently than Maven when processing exclude rules through transitive
dependencies. This causes gradle projects (e.g. in Kudu) that are using Hadoop MiniCluster
to fail because different Guava version come to the classpath through Curator. In this
fix we make sure that ZooKeeper, SLF4J and Gradle gets always excluded from Curator Client
even if they would come through other Curator dependencies transitively.
 2019-12-16 14:43:59 -08:00
dependabot[bot]
c1d393a156 Bump nimbus-jose-jwt from 4.41.1 to 7.9 (#1682) 
Bumps [nimbus-jose-jwt](https://bitbucket.org/connect2id/nimbus-jose-jwt) from 4.41.1 to 7.9.
- [Changelog](https://bitbucket.org/connect2id/nimbus-jose-jwt/src/master/CHANGELOG.txt)
- [Commits](https://bitbucket.org/connect2id/nimbus-jose-jwt/branches/compare/7.9..4.41.1)

Signed-off-by: dependabot[bot] <support@github.com>
 2019-12-09 10:14:44 +09:00
Tamás Pénzes
7c869b4df2 HADOOP-16729. Extract version numbers to head of pom.xml (#1730). Contributed by Tamas Penzes. 2019-12-04 10:34:29 +01:00
Wei-Chiu Chuang
012756a0d9 HADOOP-16675. Upgrade jackson-databind to 2.9.10.1. Contributed by Lisheng Sun. 2019-10-29 13:36:30 -07:00
Eric Yang
ac6b6a6a85 HADOOP-16614. Add aarch64 support for dependent leveldbjni. 
Contributed by liusheng
close #1546
 2019-10-24 11:45:57 -04:00
Mate Szalay-Beko
6d92aa7c30 HADOOP-16579. Upgrade to Curator 4.2.0 and ZooKeeper 3.5.5 (#1656). Contributed by Norbert Kalmár, Mate Szalay-Beko 
* HADOOP-16579 - Upgrade to Apache Curator 4.2.0 and ZooKeeper 3.5.5

- Add a static initializer for the unit tests using ZooKeeper to enable
the four-letter-words diagnostic telnet commands. (this is an interface
that become disabled by default, so to keep the ZooKeeper 3.4.x behavior
we enabled it for the tests)
- Also fix ZKFailoverController to look for relevant fail-over ActiveAttempt
records. The new ZooKeeper seems to respond quicker during the fail-over
tests than the ZooKeeper, so we made sure to catch all the relevant records
by adding a new parameter to ZKFailoverontroller.waitForActiveAttempt().

Co-authored-by: Norbert Kalmár <nkalmar@cloudera.com>
 2019-10-18 13:26:20 -07:00
Yuming Wang
3d41f33018 HADOOP-16152. Upgrade Eclipse Jetty version to 9.4.x. Contributed by Yuming Wang, Siyao Meng. 
Co-authored-By: Siyao Meng <smeng@cloudera.com>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-10-18 08:25:02 -07:00
Wei-Chiu Chuang
85af77c757 HADOOP-16643. Update netty4 to the latest 4.1.42. Contributed by Lisheng Sun. 2019-10-15 08:55:14 -07:00
Wei-Chiu Chuang
55c5436f39 Revert "HADOOP-16579. Upgrade to Apache Curator 4.2.0 excluding ZK (#1531). Contributed by Norbert Kalmár." 
This reverts commit 10bdc592d6.
 2019-10-05 11:16:11 -07:00
Norbert Kalmar
10bdc592d6 HADOOP-16579. Upgrade to Apache Curator 4.2.0 excluding ZK (#1531). Contributed by Norbert Kalmár. 2019-10-04 10:57:07 -07:00
Siyao Meng
d947ded053 HADOOP-16619. Upgrade jackson and jackson-databind to 2.9.10 (#1554). Contributed by Siyao Meng. 2019-10-01 12:46:40 -07:00
Vinayakumar B
07c81e9bfc
HADOOP-16558. [COMMON+HDFS] use protobuf-maven-plugin to generate protobuf classes (#1494). Contributed by Vinayakumar B. 2019-09-23 12:37:47 +05:30
Vinayakumar B
efed4450bf
HADOOP-16589. [pb-upgrade] Update docker image to make 3.7.1 protoc as default (#1482). Contributed by Vinayakumar B. 2019-09-21 10:07:26 +05:30
Vinayakumar B
1654497f98
HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 (#1432) 
HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1. Contributed by Vinayakumar B.
 2019-09-20 16:08:30 +05:30
Yi Sheng
1843c4688a HADOOP-16555. Update commons-compress to 1.19. (#1425) Contributed by YiSheng Lien. 2019-09-14 02:11:04 +08:00
HUAN-PING SU
38c1a10024 HADOOP-16542. Update commons-beanutils version to 1.9.4. Contributed by kevin su. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-09-10 19:58:34 +08:00
Akira Ajisaka
d85d68f6ff HADOOP-16533. Upgrade jackson-databind to 2.9.9.3. (#1354). Contributed by Akira Ajisaka. 
Reviewed-by: Siyao Meng <smeng@cloudera.com>
 2019-08-27 15:54:35 -07:00
Hrishikesh Gadre
3cc0ace203 HADOOP-16491. Upgrade jetty version to 9.3.27. Contributed by Hrishikesh Gadre. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-08-07 13:50:14 -07:00
Akira Ajisaka
0b0ba70b35
HADOOP-15908. hadoop-build-tools jar is downloaded from remote repository instead of using from local. Contributed by Oleksandr Shevchenko. 2019-08-07 09:29:18 +09:00
HUAN-PING SU
b77761b0e3 HADOOP-16275. Upgrade Mockito to the latest version. Contributed by kevin su. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-08-06 12:18:24 -07:00
Siyao Meng
9680a8b237 HADOOP-16487. Update jackson-databind to 2.9.9.2. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-08-04 20:03:07 -07:00
Sneha Vijayarajan
12a526c080 HADOOP-16460: ABFS: fix for Sever Name Indication (SNI) 
Contributed by Sneha Vijayarajan <snvijaya@microsoft.com>
 2019-07-30 17:23:23 +00:00
pingsutw
98653ecccb
HADOOP-16447 Upgrade JUnit5 from 5.3.1 to 5.5.1 to support global timeout 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-07-26 17:05:34 +09:00
Siyao Meng
9b8b3acb0a HADOOP-16451. Update jackson-databind to 2.9.9.1. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-07-24 17:25:25 -07:00
Zhankun Tang
062eb605ac YARN-9477. Implement VE discovery using libudev. Contributed by Peter Bacsko. 2019-06-26 23:53:14 +08:00
Shweta Yakkali
cf84881dea HADOOP-16365. Upgrade jackson-databind to 2.9.9. Contributed by Shweta Yakkali. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-12 10:37:58 -07:00
Steve Loughran
ec26c431f9
HADOOP-16117. Update AWS SDK to 1.11.563. 
Contributed by Steve Loughran.

Change-Id: I7c46ed2a6378e1370f567acf4cdcfeb93e43fa13
 2019-06-06 10:08:18 +01:00
Akira Ajisaka
afd844059c HADOOP-16331. Fix ASF License check in pom.xml 
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
 2019-05-29 17:25:13 +09:00
Akira Ajisaka
9f933e6446
HADOOP-16323. https everywhere in Maven settings. 2019-05-27 15:24:59 +09:00
Akira Ajisaka
f257497b0f HADOOP-16299. [JDK 11] Build fails without specifying -Djavac.version=11 
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
 2019-05-09 14:49:46 +09:00
Akira Ajisaka
66c2a4ef89
HADOOP-16270. [JDK 11] Remove unintentional override of the version of Maven Dependency Plugin. Contributed by Xieming Li. 2019-05-08 10:50:07 +09:00
Eric Yang
a54c1e3ace YARN-8551. Project setup for MaWo application. 
Contributed by Yesha Vora
 2019-04-22 16:56:26 -04:00
Takanobu Asanuma
a5ceed26f3 HADOOP-16253. Update AssertJ to 3.12.2. 2019-04-16 12:53:52 +09:00
Todd Lipcon
65deb1ac42 HADOOP-16179. hadoop-common pom should not depend on kerb-simplekdc 
The hadoop-common pom currently has a dependency on kerb-simplekdc. In
fact, the only classes used from Kerby are in kerb-core and kerb-util
(which is a transitive dependency frmo kerb-core). Depending on
kerb-simplekdc pulls a bunch of other unnecessary classes into the
hadoop-common classpath.

This changes the hadoop-common pom to depend only on kerb-core.

hadoop-minikdc already had the appropriate dependency on kerb-simplekdc
so it continues to pull in what it needs.

Signed-off-by: Todd Lipcon <todd@apache.org>
 2019-04-10 08:49:46 -07:00
Gabor Bota
d7979079ea HADOOP-16210. Update guava to 27.0-jre in hadoop-project trunk. Contributed by Gabor Bota. 2019-04-03 12:59:39 -06:00
Billie Rinaldi
7ee32a2eb1 YARN-7129. Application Catalog for YARN applications. Contributed by Eric Yang 2019-03-29 13:51:21 -07:00
Billie Rinaldi
ab574ffd72 Revert "YARN-7129. Application Catalog for YARN applications. Contributed by Eric Yang" 
This reverts commit 2576401928.
 2019-03-12 11:50:16 -07:00
Billie Rinaldi
2576401928 YARN-7129. Application Catalog for YARN applications. Contributed by Eric Yang 2019-03-05 06:14:14 -08:00
Steve Loughran
5b43e42d0c HADOOP-16149 hadoop-mapreduce-client-app build not converging due to transient dependencies 
Change-Id: If95b12b223770b057041f99f0f8fd8ba370c377f
 2019-02-27 12:44:46 -08:00
Akira Ajisaka
529791cb18
HADOOP-15938. [JDK 11] Remove animal-sniffer-maven-plugin to fix build. Contributed by Dinesh Chitlangia. 2019-02-05 09:42:44 +09:00
Larry McCay
758e9ce781
HADOOP-16076. SPNEGO+SSL Client Connections with HttpClient Broken. 
Contributed by Larry McCay
 2019-02-04 17:38:40 +00:00
Akira Ajisaka
0f9aa5b4d5
HADOOP-16089. AliyunOSS: update oss-sdk version to 3.4.1. Contributed by wujinhu. 2019-02-04 14:46:35 +09:00
Akira Ajisaka
1129288cf5
HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki. 2019-01-29 18:29:56 -08:00
Akira Ajisaka
01405df87f
HADOOP-15941. Addendum patch. Contributed by Takanobu Asanuma. 2019-01-16 10:28:08 +09:00
Steve Loughran
6d0bffe17e
HADOOP-14556. S3A to support Delegation Tokens. 
Contributed by Steve Loughran and Daryn Sharp.
 2019-01-14 17:59:27 +00:00
Akira Ajisaka
3bb745df18
HADOOP-15994. Upgrade Jackson2 to 2.9.8. Contributed by lqjacklee. 2019-01-12 15:23:49 +09:00
Takanobu Asanuma
709ddb10e5 HADOOP-15941. [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible. 2019-01-09 13:55:25 +09:00
Akira Ajisaka
7f78397036
Revert "HADOOP-14556. S3A to support Delegation Tokens." 
This reverts commit d7152332b3.
 2019-01-08 14:51:30 +09:00
Steve Loughran
d7152332b3
HADOOP-14556. S3A to support Delegation Tokens. 
Contributed by Steve Loughran.
 2019-01-07 13:18:03 +00:00
Akira Ajisaka
32d5caa0a8
HADOOP-15937. [JDK 11] Update maven-shade-plugin.version to 3.2.1. Contributed by Dinesh Chitlangia. 2019-01-07 19:17:23 +09:00
Sunil G
1f425271a7
Revert "HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu." 
This reverts commit e4fca6aae4.

Revert "HADOOP-15671. AliyunOSS: Support Assume Roles in AliyunOSS. Contributed by Jinhu Wu."

This reverts commit 2b635125fb.
 2019-01-05 17:35:29 +09:00
Ayush Saxena
cb26f15428
HADOOP-16025. Update the year to 2019. 
Contributed by Ayush Saxena.
 2019-01-02 22:24:01 +00:00
Jason Lowe
9287ab3642 HADOOP-15974. Upgrade Curator version to 2.13.0 to fix ZK tests. Contributed by Akira Ajisaka 2018-12-04 15:44:03 -06:00
Akira Ajisaka
ff31313d83
HADOOP-15970. Upgrade plexus-utils from 2.0.5 to 3.1.0. 2018-12-04 22:45:29 +09:00
Rohith Sharma K S
f63e4e4f2e YARN-8936. Bump up Atsv2 hbase versions. Contributed by Vrushali C. 2018-11-21 15:02:22 +05:30
Billie Rinaldi
27ffec7ba7 YARN-8778. Add command line interface to invoke interactive docker shell. Contributed by Eric Yang 2018-11-19 17:59:12 -08:00
Akira Ajisaka
a736b5da15
HADOOP-15916. Upgrade Maven Surefire plugin to 3.0.0-M1. 2018-11-10 00:24:56 +09:00
Akira Ajisaka
78e43bccf6
HADOOP-15902. [JDK 11] Specify the HTML version of Javadoc to 4.01. Contributed by Takanobu Asanuma. 2018-11-06 20:44:05 +09:00
Steve Loughran
d174b91635 HADOOP-15895. [JDK9+] Add missing javax.annotation-api dependency to hadoop-yarn-csi. 
Contributed by Takanobu Asanuma.
 2018-11-01 12:56:20 +00:00
Sunil G
e28c00c290 HADOOP-15815. Upgrade Eclipse Jetty version to 9.3.24. Cotributed by Boris Vulikh. 2018-10-26 13:46:15 +05:30
Bharat Viswanadham
a4b9b7c130 HDDS-702:Used fixed/external version from hadoop jars in hdds/ozone projects. Contributed by Elek Marton. 2018-10-25 16:26:48 -07:00
Bharat Viswanadham
34b2521f5e HADOOP-15882. Upgrade maven-shade-plugin from 2.4.3 to 3.2.0. Contributed by Takanobu Asanuma. 2018-10-25 13:29:59 -07:00
Mukul Kumar Singh
ace06a93ba HDDS-714. Bump protobuf version to 3.5.1. Contributed by Mukul Kumar Singh. 2018-10-25 09:34:06 +05:30
Shashikant Banerjee
0891cdda79 HDDS-716. Update ozone to latest ratis snapshot build(0.3.0-aa38160-SNAPSHOT). Contributed by Mukul Kumar Singh. 2018-10-24 16:05:08 +05:30
Takanobu Asanuma
1c0aae63a7 HADOOP-14775. Change junit dependency in parent pom file to junit 5 while maintaining backward compatibility to junit4. Contributed by Akira Ajisaka. 2018-10-24 16:48:06 +09:00
Vinayakumar B
0ca50648c2 HADOOP-15856. Trunk build fails to compile native on Windows. Contributed by Vinayakumar B. 2018-10-24 11:32:53 +05:30
Haibo Chen
823bb5dda8 MAPREDUCE-4669. MRAM web UI does not work with HTTPS. (Contributed by Robert Kanter) 2018-10-23 15:28:13 -07:00
Eric Yang
e2a9fa8448 HADOOP-15821. Move YARN Registry to Hadoop Registry. 
Contributed by Íñigo Goiri
 2018-10-19 19:46:48 -04:00
Takanobu Asanuma
9bd18324c7 HADOOP-15804. upgrade to commons-compress 1.18. Contributed by Akira Ajisaka. 2018-10-19 21:29:35 +09:00
Xiao Chen
8853fc8a55 HADOOP-15849. Upgrade netty version to 3.10.6. 2018-10-13 20:22:02 -07:00
Tsz Wo Nicholas Sze
fb18cc5eaa HDDS-625. putKey hangs for a long time after completion, sometimes forever. Contributed by Arpit Agarwal 2018-10-12 10:37:37 +08:00
Jitendra Pandey
0bc6d0484a HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-10-11 17:12:47 -07:00
Akira Ajisaka
6fa3feb577
HADOOP-15832. Upgrade BouncyCastle to 1.60. Contributed by Robert Kanter. 2018-10-10 10:16:57 +09:00
Takanobu Asanuma
9bbeb52486 HADOOP-15775. [JDK9] Add missing javax.activation-api dependency. Contributed by Akira Ajisaka. 2018-10-09 13:06:14 +09:00
Eric Yang
347ea38581 YARN-8763. Added node manager websocket API for accessing containers. 
Contributed by Zian Chen
 2018-10-08 13:56:47 -04:00
Takanobu Asanuma
241cbec2da HADOOP-15816. Upgrade Apache Zookeeper version due to security concerns. Contributed by Akira Ajisaka. 2018-10-05 14:57:45 +09:00
Takanobu Asanuma
2626f46691 HADOOP-15814. Maven 3.3.3 unable to parse pom file. Contributed by Wei-Chiu Chuang. 2018-10-03 16:38:41 +09:00
Akira Ajisaka
31fa9bb799
HADOOP-15767. [JDK10] Building native package on JDK10 fails due to missing javah. Contributed by Takanobu Asanuma. 2018-10-03 11:29:18 +09:00
Robert Kanter
96ae4ac45f Changed version in trunk to 3.3.0-SNAPSHOT addendum 2018-10-02 16:48:59 -07:00
Sunil G
58fa96b697 Changed version in trunk to 3.3.0-SNAPSHOT. 2018-10-02 22:41:41 +05:30
Bharat Viswanadham
67173b4847 HDDS-441. Create new s3gateway daemon. Contributed by Elek Marton. 2018-09-24 13:42:55 -07:00
Bharat Viswanadham
62f817d32e HDDS-447. Separate ozone-dist and hadoop-dist projects with real classpath separation. Contributed by Elek Marton. 2018-09-24 10:10:11 -07:00
Sean Mackrory
0def61482b Merge branch 'HADOOP-15407' into trunk 2018-09-22 21:19:12 -06:00
Nanda kumar
c0956ee2a8 HDDS-476. Add Pipeline reports to make pipeline active on SCM restart. 
Contributed by Mukul Kumar Singh.
 2018-09-19 18:52:08 +05:30
Sammi Chen
e4fca6aae4 HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu. 2018-09-18 18:37:49 +08:00
Takanobu Asanuma
281c192e7f
[JDK10] Upgrade Maven Javadoc Plugin from 3.0.0-M1 to 3.0.1. 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-09-18 09:32:27 +09:00
Thomas Marquardt
d6a4f39bd5 HADOOP-15669. ABFS: Improve HTTPS Performance. 
Contributed by Vishwajeet Dusane.
 2018-09-17 19:54:01 +00:00
Steve Loughran
f044deedbb HADOOP-15407. HADOOP-15540. Support Windows Azure Storage - Blob file system "ABFS" in Hadoop: Core Commit. 
Contributed by Shane Mainali, Thomas Marquardt, Zichen Sun, Georgi Chalakov, Esfandiar Manii, Amit Singh, Dana Kaban, Da Zhou, Junhua Gu, Saher Ahwal, Saurabh Pant, James Baker, Shaoyu Zhang, Lawrence Chen, Kevin Chen and Steve Loughran
 2018-09-17 19:54:01 +00:00
Mukul Kumar Singh
c9e0b69ab3 HDDS-233. Update ozone to latest ratis snapshot build(0.3.0-50588bd-SNAPSHOT). Contributed by Shashikant Banerjee. 2018-09-13 19:01:07 +05:30
Akira Ajisaka
76d0365190 HADOOP-15584. Move httpcomponents versions in pom.xml. Contributed by Brandon Scheller. 2018-09-12 14:28:47 +09:00
Mukul Kumar Singh
2651e2c43d HDDS-365. Implement flushStateMachineData for containerStateMachine. Contributed by Shashikant Banerjee. 2018-08-29 07:58:30 +05:30
Steve Loughran
0e832e7a74
HADOOP-15642. Update aws-sdk version to 1.11.375. 
Contributed by Steve Loughran.
 2018-08-16 09:58:46 -07:00
Xiaoyu Yao
b4031a8f1b HDDS-324. Use pipeline name as Ratis groupID to allow datanode to report pipeline info. Contributed by Mukul Kumar Singh. 2018-08-13 12:47:49 -07:00
Mukul Kumar Singh
900c0e114f HDDS-230. ContainerStateMachine should implement readStateMachineData api to read data from Containers if required during replication. Contributed by Mukul Kumar Singh. 2018-08-07 15:03:14 +05:30
Akira Ajisaka
88625f5cd9
HADOOP-15531. Use commons-text instead of commons-lang in some classes to fix deprecation warnings. Contributed by Takanobu Asanuma. 2018-07-13 11:42:12 -04:00
Akira Ajisaka
2b2399d623
HADOOP-15495. Upgrade commons-lang version to 3.7 in hadoop-common-project and hadoop-tools. Contributed by Takanobu Asanuma. 2018-06-28 14:37:22 +09:00
Anu Engineer
e16e5b307d HDDS-177. Create a releasable ozonefs artifact 
Contributed by Marton, Elek.
 2018-06-24 01:05:04 -07:00
Sean Mackrory
b089a06793 HADOOP-14918. Remove the Local Dynamo DB test option. Contributed by Gabor Bota. 2018-06-20 16:45:08 -06:00
Jitendra Pandey
c42dcc7c47 HADOOP-15482. Upgrade jackson-databind to version 2.9.5. Contributed by Lokesh Jain. 2018-06-07 23:00:26 -07:00
Steve Loughran
d901be6795
HADOOP-15506. Upgrade Azure Storage Sdk version to 7.0.0 and update corresponding code blocks. 
Contributed by Esfandiar Manii.
 2018-06-06 18:28:14 +01:00
Wangda Tan
ff583d3fa3 YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda) 
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
 2018-06-01 14:49:18 -07:00
Jason Lowe
31ab960f4f YARN-8338. TimelineService V1.5 doesn't come up after HADOOP-15406. Contributed by Vinod Kumar Vavilapalli 2018-05-29 11:00:30 -05:00
Anu Engineer
5a9140690a HDDS-49. Standalone protocol should use grpc in place of netty. 
Contributed by Mukul Kumar Singh.
 2018-05-22 19:56:15 -07:00
Anu Engineer
481bfdb94f HDDS-89. Create ozone specific inline documentation as part of the build. 
Contributed by Elek, Marton.
 2018-05-22 10:49:10 -07:00
Mukul Kumar Singh
6653f4ba2e HDDS-19. Update ozone to latest ratis snapshot build (0.1.1-alpha-d7d7061-SNAPSHOT). Contributed by Lokesh Jain. 2018-05-14 22:25:03 +05:30
Anu Engineer
c1d64d60f6 HDDS-39. Ozone: Compile Ozone/HDFS/Cblock protobuf files with proto3 compiler using maven protoc plugin. 
Contributed by Mukul Kumar Singh.
 2018-05-11 11:08:45 -07:00
Owen O'Malley
2adda92de1
HDFS-7240 git commit fixup 
Signed-off-by: Owen O'Malley <omalley@apache.org>
 2018-04-26 13:52:17 -07:00
Xiaoyu Yao
20dab05564 HDFS-13407. Ozone: Use separated version schema for Hdds/Ozone projects. Contributed by Elek Marton. 2018-04-26 05:36:04 -07:00
Mukul Kumar Singh
ec6c8742e5 HDFS-13415. Ozone: Remove cblock code from HDFS-7240. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Anu Engineer
8b832f3c35 HDFS-13405. Ozone: Rename HDSL to HDDS. 
Contributed by Ajay Kumar, Elek Marton, Mukul Kumar Singh, Shashikant Banerjee and Anu Engineer.
 2018-04-26 05:36:04 -07:00
Nanda kumar
6cc765fbb6 HDFS-13320. Ozone: Support for MicrobenchMarking Tool. Contributed by Shashikant Banerjee 2018-04-26 05:36:04 -07:00
Anu Engineer
4e61bc431e HDFS-13258. Ozone: restructure Hdsl/Ozone code to separated maven subprojects. 
Contributed by Elek Marton, Mukul Kumar Singh, Xiaoyu Yao, Ajay Kumar, Anu Engineer, Lokesh Jain, Nanda Kumar.
 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
f2d9360b9d HDFS-12199. Ozone: OzoneFileSystem: OzoneFileystem initialization code. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Takanobu Asanuma
bcb57b1f89
HADOOP-15393. Upgrade the version of commons-lang3 to 3.7 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-04-18 13:33:15 +09:00
Xiaoyu Yao
ea95a335d0 HADOOP-15369. Avoid usage of ${project.version} in parent poms. Contributed by Elek Marton. 2018-04-16 10:15:37 -07:00
Sean Mackrory
82665a7887 HADOOP-15299. Bump Jackson 2 version to Jackson 2.9.x. 2018-03-26 14:05:15 -06:00
Arpit Agarwal
dae5051828 HADOOP-15334. Upgrade Maven surefire plugin. Contributed by Arpit Agarwal. 2018-03-22 10:52:02 -07:00
weiy
6e2b5fa493 HDFS-13215. RBF: Move Router to its own module. Contributed by Wei Yan 2018-03-19 22:13:40 -07:00
Rohith Sharma K S
55ba49dd07 YARN-7346. Add a profile to allow optional compilation for ATSv2 with HBase-2.0. Contributed by Haibo Chen and Rohith. 2018-03-06 11:55:21 +05:30
Akira Ajisaka
432cd74c72
HADOOP-15261. Upgrade commons-io from 2.4 to 2.5. Contributed by PandaMonkey. 2018-03-02 15:47:43 -08:00
Ray Chiang
923e1773e1 HADOOP-14652. Update metrics-core version to 3.2.4. (rchiang) 2018-03-01 15:36:10 -08:00
Haibo Chen
10663b78c8 Revert "yarn-7346.07.patch" 
This reverts commit 5e37ca5bb4.
 2018-02-28 21:11:36 -08:00
Haibo Chen
5e37ca5bb4 yarn-7346.07.patch 2018-02-28 21:04:54 -08:00
Steve Loughran
edc9f1451b HADOOP-15263. hadoop cloud-storage module to mark hadoop-common as provided; add azure-datalake. 
Contributed by Steve Loughran
 2018-02-28 14:42:25 +00:00
Steve Loughran
e015e00989 HADOOP-15264. AWS "shaded" SDK 1.271 is pulling in netty 4.1.17. 
Contributed by Steve Loughran.

(cherry picked from commit b580196a16dcafe26d6069267a5e2242917aad84)
 2018-02-28 13:11:07 +00:00
Steve Loughran
004b722372 HADOOP-15247. Move commons-net up to 3.6. 
Contributed by Steve Loughran.
 2018-02-21 10:40:42 +00:00
Rohith Sharma K S
9af30d46c6 YARN-7919. Refactor timelineservice-hbase module into submodules. Contributed by Haibo Chen. 2018-02-17 20:30:28 +05:30
Aaron Fabbri
60971b8195
HADOOP-15040 Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation 2018-02-13 18:51:22 -08:00
Wangda Tan
60f9e60b3b Preparing for 3.2.0 development 
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
 2018-02-11 11:17:38 +08:00
Xiao Chen
09dd709d6e HADOOP-15197. Remove tomcat from the Hadoop-auth test bundle. 2018-02-01 15:33:52 -08:00
Akira Ajisaka
cdaf92c9f5
HADOOP-15177. Update the release year to 2018. Contributed by Bharat Viswanadham. 2018-01-18 13:15:57 +09:00
Steve Loughran
2e0a451a8d HADOOP-15033. Use java.util.zip.CRC32C for Java 9 and above 
Contributed by Dmitry Chuyko,
 2018-01-11 10:47:50 +00:00
Akira Ajisaka
d2d8f4aeb3
HADOOP-15133. [JDK9] Ignore com.sun.javadoc.* and com.sun.tools.* in animal-sniffer-maven-plugin to compile with Java 9. 2017-12-21 11:58:34 +09:00
Virajith Jalaparti
352f994b64 HDFS-12665. [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb). Contributed by Ewan Higgs. 2017-12-15 17:51:40 -08:00
Sammi Chen
67b2661e3d HADOOP-15080. Aliyun OSS: update oss sdk from 2.8.1 to 2.8.3 to remove its dependency on Cat-x json-lib. 2017-12-07 22:46:11 +08:00
Wei-Chiu Chuang
3881c9ef7e HADOOP-15054. upgrade hadoop dependency on commons-codec to 1.11. 2017-11-29 08:54:49 -08:00
Akira Ajisaka
6903cf096e HADOOP-13514. Upgrade maven surefire plugin to 2.20.1 
Signed-off-by: Allen Wittenauer <aw@apache.org>
 2017-11-19 12:39:37 -08:00
Jian He
ba7ed7b66a YARN-7384. Remove apiserver cmd and merge service cmd into application cmd. Contributed by Billie Rinaldi 2017-11-06 13:30:19 -08:00
Gour Saha
541b64c798 YARN-7165. Miscellaneous fixes in yarn-native-services. Contributed by Jian He 2017-11-06 13:30:15 -08:00
Jian He
fecf22b2fd YARN-7113. Clean up packaging and dependencies for yarn-native-services. Contributed by Billie Rinaldi 2017-11-06 13:30:13 -08:00
Billie Rinaldi
40ab068eab YARN-7091. Rename application to service in yarn-native-services. Contributed by Jian He 2017-11-06 13:30:13 -08:00
Jian He
f934f62fc7 YARN-5218. Initial core change for DNS for YARN. Contributed by Jonathan Maron 2017-11-06 13:28:39 -08:00
Jian He
234dba84a1 YARN-5909. Remove agent related code in slider AM. Contributed by Jian He 2017-11-06 13:28:36 -08:00
Gour Saha
09e4b9e897 YARN-5690. Integrate native services modules into maven build. Contributed by Billie Rinaldi 2017-11-06 13:28:34 -08:00
Jian He
18bf0dce28 YARN-5610. Initial code for native services REST API. Contributed by Gour Saha 2017-11-06 13:28:33 -08:00
Chris Douglas
e4878a59b3 HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat Viswanadham 2017-10-30 09:49:22 -07:00
Chris Douglas
b50def3697 HADOOP-14986. Enforce JDK limitations. 2017-10-27 18:47:45 -07:00
Subru Krishnan
625039ef20 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru). 2017-10-25 15:51:27 -07:00
Wangda Tan
4afd308b62 YARN-7170. Improve bower dependencies for YARN UI v2. (Sunil G via wangda) 2017-10-19 21:58:40 -07:00
Akira Ajisaka
0de40f0e27
Revert "HADOOP-13514. Upgrade maven surefire plugin to 2.19.1." 
This reverts commit 3d04c00aed.
 2017-10-13 18:00:25 +09:00
Akira Ajisaka
3d04c00aed
HADOOP-13514. Upgrade maven surefire plugin to 2.19.1. 2017-10-11 10:42:32 +09:00
Jitendra Pandey
f29e55bf5e HADOOP-14910. Upgrade netty-all jar to latest 4.0.x.Final. Contributed by Vinayakumar B. 2017-10-10 11:00:07 -07:00
John Zhuge
8aca46e53f HADOOP-14651. Update okhttp version to 2.7.5. Contributed by Ray Chiang and John Zhuge. 2017-09-29 12:15:06 -07:00
Akira Ajisaka
dd378775df
HADOOP-14822. hadoop-project/pom.xml is executable. Contributed by Ajay Kumar. 2017-09-27 14:25:07 +09:00
Aaron Fabbri
a2b31e355a
HADOOP-14890 Move up to AWS SDK 1.11.199. Contributed by Steve Loughran. 2017-09-25 17:12:01 -07:00
Ray Chiang
cde804b91f HADOOP-14903. Add json-smart explicitly to pom.xml. (rchiang) 2017-09-25 15:30:51 -07:00
Andrew Wang
8d29bf57ca Revert "HADOOP-14655. Update httpcore version to 4.4.6. (rchiang)" 
This reverts commit 088a18b44d.
 2017-09-22 14:43:44 -07:00
Andrew Wang
3cf3540f19 HADOOP-14835. mvn site build throws SAX errors. Contributed by Andrew Wang and Sean Mackrory. 2017-09-18 15:13:42 -07:00
Kai Zheng
08b98149e1 HADOOP-14869. Upgrade Apache Kerby version to v1.0.1. Contributed by Wei Zhou 2017-09-15 19:49:58 +08:00
Aaron Fabbri
49467165a5
HADOOP-14738 Remove S3N and obsolete bits of S3A; rework docs. Contributed by Steve Loughran. 2017-09-14 14:10:48 -07:00
Steve Loughran
b9465bb876
Revert "HADOOP-14654. Update httpclient version to 4.5.3. (rchiang)" 
This reverts commit 1118ca9b07.
 2017-09-14 13:31:30 +01:00
Ray Chiang
f1d751bd05 HADOOP-14797. Update re2j version to 1.1. (rchiang) 2017-09-12 11:35:21 -07:00
Ray Chiang
a6432ba5a1 HADOOP-14653. Update joda-time version to 2.9.9. (rchiang) 2017-09-12 11:12:44 -07:00
Ray Chiang
39818259c3 HADOOP-14648. Bump commons-configuration2 to 2.1.1. (rchiang) 2017-09-12 10:53:48 -07:00
Ray Chiang
af45cd1be6 HADOOP-14796. Update json-simple version to 1.1.1. (rchiang) 2017-09-12 10:36:04 -07:00
Ray Chiang
556812c179 HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang) 2017-09-12 10:19:34 -07:00