big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
25,250 Commits 2 Branches 2 Tags 264 MiB
b8f7c7527a
Commit Graph

279 Commits

Author SHA1 Message Date
Liang-Chi Hsieh
b8f7c7527a
HADOOP-17891. Exclude snappy-java and lz4-java from relocation in shaded hadoop client libraries (#3385) 2021-09-14 11:17:18 -07:00
Ayush Saxena
4d18a2eb99
HADOOP-17904. Test Result Not Working In Jenkins Result. (#3413). Contributed by Ayush Saxena. 2021-09-11 05:15:54 +05:30
Gautham B A
c8e5864838
HADOOP-17854. Run junit in Jenkins only if surefire reports exist (#3319) 2021-08-24 10:26:26 -07:00
Gautham B A
4fd97e01e5
HADOOP-17787. Refactor fetching of credentials in Jenkins (#3167) 2021-08-06 11:56:27 -07:00
Gautham B A
e80b5a08e2
HADOOP-17816. Run optional CI for changes in C (#3238) 
* HADOOP-17816. Run optional CI for changes in C

* We need to ensure that we run
  the CI for all the platforms
  when there are changes in C files.

* Trigger CI

* Revert "Trigger CI"

This reverts commit ecb88350b91c692cac128fc6f72dcd8971932041.
 2021-08-05 12:13:33 +00:00
Gautham B A
13467f4524
HADOOP-17815. Run CI for Centos 7 (#3231) 2021-07-29 10:50:57 -07:00
Gautham B A
97c88c97de
HADOOP-17807. Use separate src dir for platform builds (#3210) 2021-07-26 13:09:36 -07:00
Masatake Iwasaki
c42441a1ec
HADOOP-17775. Remove JavaScript package from Docker environment. (#3137) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2021-07-07 11:07:10 +09:00
Gautham B A
7c999e2d9a
HADOOP-17778. CI for Centos 8 (#3151) 2021-06-30 22:04:54 -07:00
Gautham B A
ef5dbc7283
HADOOP-17766. CI for Debian 10 (#3129) 2021-06-23 10:02:33 -07:00
Gautham B A
51991c4907
HADOOP-17724. Add Dockerfile for Debian 10 (#3038) 2021-06-17 10:14:44 -07:00
Takanobu Asanuma
ae9630f580
HADOOP-17756. Increase precommit job timeout from 20 hours to 24 hours. (#3090) 
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
 2021-06-14 10:17:39 +09:00
Gautham B A
1c0b2edde9
HADOOP-17727. Modularize docker images (#3043) 
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
 2021-06-07 20:11:08 -07:00
Wei-Chiu Chuang
1576f81dfe
HADOOP-17723. [build] fix the Dockerfile for ARM (#3037) 
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
 2021-05-24 03:19:58 -07:00
Wei-Chiu Chuang
ad923ad564
HADOOP-17718. Explicitly set locale in the Dockerfile. (#3034) 
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
 2021-05-21 09:26:50 -07:00
Wei-Chiu Chuang
110cda3de6
HADOOP-17703. checkcompatibility.py errors out when specifying annotations. (#3017) 
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
 2021-05-17 20:21:54 -07:00
Ayush Saxena
fcd4140e5f
HDFS-15988. Stabilise HDFS Pre-Commit. (#2860). Contributed by Ayush Saxena. 
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
 2021-05-16 00:45:11 +05:30
Gautham B A
2e58fb671b
HADOOP-17693. Dockerfile for building on Centos 8 (#3006) 2021-05-13 09:28:27 -07:00
Gautham B A
8f850b46a0
HADOOP-17678. Add Dockerfile for Centos 7 (#2967) 2021-05-10 10:05:14 -07:00
Gautham B A
02b9506c5a
HDFS-15948. Fix test4tests for libhdfspp (#2873) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2021-04-07 19:06:25 +09:00
Akira Ajisaka
2b62b12d0d
HADOOP-17582. Replace GitHub App Token with GitHub OAuth token (#2766) 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
 2021-03-12 18:04:00 +09:00
Akira Ajisaka
9b78de2550
HADOOP-17570. Apply YETUS-1102 to re-enable GitHub comments (#2745) 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
 2021-03-11 21:48:47 +09:00
Akira Ajisaka
23b343aed1
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753) 
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
 2021-03-11 10:56:07 +09:00
Akira Ajisaka
63aa142b77
HADOOP-17557. skip-dir option is not processed by Yetus. Contributed by Ahmed Hussein. 2021-03-09 11:10:10 +09:00
Akira Ajisaka
b9b49ed956
HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (#1738) 
- Upgrade Yetus to 0.13.0 to support Python 3 for the release scripts.
- Removed determine-flaky-tests-hadoop.py.
- Temporarily disabled shelldocs check due to YETUS-1099.

Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
 2021-02-20 17:18:23 +09:00
Akira Ajisaka
9a298d180d
Revert "HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2454)" 
This reverts commit 4cf3531583.
 2021-02-19 11:09:10 +09:00
Akira Ajisaka
4cf3531583
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2454) 
Use spotbugs instead of findbugs. Removed findbugs from the hadoop build images,
and added spotbugs in the images instead.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Dinesh Chitlangia <dineshc@apache.org>
 2021-02-17 10:38:20 +09:00
Gautham B A
6c891c0dd4
HADOOP-17509. Parallelize building of dependencies (#2669) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2021-02-03 00:09:30 +09:00
Akira Ajisaka
84b154ebc0
HADOOP-17354. Move Jenkinsfile outside of the root directory. (#2647) 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
 2021-02-01 18:51:00 +09:00
Gautham B A
a9ff726e42
HADOOP-17496. Install a supported version of pip (#2653) 
pip version 21 ended support for python 2.7. Thus we need to
install a version of pip that supports python 2.7.

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2021-01-26 23:06:38 +09:00
Gautham B A
b441ca8699
HADOOP-17465. Upgrade to Focal (#2613) 2021-01-25 21:15:43 -08:00
Takanobu Asanuma
d09e3c929f
HADOOP-17224. Install Intel ISA-L library in Dockerfile. (#2537) 2021-01-22 10:27:06 +09:00
Akira Ajisaka
ae4945fb2c
YARN-10560. Upgrade node.js to 10.23.1 and yarn to 1.22.5 in Web UI v2. (#2592) 2021-01-06 12:12:46 +09:00
Masatake Iwasaki
9aefe72ed6
HDFS-15743. Fix -Pdist build failure of hadoop-hdfs-native-client. (#2569) 2020-12-22 07:19:44 +09:00
Akira Ajisaka
34e2abd811
HADOOP-17352. Update PATCH_NAMING_RULE in the personality file. (#2433) 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
 2020-11-10 13:58:27 +09:00
Takanobu Asanuma
4b312810ae
Revert "HADOOP-17224. Install Intel ISA-L library in Dockerfile. (#2243)" (#2440) 2020-11-06 11:20:45 +09:00
Liang-Chi Hsieh
c9ea344f98
HADOOP-17125. Use snappy-java in SnappyCodec (#2297) 
This switches the SnappyCodec to use the java-snappy codec, rather than the native one. 

To use the codec, snappy-java.jar (from org.xerial.snappy) needs to be on the classpath.

This comesin as an avro dependency,  so it is already on the hadoop-common classpath,
as well as in hadoop-common/lib.
The version used is now managed in the hadoop-project POM; initially 1.1.7.7

Contributed by DB Tsai and Liang-Chi Hsieh
 2020-10-06 17:07:54 +01:00
tkuramoto33
3fc007a37b
HADOOP-17282. libzstd-dev should be used instead of libzstd1-dev on Ubuntu 18.04 or higher. (#2336) 2020-09-25 14:17:50 +09:00
Wanqiang Ji
ce86183691
HADOOP-17246. Fix build the hadoop-build Docker image failed (#2277) 2020-09-16 16:23:57 +09:00
Takanobu Asanuma
931adbaa14
HADOOP-17224. Install Intel ISA-L library in Dockerfile. (#2243) 2020-08-26 23:15:24 +09:00
Chao Sun
fefacf2578
HADOOP-17205. Move personality file from Yetus to Hadoop repository (#2226) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2020-08-18 12:08:58 +09:00
Akira Ajisaka
e277d338da
YARN-10367. Failed to get nodejs 10.21.0 when building docker image (#2171) 2020-07-27 00:51:44 +09:00
Gautham B A
cce5a6f609
HDFS-15385 Upgrade boost library to 1.72 (#2051) 
* Removed the asio-1.10.2 that was
  checked in under libhdfspp/third_party
  directory.
 2020-07-15 13:39:48 +09:00
zhaorenhai
6c57be4897
HADOOP-17084 Update Dockerfile_aarch64 to use Bionic (#2103). Contributed by zhaorenhai. 
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
 2020-07-01 15:27:11 +05:30
Akira Ajisaka
cd188ea9f0
YARN-10331. Upgrade node.js to 10.21.0. (#2106) 2020-06-30 16:52:57 +09:00
Akira Ajisaka
9821b94c94
HADOOP-16888. [JDK11] Support JDK11 in the precommit job (#2012) 
* Install JDK 11 in the docker image
* Refactor Dockerfile
* Add compile test with JDK11 via Yetus multijdk feature
 2020-06-19 13:29:44 +09:00
Akira Ajisaka
5157118bd7
HADOOP-17056. Addendum patch: Fix typo 2020-06-04 16:34:46 +09:00
Akira Ajisaka
9c290c08db
HADOOP-17056. shelldoc fails in hadoop-common. (#2045) 
In the docker build image, skip GPG verification when downloading
Yetus tarball via yetus-wrapper.
 2020-06-03 18:01:37 +09:00
Wanqiang Ji
d9838f2d42
HADOOP-17055. Remove residual code of Ozone (#2039) 2020-05-29 16:49:18 +09:00
Akira Ajisaka
81d8b71534
HADOOP-16054. Update Dockerfile to use Bionic (#1966) 2020-04-26 02:54:45 +09:00