big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
26,535 Commits 2 Branches 2 Tags 264 MiB
14c5810d5e
Commit Graph

87 Commits

Author SHA1 Message Date
Chris Nauroth
14c5810d5e HADOOP-18680: Insufficient heap during full test runs in Docker container. 
Closes #5522

Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
 2023-04-03 22:53:29 +00:00
Gautham B A
5694d7e25f
Add Dockerfile_windows_10 (#4936) 2022-10-12 09:30:54 -07:00
Gautham B A
7ac271307c
HADOOP-18274. Use CMake 3.19.0 in Debian 10 (#4395) 2022-06-02 11:16:05 -07:00
Gautham B A
712e009172
HADOOP-18268. Install maven from Apache archives (#4373) 
* The remote server hosting maven
  was temporarily unavailable causing
  the Hadoop Jenkins CI to fail.
* Thus, we're switching to use a CDN
  to mitigate such issues.
 2022-06-02 17:05:18 +05:30
Gautham B A
19561846df
HADOOP-18151. Switch the baseurl for Centos 8 (#4047) 
* Centos 8 has reached its
  End-of-Life and thus its
  packages are no longer
  accessible from
  mirror.centos.org.
* This PR switches the baseurl
  to vault.centos.org where
  the packages are archived.
 2022-03-05 07:11:22 +05:30
Gautham B A
d6eb077247
HADOOP-17902. Fix Hadoop build on Debian 10 (#3408) 2021-09-18 11:51:33 -07:00
Gautham B A
16ca362564
HADOOP-17913. Filter deps with release labels (#3437) 2021-09-16 09:18:58 -07:00
Gautham B A
13467f4524
HADOOP-17815. Run CI for Centos 7 (#3231) 2021-07-29 10:50:57 -07:00
Masatake Iwasaki
c42441a1ec
HADOOP-17775. Remove JavaScript package from Docker environment. (#3137) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2021-07-07 11:07:10 +09:00
Gautham B A
7c999e2d9a
HADOOP-17778. CI for Centos 8 (#3151) 2021-06-30 22:04:54 -07:00
Gautham B A
ef5dbc7283
HADOOP-17766. CI for Debian 10 (#3129) 2021-06-23 10:02:33 -07:00
Gautham B A
51991c4907
HADOOP-17724. Add Dockerfile for Debian 10 (#3038) 2021-06-17 10:14:44 -07:00
Gautham B A
1c0b2edde9
HADOOP-17727. Modularize docker images (#3043) 
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
 2021-06-07 20:11:08 -07:00
Wei-Chiu Chuang
1576f81dfe
HADOOP-17723. [build] fix the Dockerfile for ARM (#3037) 
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
 2021-05-24 03:19:58 -07:00
Wei-Chiu Chuang
ad923ad564
HADOOP-17718. Explicitly set locale in the Dockerfile. (#3034) 
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
 2021-05-21 09:26:50 -07:00
Ayush Saxena
fcd4140e5f
HDFS-15988. Stabilise HDFS Pre-Commit. (#2860). Contributed by Ayush Saxena. 
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
 2021-05-16 00:45:11 +05:30
Gautham B A
2e58fb671b
HADOOP-17693. Dockerfile for building on Centos 8 (#3006) 2021-05-13 09:28:27 -07:00
Gautham B A
8f850b46a0
HADOOP-17678. Add Dockerfile for Centos 7 (#2967) 2021-05-10 10:05:14 -07:00
Akira Ajisaka
23b343aed1
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753) 
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
 2021-03-11 10:56:07 +09:00
Akira Ajisaka
b9b49ed956
HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (#1738) 
- Upgrade Yetus to 0.13.0 to support Python 3 for the release scripts.
- Removed determine-flaky-tests-hadoop.py.
- Temporarily disabled shelldocs check due to YETUS-1099.

Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
 2021-02-20 17:18:23 +09:00
Akira Ajisaka
9a298d180d
Revert "HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2454)" 
This reverts commit 4cf3531583.
 2021-02-19 11:09:10 +09:00
Akira Ajisaka
4cf3531583
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2454) 
Use spotbugs instead of findbugs. Removed findbugs from the hadoop build images,
and added spotbugs in the images instead.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Dinesh Chitlangia <dineshc@apache.org>
 2021-02-17 10:38:20 +09:00
Gautham B A
6c891c0dd4
HADOOP-17509. Parallelize building of dependencies (#2669) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2021-02-03 00:09:30 +09:00
Gautham B A
a9ff726e42
HADOOP-17496. Install a supported version of pip (#2653) 
pip version 21 ended support for python 2.7. Thus we need to
install a version of pip that supports python 2.7.

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2021-01-26 23:06:38 +09:00
Gautham B A
b441ca8699
HADOOP-17465. Upgrade to Focal (#2613) 2021-01-25 21:15:43 -08:00
Takanobu Asanuma
d09e3c929f
HADOOP-17224. Install Intel ISA-L library in Dockerfile. (#2537) 2021-01-22 10:27:06 +09:00
Akira Ajisaka
ae4945fb2c
YARN-10560. Upgrade node.js to 10.23.1 and yarn to 1.22.5 in Web UI v2. (#2592) 2021-01-06 12:12:46 +09:00
Takanobu Asanuma
4b312810ae
Revert "HADOOP-17224. Install Intel ISA-L library in Dockerfile. (#2243)" (#2440) 2020-11-06 11:20:45 +09:00
tkuramoto33
3fc007a37b
HADOOP-17282. libzstd-dev should be used instead of libzstd1-dev on Ubuntu 18.04 or higher. (#2336) 2020-09-25 14:17:50 +09:00
Wanqiang Ji
ce86183691
HADOOP-17246. Fix build the hadoop-build Docker image failed (#2277) 2020-09-16 16:23:57 +09:00
Takanobu Asanuma
931adbaa14
HADOOP-17224. Install Intel ISA-L library in Dockerfile. (#2243) 2020-08-26 23:15:24 +09:00
Akira Ajisaka
e277d338da
YARN-10367. Failed to get nodejs 10.21.0 when building docker image (#2171) 2020-07-27 00:51:44 +09:00
Gautham B A
cce5a6f609
HDFS-15385 Upgrade boost library to 1.72 (#2051) 
* Removed the asio-1.10.2 that was
  checked in under libhdfspp/third_party
  directory.
 2020-07-15 13:39:48 +09:00
zhaorenhai
6c57be4897
HADOOP-17084 Update Dockerfile_aarch64 to use Bionic (#2103). Contributed by zhaorenhai. 
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
 2020-07-01 15:27:11 +05:30
Akira Ajisaka
cd188ea9f0
YARN-10331. Upgrade node.js to 10.21.0. (#2106) 2020-06-30 16:52:57 +09:00
Akira Ajisaka
9821b94c94
HADOOP-16888. [JDK11] Support JDK11 in the precommit job (#2012) 
* Install JDK 11 in the docker image
* Refactor Dockerfile
* Add compile test with JDK11 via Yetus multijdk feature
 2020-06-19 13:29:44 +09:00
Akira Ajisaka
5157118bd7
HADOOP-17056. Addendum patch: Fix typo 2020-06-04 16:34:46 +09:00
Akira Ajisaka
9c290c08db
HADOOP-17056. shelldoc fails in hadoop-common. (#2045) 
In the docker build image, skip GPG verification when downloading
Yetus tarball via yetus-wrapper.
 2020-06-03 18:01:37 +09:00
Wanqiang Ji
d9838f2d42
HADOOP-17055. Remove residual code of Ozone (#2039) 2020-05-29 16:49:18 +09:00
Akira Ajisaka
81d8b71534
HADOOP-16054. Update Dockerfile to use Bionic (#1966) 2020-04-26 02:54:45 +09:00
Akira Ajisaka
e6455cc864
HADOOP-16949. pylint fails in the build environment (#1926) 2020-04-04 16:52:04 +09:00
Akira Ajisaka
4454c6d14b
Revert "HADOOP-16054. Update Dockerfile to use Bionic." (#1911) 
This reverts commit 367833cf41.
 2020-03-24 22:05:33 +09:00
Akira Ajisaka
367833cf41
HADOOP-16054. Update Dockerfile to use Bionic. 
Contributed by Akira Ajisaka.
 2020-03-18 13:44:44 +00:00
Vinayakumar B
52b360a928
HADOOP-16797. Add Dockerfile for ARM builds. Contributed by Vinayakumar B. (#1801) 2020-01-13 10:40:29 +05:30
Akira Ajisaka
c44943d1fc
YARN-10054. Upgrade yarn to 1.21.1 in Dockerfile. (#1777) 2019-12-23 14:08:14 +09:00
Akira Ajisaka
bc825b9628
YARN-10036. Install yarnpkg and upgrade nodejs in Dockerfile (#1772) 2019-12-23 10:30:26 +09:00
Kevin Su
e573ea4908
HADOOP-16754. Fix docker failed to build yetus/hadoop. 
Contributed by Kevin Su.

Change-Id: Ie9cf27b7a7ba5923405f24d39b95b0248f3718b7
 2019-12-11 16:56:25 +00:00
Ayush Saxena
104ccca916 HDFS-14900. Fix build failure of hadoop-hdfs-native-client. Contributed by Masatake Iwasaki. 2019-10-10 21:36:02 +05:30
pingsutw
1dde3efb91
HADOOP-16624. Upgrade hugo to the latest version in Dockerfile 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-10-04 10:01:07 +09:00
Akira Ajisaka
0e026cb0ce
HADOOP-16620. [pb-upgrade] Remove protocol buffers 3.7.1 from requirements in BUILDING.txt (#1558) 
* Removed protobuf 3.7.1 from Dockerfile
 2019-10-03 15:24:47 +09:00