big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
25,225 Commits 2 Branches 2 Tags 264 MiB
a226016c52
Commit Graph

68 Commits

Author SHA1 Message Date
Chris Nauroth
3400e8257e HADOOP-18680: Insufficient heap during full test runs in Docker container on branch-3.3. 
Closes #5511

Signed-off-by: Shilun Fan <slfan1989@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
 2023-04-03 22:58:53 +00:00
Steve Loughran
61e1603750
HADOOP-18401. No ARM binaries in branch-3.3.x releases. (#4953) 
Fix the branch-3.3 docker image and create-release scripts to work on arm 64 and macbook m1

Contributed by Ayush Saxena and Steve Loughran
 2022-10-07 15:58:51 +01:00
Siyao Meng
0cab54909a
HADOOP-18048. [branch-3.3] Dockerfile_aarch64 build fails with fatal error: Python.h: No such file or directory (#3801) 2021-12-14 17:56:58 -08:00
Masatake Iwasaki
99cff01e38
HADOOP-17775. Remove JavaScript package from Docker environment. (#3182) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2021-07-07 17:49:19 +09:00
Wei-Chiu Chuang
745a2f5ec3
HADOOP-17723. [build] fix the Dockerfile for ARM (#3037) 
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 1576f81dfe)
 2021-05-24 18:20:49 +08:00
Gautham B A
23ada04dac
HADOOP-17509. Parallelize building of dependencies (#2669) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 6c891c0dd4)
 2021-05-22 01:32:37 +08:00
Wei-Chiu Chuang
5e09d38b25
HADOOP-17718. Explicitly set locale in the Dockerfile. (#3034) 
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit ad923ad564)

Conflicts:
	dev-support/docker/Dockerfile_centos_7
	dev-support/docker/Dockerfile_centos_8
 2021-05-22 00:31:59 +08:00
Takanobu Asanuma
932a16837a
HADOOP-17224. Install Intel ISA-L library in Dockerfile. (#2537) 
(cherry picked from commit d09e3c929f)
 2021-05-19 20:27:22 +08:00
Akira Ajisaka
de2904f123
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753) 
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 23b343aed1)

 Conflicts:
	dev-support/docker/Dockerfile
	hadoop-project/pom.xml
 2021-03-11 14:57:03 +09:00
Akira Ajisaka
ff8b79f890
HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (branch-3.3) (#2709) 
- Upgrade Yetus to 0.13.0 to support Python 3 for the release scripts.
- Removed determine-flaky-tests-hadoop.py.
- Temporarily disabled shelldocs check due to YETUS-1099.

Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
(cherry picked from commit b9b49ed956)

 Conflicts:
	dev-support/Jenkinsfile
	dev-support/docker/Dockerfile
	dev-support/docker/Dockerfile_aarch64
 2021-02-22 15:19:05 +09:00
zhaorenhai
c7bab342ee
HADOOP-17084 Update Dockerfile_aarch64 to use Bionic (#2103). Contributed by zhaorenhai. 
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 6c57be4897)
 2021-02-22 13:49:51 +09:00
Akira Ajisaka
118a5747f8
HADOOP-16054. Update Dockerfile to use Bionic (#1966) 
(cherry picked from commit 81d8b71534)
 2021-02-22 13:49:29 +09:00
Akira Ajisaka
3748c258f9
YARN-10560. Upgrade node.js to 10.23.1 and yarn to 1.22.5 in Web UI v2. (#2592) 
(cherry picked from commit ae4945fb2c)
 2021-01-06 12:14:09 +09:00
Akira Ajisaka
74c0764343
HADOOP-17246. Addendum patch for branch-3.3. 2020-09-16 16:45:20 +09:00
Wanqiang Ji
cda7d6ca85
HADOOP-17246. Fix build the hadoop-build Docker image failed (#2277) 
(cherry picked from commit ce86183691)
 2020-09-16 16:24:44 +09:00
Akira Ajisaka
9263b75b3c
YARN-10367. Failed to get nodejs 10.21.0 when building docker image (#2171) 
(cherry picked from commit e277d338da)
 2020-07-27 00:53:24 +09:00
Masatake Iwasaki
7522b44067 HADOOP-17120. Fix failure of docker image creation due to pip2 install error. (#2130) 
(cherry picked from commit 53cfe6090419649dde18e3bf0d6ff757f76d716f)
 2020-07-09 03:19:18 +00:00
Akira Ajisaka
aa283fc2c2
YARN-10331. Upgrade node.js to 10.21.0. (#2106) 
(cherry picked from commit cd188ea9f0)
 2020-06-30 16:54:59 +09:00
Akira Ajisaka
9cfc0e50fa
HADOOP-17056. Addendum patch: Fix typo 
(cherry picked from commit 5157118bd7)
 2020-06-04 16:35:27 +09:00
Akira Ajisaka
c88bf7acc1
HADOOP-17056. shelldoc fails in hadoop-common. (#2045) 
In the docker build image, skip GPG verification when downloading
Yetus tarball via yetus-wrapper.

(cherry picked from commit 9c290c08db)
 2020-06-03 18:03:03 +09:00
Wanqiang Ji
9b84a637b7
HADOOP-17055. Remove residual code of Ozone (#2039) 
(cherry picked from commit d9838f2d42)
 2020-05-29 16:50:10 +09:00
Akira Ajisaka
f537a51288
HADOOP-16949. pylint fails in the build environment (#1926) 
(cherry picked from commit e6455cc864)
 2020-04-04 16:53:26 +09:00
Akira Ajisaka
4454c6d14b
Revert "HADOOP-16054. Update Dockerfile to use Bionic." (#1911) 
This reverts commit 367833cf41.
 2020-03-24 22:05:33 +09:00
Akira Ajisaka
367833cf41
HADOOP-16054. Update Dockerfile to use Bionic. 
Contributed by Akira Ajisaka.
 2020-03-18 13:44:44 +00:00
Vinayakumar B
52b360a928
HADOOP-16797. Add Dockerfile for ARM builds. Contributed by Vinayakumar B. (#1801) 2020-01-13 10:40:29 +05:30
Akira Ajisaka
c44943d1fc
YARN-10054. Upgrade yarn to 1.21.1 in Dockerfile. (#1777) 2019-12-23 14:08:14 +09:00
Akira Ajisaka
bc825b9628
YARN-10036. Install yarnpkg and upgrade nodejs in Dockerfile (#1772) 2019-12-23 10:30:26 +09:00
Kevin Su
e573ea4908
HADOOP-16754. Fix docker failed to build yetus/hadoop. 
Contributed by Kevin Su.

Change-Id: Ie9cf27b7a7ba5923405f24d39b95b0248f3718b7
 2019-12-11 16:56:25 +00:00
Ayush Saxena
104ccca916 HDFS-14900. Fix build failure of hadoop-hdfs-native-client. Contributed by Masatake Iwasaki. 2019-10-10 21:36:02 +05:30
pingsutw
1dde3efb91
HADOOP-16624. Upgrade hugo to the latest version in Dockerfile 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-10-04 10:01:07 +09:00
Akira Ajisaka
0e026cb0ce
HADOOP-16620. [pb-upgrade] Remove protocol buffers 3.7.1 from requirements in BUILDING.txt (#1558) 
* Removed protobuf 3.7.1 from Dockerfile
 2019-10-03 15:24:47 +09:00
Vinayakumar B
efed4450bf
HADOOP-16589. [pb-upgrade] Update docker image to make 3.7.1 protoc as default (#1482). Contributed by Vinayakumar B. 2019-09-21 10:07:26 +05:30
Vinayakumar B
39e82acc48 HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable (#1429). 
Addendum patch. Moved protobuf-3.7.1 installation within YETUS marker.
 2019-09-13 16:50:16 +05:30
Vinayakumar B
f4f9f0fe4f
HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable (#1429). Contributed by Vinayakumar B. 2019-09-12 16:47:54 +05:30
Xieming Li
bdbca0e53b
HADOOP-16052. Remove Subversion and Forrest from Dockerfile 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-04-11 19:56:15 +09:00
Akira Ajisaka
8f97d6f2cd
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe. 2018-10-24 13:49:28 +09:00
Allen Wittenauer
4b8c2b1c1c
HADOOP-14671. Upgrade Apache Yetus to 0.8.0 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-09-11 08:55:34 -07:00
Eric Yang
ba1ab08fda HADOOP-15610. Fixed pylint version for Hadoop docker image. 
Contributed by Jack Bearden
 2018-07-18 20:09:43 -04:00
Anu Engineer
abb62dd7ef HDFS-12702. Ozone: Add hugo to the dev docker image. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
James Clampffer
8620d2bdf9 HDFS-12110: libhdfs++: Rebase HDFS-8707 on trunk, minor conflict resolution in this patch. Contributed by Deepak Majeti and Anatoli Shein. 2018-03-22 17:19:47 -04:00
James Clampffer
033433bce7 HDFS-12026: libhdfs++: Fix compilation errors and warnings when compiling with Clang. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
Bob Hansen
549a5dbce9 HDFS-10450: libhdfs++: Add Cyrus SASL support. Contributed by Don Davis. 2018-03-22 17:19:47 -04:00
James
dba377bfcc HDFS-9448. Enable valgrind for libhdfspp unit tests. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
Allen Wittenauer
d4cc50f622 HADOOP-15279. increase maven heap size recommendations 
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
 2018-03-01 15:32:43 -08:00
Akira Ajisaka
5b98639400
HADOOP-14977. Xenial dockerfile needs ant in main build for findbugs 
Signed-off-by: Allen Wittenauer <aw@apache.org>
 2017-10-25 08:08:22 -07:00
Chris Douglas
ca8ddc6aa4 HADOOP-14816. Update Dockerfile to use Xenial. Contributed by Allen Wittenauer 2017-10-19 16:45:18 -07:00
Akira Ajisaka
0de40f0e27
Revert "HADOOP-13514. Upgrade maven surefire plugin to 2.19.1." 
This reverts commit 3d04c00aed.
 2017-10-13 18:00:25 +09:00
Akira Ajisaka
3d04c00aed
HADOOP-13514. Upgrade maven surefire plugin to 2.19.1. 2017-10-11 10:42:32 +09:00
Allen Wittenauer
71bbb86d69
HADOOP-14670. Increase minimum cmake version for all platforms 
Signed-off-by: Chris Douglas <cdouglas@apache.org>
 2017-08-30 21:47:24 -07:00
Arpit Agarwal
a6fdeb8a87 HADOOP-13963. /bin/bash is hard coded in some of the scripts. Contributed by Ajay Yadav. 2017-08-04 10:40:52 -07:00