Gautham B A
a9ff726e42
HADOOP-17496. Install a supported version of pip ( #2653 )
...
pip version 21 ended support for python 2.7. Thus we need to
install a version of pip that supports python 2.7.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-01-26 23:06:38 +09:00
Gautham B A
b441ca8699
HADOOP-17465. Upgrade to Focal ( #2613 )
2021-01-25 21:15:43 -08:00
Takanobu Asanuma
d09e3c929f
HADOOP-17224. Install Intel ISA-L library in Dockerfile. ( #2537 )
2021-01-22 10:27:06 +09:00
Akira Ajisaka
ae4945fb2c
YARN-10560. Upgrade node.js to 10.23.1 and yarn to 1.22.5 in Web UI v2. ( #2592 )
2021-01-06 12:12:46 +09:00
Masatake Iwasaki
9aefe72ed6
HDFS-15743. Fix -Pdist build failure of hadoop-hdfs-native-client. ( #2569 )
2020-12-22 07:19:44 +09:00
Akira Ajisaka
34e2abd811
HADOOP-17352. Update PATCH_NAMING_RULE in the personality file. ( #2433 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2020-11-10 13:58:27 +09:00
Takanobu Asanuma
4b312810ae
Revert "HADOOP-17224. Install Intel ISA-L library in Dockerfile. ( #2243 )" ( #2440 )
2020-11-06 11:20:45 +09:00
Liang-Chi Hsieh
c9ea344f98
HADOOP-17125. Use snappy-java in SnappyCodec ( #2297 )
...
This switches the SnappyCodec to use the java-snappy codec, rather than the native one.
To use the codec, snappy-java.jar (from org.xerial.snappy) needs to be on the classpath.
This comesin as an avro dependency, so it is already on the hadoop-common classpath,
as well as in hadoop-common/lib.
The version used is now managed in the hadoop-project POM; initially 1.1.7.7
Contributed by DB Tsai and Liang-Chi Hsieh
2020-10-06 17:07:54 +01:00
tkuramoto33
3fc007a37b
HADOOP-17282. libzstd-dev should be used instead of libzstd1-dev on Ubuntu 18.04 or higher. ( #2336 )
2020-09-25 14:17:50 +09:00
Wanqiang Ji
ce86183691
HADOOP-17246. Fix build the hadoop-build Docker image failed ( #2277 )
2020-09-16 16:23:57 +09:00
Takanobu Asanuma
931adbaa14
HADOOP-17224. Install Intel ISA-L library in Dockerfile. ( #2243 )
2020-08-26 23:15:24 +09:00
Chao Sun
fefacf2578
HADOOP-17205. Move personality file from Yetus to Hadoop repository ( #2226 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2020-08-18 12:08:58 +09:00
Akira Ajisaka
e277d338da
YARN-10367. Failed to get nodejs 10.21.0 when building docker image ( #2171 )
2020-07-27 00:51:44 +09:00
Gautham B A
cce5a6f609
HDFS-15385 Upgrade boost library to 1.72 ( #2051 )
...
* Removed the asio-1.10.2 that was
checked in under libhdfspp/third_party
directory.
2020-07-15 13:39:48 +09:00
zhaorenhai
6c57be4897
HADOOP-17084 Update Dockerfile_aarch64 to use Bionic ( #2103 ). Contributed by zhaorenhai.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2020-07-01 15:27:11 +05:30
Akira Ajisaka
cd188ea9f0
YARN-10331. Upgrade node.js to 10.21.0. ( #2106 )
2020-06-30 16:52:57 +09:00
Akira Ajisaka
9821b94c94
HADOOP-16888. [JDK11] Support JDK11 in the precommit job ( #2012 )
...
* Install JDK 11 in the docker image
* Refactor Dockerfile
* Add compile test with JDK11 via Yetus multijdk feature
2020-06-19 13:29:44 +09:00
Akira Ajisaka
5157118bd7
HADOOP-17056. Addendum patch: Fix typo
2020-06-04 16:34:46 +09:00
Akira Ajisaka
9c290c08db
HADOOP-17056. shelldoc fails in hadoop-common. ( #2045 )
...
In the docker build image, skip GPG verification when downloading
Yetus tarball via yetus-wrapper.
2020-06-03 18:01:37 +09:00
Wanqiang Ji
d9838f2d42
HADOOP-17055. Remove residual code of Ozone ( #2039 )
2020-05-29 16:49:18 +09:00
Akira Ajisaka
81d8b71534
HADOOP-16054. Update Dockerfile to use Bionic ( #1966 )
2020-04-26 02:54:45 +09:00
Vinayakumar B
4d24d99e85
HADOOP-16985. Handle release package related issues ( #1957 )
2020-04-15 20:38:19 +05:30
Akira Ajisaka
e6455cc864
HADOOP-16949. pylint fails in the build environment ( #1926 )
2020-04-04 16:52:04 +09:00
Akira Ajisaka
4454c6d14b
Revert "HADOOP-16054. Update Dockerfile to use Bionic." ( #1911 )
...
This reverts commit 367833cf41
.
2020-03-24 22:05:33 +09:00
Akira Ajisaka
367833cf41
HADOOP-16054. Update Dockerfile to use Bionic.
...
Contributed by Akira Ajisaka.
2020-03-18 13:44:44 +00:00
Vinayakumar B
52b360a928
HADOOP-16797. Add Dockerfile for ARM builds. Contributed by Vinayakumar B. ( #1801 )
2020-01-13 10:40:29 +05:30
Akira Ajisaka
c44943d1fc
YARN-10054. Upgrade yarn to 1.21.1 in Dockerfile. ( #1777 )
2019-12-23 14:08:14 +09:00
Akira Ajisaka
bc825b9628
YARN-10036. Install yarnpkg and upgrade nodejs in Dockerfile ( #1772 )
2019-12-23 10:30:26 +09:00
Kevin Su
e573ea4908
HADOOP-16754. Fix docker failed to build yetus/hadoop.
...
Contributed by Kevin Su.
Change-Id: Ie9cf27b7a7ba5923405f24d39b95b0248f3718b7
2019-12-11 16:56:25 +00:00
Masatake Iwasaki
ccca5f4a40
HADOOP-16441. if use -Dbundle.openssl=true, bundled with unnecessary libk5crypto.*. Contributed by KWON BYUNGCHANG.
2019-12-04 14:25:46 +09:00
Ayush Saxena
104ccca916
HDFS-14900. Fix build failure of hadoop-hdfs-native-client. Contributed by Masatake Iwasaki.
2019-10-10 21:36:02 +05:30
pingsutw
1dde3efb91
HADOOP-16624. Upgrade hugo to the latest version in Dockerfile
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-10-04 10:01:07 +09:00
Akira Ajisaka
0e026cb0ce
HADOOP-16620. [pb-upgrade] Remove protocol buffers 3.7.1 from requirements in BUILDING.txt ( #1558 )
...
* Removed protobuf 3.7.1 from Dockerfile
2019-10-03 15:24:47 +09:00
Vinayakumar B
efed4450bf
HADOOP-16589. [pb-upgrade] Update docker image to make 3.7.1 protoc as default ( #1482 ). Contributed by Vinayakumar B.
2019-09-21 10:07:26 +05:30
Vinayakumar B
39e82acc48
HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable ( #1429 ).
...
Addendum patch. Moved protobuf-3.7.1 installation within YETUS marker.
2019-09-13 16:50:16 +05:30
Vinayakumar B
f4f9f0fe4f
HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable ( #1429 ). Contributed by Vinayakumar B.
2019-09-12 16:47:54 +05:30
Akira Ajisaka
567091aa9b
HADOOP-15958. Revisiting LICENSE and NOTICE files.
...
This closes #1307
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
2019-08-27 13:47:12 +09:00
Akira Ajisaka
5e156b9dde
HADOOP-16061. Upgrade Yetus to 0.10.0
...
This closes #1298
2019-08-22 13:01:11 +09:00
Akira Ajisaka
34dd9ee366
HADOOP-16494. Add SHA-512 checksum to release artifact to comply with the release distribution policy.
...
This closes #1243
2019-08-22 11:01:02 +09:00
Erik Krogen
ab0b180ddb
HDFS-12345 Add Dynamometer to hadoop-tools, a tool for scale testing the HDFS NameNode with real metadata and workloads. Contributed by Erik Krogen.
2019-06-25 08:07:39 -07:00
Sammi Chen
d1aad44490
HDFS-14356. Implement HDFS cache on SCM with native PMDK libs. Contributed by Feilong He.
2019-06-05 21:33:00 +08:00
Wanqiang Ji
d23e8e9232
HADOOP-16334. Fix yetus-wrapper not working when HADOOP_YETUS_VERSION >= 0.9.0
...
This closes #864
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-05-30 15:11:05 +09:00
Xieming Li
bdbca0e53b
HADOOP-16052. Remove Subversion and Forrest from Dockerfile
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-04-11 19:56:15 +09:00
Akira Ajisaka
af5958f7b6
HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia.
2018-11-16 13:16:59 +09:00
Akira Ajisaka
df5e863fee
HADOOP-15930. Exclude MD5 checksum files from release artifact.
2018-11-15 10:45:34 +09:00
Akira Ajisaka
703b2860a4
HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent.
2018-11-13 13:40:43 +09:00
Akira Ajisaka
8f97d6f2cd
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe.
2018-10-24 13:49:28 +09:00
Eric Yang
e2a9fa8448
HADOOP-15821. Move YARN Registry to Hadoop Registry.
...
Contributed by Íñigo Goiri
2018-10-19 19:46:48 -04:00
Bharat Viswanadham
62f817d32e
HDDS-447. Separate ozone-dist and hadoop-dist projects with real classpath separation. Contributed by Elek Marton.
2018-09-24 10:10:11 -07:00
Márton Elek
b6ad84ebb1
HDDS-468. Add version number to datanode plugin and ozone file system jar. Contributed by Bharat Viswanadham.
...
(cherry picked from commit a71aea732315ffc5c99c011369adfbeddb9a8c01)
2018-09-18 11:01:52 +02:00
Bharat Viswanadham
8b2f5e60fa
HDDS-352. Separate install and testing phases in acceptance tests. Contributed by Elek Marton.
2018-09-17 17:13:52 -07:00
Bharat Viswanadham
3d89c3e73e
HDDS-463. Fix the release packaging of the ozone distribution. Contributed by Elek Marton.
2018-09-17 11:49:09 -07:00
Anu Engineer
8af8453589
HDDS-435. Enhance the existing ozone documentation.
...
Contributed by Elek, Marton.
2018-09-17 10:46:28 -07:00
Bharat Viswanadham
b95aa56062
HDDS-446. Provide shaded artifact to start ozone service as a datanode plugin. Contributed by Elek Marton
2018-09-14 14:12:03 -07:00
Anu Engineer
7b5886bf78
HDDS-222. Remove hdfs command line from ozone distribution.
...
Contributed by Elek, Marton.
2018-09-11 10:19:50 -07:00
Allen Wittenauer
4b8c2b1c1c
HADOOP-14671. Upgrade Apache Yetus to 0.8.0
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-09-11 08:55:34 -07:00
Mukul Kumar Singh
692736f7cf
HDDS-280. Support ozone dist-start-stitching on openbsd/osx. Contributed by Elek, Marton.
2018-08-30 02:21:24 +05:30
Anu Engineer
af4b705b5f
HDDS-342. Add example byteman script to print out hadoop rpc traffic.
...
Contributed by Elek, Marton.
2018-08-22 14:48:22 -07:00
Xiaoyu Yao
9dd5d5ba71
HDDS-218. add existing docker-compose files to the ozone release artifact. Contributed by Elek Marton.
2018-08-17 07:58:24 -07:00
Eric Yang
ba1ab08fda
HADOOP-15610. Fixed pylint version for Hadoop docker image.
...
Contributed by Jack Bearden
2018-07-18 20:09:43 -04:00
Arpit Agarwal
061b168529
HDDS-167. Rename KeySpaceManager to OzoneManager. Contributed by Arpit Agarwal.
2018-07-06 12:09:05 -07:00
Anu Engineer
e16e5b307d
HDDS-177. Create a releasable ozonefs artifact
...
Contributed by Marton, Elek.
2018-06-24 01:05:04 -07:00
Mukul Kumar Singh
63fc5873ce
HDDS-84. The root directory of ozone.tar.gz should contain the version string. Contributed by Elek, Marton.
2018-05-23 21:07:37 +05:30
Anu Engineer
481bfdb94f
HDDS-89. Create ozone specific inline documentation as part of the build.
...
Contributed by Elek, Marton.
2018-05-22 10:49:10 -07:00
Anu Engineer
4b4f24ad5f
HDDS-40. Separating packaging of Ozone/HDDS from the main Hadoop.
...
Contributed by Elek, Marton.
2018-05-11 14:24:36 -07:00
Owen O'Malley
2adda92de1
HDFS-7240 git commit fixup
...
Signed-off-by: Owen O'Malley <omalley@apache.org>
2018-04-26 13:52:17 -07:00
Anu Engineer
bf206f014a
HDFS-13196. Ozone: dozone: make example docker-compose files version independent. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
Anu Engineer
254cbe2589
HDFS-12983. Block Storage: provide docker-compose file for cblock clusters. Contributed by Elek,Marton.
2018-04-26 05:36:04 -07:00
Xiaoyu Yao
10e1e2c2f5
HDFS-12812. Ozone: dozone: initialize scm and ksm directory on cluster startup. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
Anu Engineer
abb62dd7ef
HDFS-12702. Ozone: Add hugo to the dev docker image. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
Xiaoyu Yao
b1e2704a3a
HDFS-12656. Ozone: dozone: Use (proposed) base image from HADOOP-14898. Contributed by Elek, Marton
2018-04-26 05:36:04 -07:00
Anu Engineer
da9fd06f6a
HDFS-12562. Ozone: Add ASF license to docker files. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
Anu Engineer
94090acf3a
HDFS-12469. Ozone: Create docker-compose definition to easily test real clusters. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
Akira Ajisaka
659074728e
HADOOP-15352. Fix default local maven repository path in create-release script. Contributed by Elek, Marton.
2018-03-30 23:25:14 +09:00
James Clampffer
8620d2bdf9
HDFS-12110: libhdfs++: Rebase HDFS-8707 on trunk, minor conflict resolution in this patch. Contributed by Deepak Majeti and Anatoli Shein.
2018-03-22 17:19:47 -04:00
James Clampffer
033433bce7
HDFS-12026: libhdfs++: Fix compilation errors and warnings when compiling with Clang. Contributed by Anatoli Shein.
2018-03-22 17:19:47 -04:00
Bob Hansen
549a5dbce9
HDFS-10450: libhdfs++: Add Cyrus SASL support. Contributed by Don Davis.
2018-03-22 17:19:47 -04:00
James
dba377bfcc
HDFS-9448. Enable valgrind for libhdfspp unit tests. Contributed by Bob Hansen.
2018-03-22 17:19:46 -04:00
weiy
6e2b5fa493
HDFS-13215. RBF: Move Router to its own module. Contributed by Wei Yan
2018-03-19 22:13:40 -07:00
Chris Douglas
3fc3fa9711
HADOOP-14667. Flexible Visual Studio support. Contributed by Allen Wittenauer
2018-03-19 16:05:55 -07:00
Allen Wittenauer
d4cc50f622
HADOOP-15279. increase maven heap size recommendations
...
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
2018-03-01 15:32:43 -08:00
Chris Douglas
329a4fdd07
HADOOP-13374. Add the L&N verification script. Contributed by Allen Wittenauer
2018-02-23 17:07:22 -08:00
Sean Mackrory
5533648241
HADOOP-15058. create-release site build outputs dummy shaded jars due to skipShade. Contributed by Andrew Wang.
2017-12-04 15:39:43 -07:00
Andrew Wang
51e882d5c9
HADOOP-15018. Update JAVA_HOME in create-release for Xenial Dockerfile.
2017-11-07 16:39:04 -08:00
Akira Ajisaka
5b98639400
HADOOP-14977. Xenial dockerfile needs ant in main build for findbugs
...
Signed-off-by: Allen Wittenauer <aw@apache.org>
2017-10-25 08:08:22 -07:00
Chris Douglas
ca8ddc6aa4
HADOOP-14816. Update Dockerfile to use Xenial. Contributed by Allen Wittenauer
2017-10-19 16:45:18 -07:00
Akira Ajisaka
0de40f0e27
Revert "HADOOP-13514. Upgrade maven surefire plugin to 2.19.1."
...
This reverts commit 3d04c00aed
.
2017-10-13 18:00:25 +09:00
Akira Ajisaka
3d04c00aed
HADOOP-13514. Upgrade maven surefire plugin to 2.19.1.
2017-10-11 10:42:32 +09:00
Andrew Wang
3cf3540f19
HADOOP-14835. mvn site build throws SAX errors. Contributed by Andrew Wang and Sean Mackrory.
2017-09-18 15:13:42 -07:00
Allen Wittenauer
71bbb86d69
HADOOP-14670. Increase minimum cmake version for all platforms
...
Signed-off-by: Chris Douglas <cdouglas@apache.org>
2017-08-30 21:47:24 -07:00
Akira Ajisaka
99926756fc
Revert "HADOOP-14671. Upgrade to Apache Yetus 0.5.0."
...
This reverts commit 33afa94af1
.
2017-08-30 16:54:30 +02:00
Akira Ajisaka
33afa94af1
HADOOP-14671. Upgrade to Apache Yetus 0.5.0.
2017-08-29 13:36:22 +02:00
Arpit Agarwal
a6fdeb8a87
HADOOP-13963. /bin/bash is hard coded in some of the scripts. Contributed by Ajay Yadav.
2017-08-04 10:40:52 -07:00
Allen Wittenauer
0c52da7d3e
HADOOP-14602. allow custom release notes/changelog during create-release
...
Signed-off-by: Chris Douglas <cdouglas@apache.org>
2017-06-29 08:03:16 -07:00
Sangjin Lee
14b5c93f3c
HADOOP-14366. Maven upgrade broke start-build-env.sh. Contributed by
...
Akira Ajisaka.
2017-05-01 15:54:01 -07:00
Arun Suresh
0ac17dc644
HADOOP-14311. Add python2.7-dev to Dockerfile (Allen Wittenauer via asuresh)
2017-04-14 16:56:16 -07:00
Akira Ajisaka
612578fe67
HADOOP-14285. Update minimum version of Maven from 3.0 to 3.3.
2017-04-08 14:23:26 +09:00
Allen Wittenauer
39fa3712d9
HADOOP-14008. Upgrade to Apache Yetus 0.4.0
...
Signed-off-by: Andrew Wang <wang@apache.org>
2017-04-07 21:23:09 -07:00
Andrew Wang
2bf4c6e2d6
HADOOP-13996. Fix some release build issues.
2017-01-18 15:18:48 -08:00
Jason Lowe
a0a2761621
HADOOP-13578. Add Codec for ZStandard Compression. Contributed by churro morales
2017-01-04 14:46:25 +00:00