This PR gets Yetus to run on Windows 10
against the Hadoop codebase. It introduces
the following changes to allow us to setup
the nightly CI on Jenkins for Hadoop on
Windows 10.
* Hadoop personality changes for Yetus.
Additional arguments have been passed,
which are necessary to build and test
Hadoop on Windows 10.
* Docker image for building Hadoop on
Windows 10.
Installs the necessary tools that are
needed to run Yetus.
* dev-support/jenkins.sh file.
Passing of some flags are handled here
which are needed for the nightly CI.
part of HADOOP-18103.
Add support for multiple ranged vectored read api in PositionedReadable.
The default iterates through the ranges to read each synchronously,
but the intent is that FSDataInputStream subclasses can make more
efficient readers especially in object stores implementation.
Also added implementation in S3A where smaller ranges are merged and
sliced byte buffers are returned to the readers. All the merged ranged are
fetched from S3 asynchronously.
Contributed By: Owen O'Malley and Mukund Thakur
* The remote server hosting maven
was temporarily unavailable causing
the Hadoop Jenkins CI to fail.
* Thus, we're switching to use a CDN
to mitigate such issues.
This allows for builds to be run with options like
--mvnargs="-Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false"
Contributed by Ayush Saxena.
Change-Id: I396e82d0915d679657d063a948f865041bcdde29
Since April 2022/CVE-2022-24765, git refuses to work in directories
whose owner != the current user, unless explicitly told to trust it.
This patches the create-release script to trust the /build/source
dir mounted from the hosting OS, whose userid is inevitably different
from that of the account in the container running git.
Contributed by: Steve Loughran, Ayush Saxena and the new git error messages
* Centos 8 has reached its
End-of-Life and thus its
packages are no longer
accessible from
mirror.centos.org.
* This PR switches the baseurl
to vault.centos.org where
the packages are archived.
* HADOOP-17816. Run optional CI for changes in C
* We need to ensure that we run
the CI for all the platforms
when there are changes in C files.
* Trigger CI
* Revert "Trigger CI"
This reverts commit ecb88350b91c692cac128fc6f72dcd8971932041.
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
- Upgrade Yetus to 0.13.0 to support Python 3 for the release scripts.
- Removed determine-flaky-tests-hadoop.py.
- Temporarily disabled shelldocs check due to YETUS-1099.
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
Use spotbugs instead of findbugs. Removed findbugs from the hadoop build images,
and added spotbugs in the images instead.
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Dinesh Chitlangia <dineshc@apache.org>
pip version 21 ended support for python 2.7. Thus we need to
install a version of pip that supports python 2.7.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
