This PR enables one to create the Hadoop
release tarball on Windows, complete with
the native binaries (including winutils.exe).
This PR contains the following changes -
* Prevents splitting during array element
expansion - this is needed since we need
to pass the arguments correctly to maven.
* Install Python 3.11.8 and pip to the
Windows docker image for building
Hadoop.
* pom file changes to get maven to invoke
the releasedocmaker script through
bash.exe on Windows.
* This PR installs Python 3.10.11 for
Windows 10 Docker image to fix
the issue with building mvnsite.
* After installing Python 3.10.11, it
creates the hardlink python -> python3
as required by the script.
This PR gets Yetus to run on Windows 10
against the Hadoop codebase. It introduces
the following changes to allow us to setup
the nightly CI on Jenkins for Hadoop on
Windows 10.
* Hadoop personality changes for Yetus.
Additional arguments have been passed,
which are necessary to build and test
Hadoop on Windows 10.
* Docker image for building Hadoop on
Windows 10.
Installs the necessary tools that are
needed to run Yetus.
* dev-support/jenkins.sh file.
Passing of some flags are handled here
which are needed for the nightly CI.
part of HADOOP-18103.
Add support for multiple ranged vectored read api in PositionedReadable.
The default iterates through the ranges to read each synchronously,
but the intent is that FSDataInputStream subclasses can make more
efficient readers especially in object stores implementation.
Also added implementation in S3A where smaller ranges are merged and
sliced byte buffers are returned to the readers. All the merged ranged are
fetched from S3 asynchronously.
Contributed By: Owen O'Malley and Mukund Thakur
* The remote server hosting maven
was temporarily unavailable causing
the Hadoop Jenkins CI to fail.
* Thus, we're switching to use a CDN
to mitigate such issues.
This allows for builds to be run with options like
--mvnargs="-Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false"
Contributed by Ayush Saxena.
Change-Id: I396e82d0915d679657d063a948f865041bcdde29
Since April 2022/CVE-2022-24765, git refuses to work in directories
whose owner != the current user, unless explicitly told to trust it.
This patches the create-release script to trust the /build/source
dir mounted from the hosting OS, whose userid is inevitably different
from that of the account in the container running git.
Contributed by: Steve Loughran, Ayush Saxena and the new git error messages
* Centos 8 has reached its
End-of-Life and thus its
packages are no longer
accessible from
mirror.centos.org.
* This PR switches the baseurl
to vault.centos.org where
the packages are archived.
* HADOOP-17816. Run optional CI for changes in C
* We need to ensure that we run
the CI for all the platforms
when there are changes in C files.
* Trigger CI
* Revert "Trigger CI"
This reverts commit ecb88350b91c692cac128fc6f72dcd8971932041.
