big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
76bbd17374
hadoop/dev-support
History
Steve Loughran d7fd61d616
HADOOP-18202. create-release fails fatal: unsafe repository (#4188) 
Since April 2022/CVE-2022-24765, git refuses to work in directories
whose owner != the current user, unless explicitly told to trust it.

This patches the create-release script to trust the /build/source
dir mounted from the hosting OS, whose userid is inevitably different
from that of the account in the container running git.

Contributed by: Steve Loughran, Ayush Saxena and the new git error messages
2022-04-18 19:24:35 +01:00
..
bin HADOOP-18202. create-release fails fatal: unsafe repository (#4188) 2022-04-18 19:24:35 +01:00
byteman HDDS-342. Add example byteman script to print out hadoop rpc traffic. 2018-08-22 14:48:22 -07:00
code-formatter HADOOP-17892. Add Hadoop code formatter in dev-support (#3387) 2021-09-23 12:34:19 +08:00
docker HADOOP-18151. Switch the baseurl for Centos 8 (#4047) 2022-03-05 07:11:22 +05:30
git-jira-validation HADOOP-18125. Utility to identify git commit / Jira fixVersion discrepancies for RC preparation (#3991) 2022-02-22 11:00:38 +08:00
findHangingTest.sh HADOOP-13963. /bin/bash is hard coded in some of the scripts. Contributed by Ajay Yadav. 2017-08-04 10:40:52 -07:00
hadoop-vote.sh HADOOP-18098. Basic verification for the release candidate vote (#3944) 2022-02-07 09:34:58 +08:00
jenkins.sh HADOOP-17985. Disable JIRA plugin for Yetus run (#3601) 2021-11-01 02:18:23 +09:00
Jenkinsfile HADOOP-17985. Disable JIRA plugin for Yetus run (#3601) 2021-11-01 02:18:23 +09:00
README.md HADOOP-12651. Replace dev-support with wrappers to Yetus (aw) 2016-01-21 13:03:34 -08:00
verify-xml.sh HADOOP-13963. /bin/bash is hard coded in some of the scripts. Contributed by Ajay Yadav. 2017-08-04 10:40:52 -07:00
win-paths-eg.cmd HADOOP-14667. Flexible Visual Studio support. Contributed by Allen Wittenauer 2018-03-19 16:05:55 -07:00

README.md

This directory contains tools to help in the development and release of Apache Hadoop.

  • bin

    • releasedocmaker

      Build release notes for a given Hadoop project or subproject. This is called from Maven when -Preleasedocs is used. See BUILDING.txt for more information.

    • shelldocs

      Create documentation for the Unix Shell API. This is called from Maven when -Pshelldocs is used.

    • smart-apply-patch

      Intelligently apply a patch file to a source tree.

    • test-patch

      Test a patch against a source tree.

  • create-release.sh

    Helps REs create a release of Apache Hadoop for distribution.

  • determine-flaky-tests-hadoop.py

    Given a jenkins test job, this script examines all runs of the job done within specified period of time (number of days prior to the execution time of this script), and reports all failed tests.

  • docker

    Various helpers for the start-build-env.sh script, including the Dockerfile itself. See parent BUILDING.txt for more information.

  • findHangingTest.sh

    Finds hanging test from Jenkins build output.

Previously, the scripts test-patch.sh, smart-apply-patch.sh, releasedocmaker.py, and shelldocs.py were in this directory. They have been moved to the Apache Yetus project (https://yetus.apache.org). These scripts have been replaced with wrapper scripts located in the bin directory. Command line options are generally different than the previous versions that shipped with older versions of Apache Hadoop.

The wrapper scripts will download, verify (if GPG is installed), and cache a local copy of Apache Yetus in the hadoop/patchprocess directory. The version that is used may be overridden by setting the HADOOP_YETUS_VERSION environment variable. The cache directory may be overwritten by setting the HADOOP_PATCHPROCESS directory. If a local version of Apache Yetus is already installed, it may be used instead by setting the YETUS_HOME environment variable to point to that directory.