hadoop

Go to file

MAPREDUCE-7341. Add an intermediate manifest committer for Azure and GCS

This is a mapreduce/spark output committer optimized for
performance and correctness on Azure ADLS Gen 2 storage
(via the abfs connector) and Google Cloud Storage
(via the external gcs connector library).

* It is safe to use with HDFS, however it has not been optimized
for that use.
* It is *not* safe for use with S3, and will fail if an attempt
is made to do so.

Contributed by Steve Loughran

Change-Id: I6f3502e79c578b9fd1a8c1485f826784b5421fca

2022-03-17 11:46:41 +00:00

.github

HADOOP-15184. Add GitHub pull request template. (#1419 )

2019-09-11 11:10:11 +09:00

dev-support

HADOOP-18125. Utility to identify git commit / Jira fixVersion discrepancies for RC preparation (#3991 )

2022-02-22 11:01:35 +08:00

hadoop-assemblies

Preparing for 3.3.3 development

2021-11-16 16:02:34 -08:00

hadoop-build-tools

Preparing for 3.3.3 development

2021-11-16 16:02:34 -08:00

hadoop-client-modules

HADOOP-18033. Upgrade fasterxml Jackson to 2.13.0 (#3764 )

2021-12-13 13:52:44 +09:00

hadoop-cloud-storage-project

Preparing for 3.3.3 development

2021-11-16 16:02:34 -08:00

hadoop-common-project

HADOOP-18162. hadoop-common support for MAPREDUCE-7341 Manifest Committer

2022-03-17 11:46:11 +00:00

hadoop-dist

Preparing for 3.3.3 development

2021-11-16 16:02:34 -08:00

hadoop-hdfs-project

HDFS-16502. Reconfigure Block Invalidate limit (#4064 )

2022-03-16 09:40:59 +08:00

hadoop-mapreduce-project

MAPREDUCE-7341. Add an intermediate manifest committer for Azure and GCS

2022-03-17 11:46:41 +00:00

hadoop-maven-plugins

Preparing for 3.3.3 development

2021-11-16 16:02:34 -08:00

hadoop-minicluster

Preparing for 3.3.3 development

2021-11-16 16:02:34 -08:00

hadoop-project

HADOOP-18126. update junit 5 version due to build issues (#3993 )

2022-02-17 14:07:57 +09:00

hadoop-project-dist

Make upstream aware of 3.3.2 release

2022-03-02 19:10:30 -08:00

hadoop-tools

HADOOP-18112: Implement paging during multi object delete. (#4045 )

2022-03-11 13:16:51 +05:30

hadoop-yarn-project

HADOOP-17276. Extend CallerContext to make it include many items (#2327 )

2022-03-14 10:28:38 -07:00

licenses

HADOOP-17666. Update LICENSE for 3.3.1 (#3011 )

2021-05-21 18:15:48 -07:00

licenses-binary

HADOOP-17666. Update LICENSE for 3.3.1 (#3011 )

2021-05-21 18:15:48 -07:00

.gitattributes

HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin.

2016-09-14 11:14:31 +09:00

.gitignore

YARN-10407. Add phantomjsdriver.log to gitignore. (#2244 )

2021-02-17 10:28:17 +09:00

BUILDING.txt

HADOOP-17925. BUILDING.txt should not encourage to activate docs profile on building binary artifacts. (#3509 )

2021-10-11 08:57:07 +00:00

LICENSE-binary

HADOOP-18044. Hadoop - Upgrade to jQuery 3.6.0 (#3791 )

2022-02-11 23:18:25 +08:00

LICENSE-binary-yarn-applications-catalog-webapp

HADOOP-17666. Update LICENSE for 3.3.1 (#3011 )

2021-05-21 18:15:48 -07:00

LICENSE-binary-yarn-ui

HADOOP-17666. Update LICENSE for 3.3.1 (#3011 )

2021-05-21 18:15:48 -07:00

LICENSE.txt

HADOOP-18044. Hadoop - Upgrade to jQuery 3.6.0 (#3791 )

2022-02-11 23:18:25 +08:00

NOTICE-binary

HADOOP-18068. upgrade AWS SDK to 1.12.132 (#3864 )

2022-01-18 12:20:12 +00:00

NOTICE.txt

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

pom.xml

Also update hadoop.version to 3.3.3-SNAPSHOT

2021-11-16 16:13:51 -08:00

README.txt

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

start-build-env.sh

HADOOP-18052. Support Apple Silicon in start-build-env.sh (#3817 )

2021-12-23 18:14:16 +09:00

README.txt

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/

Languages

Java 92.9%

C++ 2.8%

C 1.8%

JavaScript 1.1%

Shell 0.5%

Other 0.6%