big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
24,837 Commits 2 Branches 2 Tags 264 MiB
Java 92.9%
C++ 2.8%
C 1.8%
JavaScript 1.1%
Shell 0.5%
Other 0.6%
1cc83f0f45
Go to file
Steve Loughran 1cc83f0f45
MAPREDUCE-7341. Add an intermediate manifest committer for Azure and GCS 
This is a mapreduce/spark output committer optimized for
performance and correctness on Azure ADLS Gen 2 storage
(via the abfs connector) and Google Cloud Storage
(via the external gcs connector library).

* It is safe to use with HDFS, however it has not been optimized
for that use.
* It is *not* safe for use with S3, and will fail if an attempt
is made to do so.

Contributed by Steve Loughran

Change-Id: I6f3502e79c578b9fd1a8c1485f826784b5421fca
2022-03-17 11:46:41 +00:00
.github HADOOP-15184. Add GitHub pull request template. (#1419) 2019-09-11 11:10:11 +09:00
dev-support HADOOP-18125. Utility to identify git commit / Jira fixVersion discrepancies for RC preparation (#3991) 2022-02-22 11:01:35 +08:00
hadoop-assemblies Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-build-tools Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-client-modules HADOOP-18033. Upgrade fasterxml Jackson to 2.13.0 (#3764) 2021-12-13 13:52:44 +09:00
hadoop-cloud-storage-project Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-common-project HADOOP-18162. hadoop-common support for MAPREDUCE-7341 Manifest Committer 2022-03-17 11:46:11 +00:00
hadoop-dist Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-hdfs-project HDFS-16502. Reconfigure Block Invalidate limit (#4064) 2022-03-16 09:40:59 +08:00
hadoop-mapreduce-project MAPREDUCE-7341. Add an intermediate manifest committer for Azure and GCS 2022-03-17 11:46:41 +00:00
hadoop-maven-plugins Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-minicluster Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-project HADOOP-18126. update junit 5 version due to build issues (#3993) 2022-02-17 14:07:57 +09:00
hadoop-project-dist Make upstream aware of 3.3.2 release 2022-03-02 19:10:30 -08:00
hadoop-tools HADOOP-18112: Implement paging during multi object delete. (#4045) 2022-03-11 13:16:51 +05:30
hadoop-yarn-project HADOOP-17276. Extend CallerContext to make it include many items (#2327) 2022-03-14 10:28:38 -07:00
licenses HADOOP-17666. Update LICENSE for 3.3.1 (#3011) 2021-05-21 18:15:48 -07:00
licenses-binary HADOOP-17666. Update LICENSE for 3.3.1 (#3011) 2021-05-21 18:15:48 -07:00
.gitattributes HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin. 2016-09-14 11:14:31 +09:00
.gitignore YARN-10407. Add phantomjsdriver.log to gitignore. (#2244) 2021-02-17 10:28:17 +09:00
BUILDING.txt HADOOP-17925. BUILDING.txt should not encourage to activate docs profile on building binary artifacts. (#3509) 2021-10-11 08:57:07 +00:00
LICENSE-binary HADOOP-18044. Hadoop - Upgrade to jQuery 3.6.0 (#3791) 2022-02-11 23:18:25 +08:00
LICENSE-binary-yarn-applications-catalog-webapp HADOOP-17666. Update LICENSE for 3.3.1 (#3011) 2021-05-21 18:15:48 -07:00
LICENSE-binary-yarn-ui HADOOP-17666. Update LICENSE for 3.3.1 (#3011) 2021-05-21 18:15:48 -07:00
LICENSE.txt HADOOP-18044. Hadoop - Upgrade to jQuery 3.6.0 (#3791) 2022-02-11 23:18:25 +08:00
NOTICE-binary HADOOP-18068. upgrade AWS SDK to 1.12.132 (#3864) 2022-01-18 12:20:12 +00:00
NOTICE.txt HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
pom.xml Also update hadoop.version to 3.3.3-SNAPSHOT 2021-11-16 16:13:51 -08:00
README.txt HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
start-build-env.sh HADOOP-18052. Support Apple Silicon in start-build-env.sh (#3817) 2021-12-23 18:14:16 +09:00

README.txt 

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/