big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
23,793 Commits 2 Branches 2 Tags 264 MiB
Java 92.9%
C++ 2.8%
C 1.8%
JavaScript 1.1%
Shell 0.5%
Other 0.6%
b0c9e4f1b5
Go to file
Mukund Thakur b0c9e4f1b5
HADOOP-16900. Very large files can be truncated when written through the S3A FileSystem. 
Contributed by Mukund Thakur and Steve Loughran.

This patch ensures that writes to S3A fail when more than 10,000 blocks are
written. That upper bound still exists. To write massive files, make sure
that the value of fs.s3a.multipart.size is set to a size which is large
enough to upload the files in fewer than 10,000 blocks.

Change-Id: Icec604e2a357ffd38d7ae7bc3f887ff55f2d721a
2020-06-01 12:01:13 +01:00
.github HADOOP-15184. Add GitHub pull request template. (#1419) 2019-09-11 11:10:11 +09:00
dev-support HADOOP-17055. Remove residual code of Ozone (#2039) 2020-05-29 16:50:10 +09:00
hadoop-assemblies Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
hadoop-build-tools Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
hadoop-client-modules Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
hadoop-cloud-storage-project Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
hadoop-common-project HADOOP-7002. Wrong description of copyFromLocal and copyToLocal in documentation. Contributed by Andras Bokor. 2020-05-29 14:49:40 +01:00
hadoop-dist Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
hadoop-hdfs-project HADOOP-17055. Remove residual code of Ozone (#2039) 2020-05-29 16:50:10 +09:00
hadoop-mapreduce-project MAPREDUCE-7278. Speculative execution behavior is observed even when mapreduce.map.speculative and mapreduce.reduce.speculative are false 2020-05-28 13:36:21 +10:00
hadoop-maven-plugins Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
hadoop-minicluster Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
hadoop-project HADOOP-17049. javax.activation-api and jakarta.activation-api define overlapping classes (#2027) 2020-05-22 11:20:16 +09:00
hadoop-project-dist Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
hadoop-tools HADOOP-16900. Very large files can be truncated when written through the S3A FileSystem. 2020-06-01 12:01:13 +01:00
hadoop-yarn-project YARN-6492. Generate queue metrics for each partition. Contributed by Manikandan R 2020-05-29 09:25:08 -07:00
licenses HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
licenses-binary HADOOP-15993. Upgrade Kafka to 2.4.0 in hadoop-kafka module. (#1796) 2020-01-09 16:24:58 +09:00
.gitattributes HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin. 2016-09-14 11:14:31 +09:00
.gitignore HADOOP-17055. Remove residual code of Ozone (#2039) 2020-05-29 16:50:10 +09:00
BUILDING.txt HADOOP-16856. cmake is missing in the CentOS 8 section of BUILDING.txt. (#1841) 2020-02-12 21:17:33 +09:00
Jenkinsfile HADOOP-16944. Use Yetus 0.12.0 in GitHub PR (#1917) 2020-04-21 21:12:02 +09:00
LICENSE-binary HADOOP-17049. javax.activation-api and jakarta.activation-api define overlapping classes (#2027) 2020-05-22 11:20:16 +09:00
LICENSE.txt YARN-9561. Add C changes for the new RuncContainerRuntime. Contributed by Eric Badger 2019-12-09 01:25:10 +00:00
NOTICE-binary HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
NOTICE.txt HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
pom.xml Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
README.txt HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
start-build-env.sh HADOOP-16849. start-build-env.sh behaves incorrectly when username is numeric only. Contributed by Jihyun Cho. 2020-02-12 14:06:23 +09:00

README.txt 

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/