big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
23,860 Commits 2 Branches 2 Tags 264 MiB
Java 92.9%
C++ 2.8%
C 1.8%
JavaScript 1.1%
Shell 0.5%
Other 0.6%
29b19cd592
Go to file
Mukund Thakur 29b19cd592
HADOOP-16900. Very large files can be truncated when written through the S3A FileSystem. 
Contributed by Mukund Thakur and Steve Loughran.

This patch ensures that writes to S3A fail when more than 10,000 blocks are
written. That upper bound still exists. To write massive files, make sure
that the value of fs.s3a.multipart.size is set to a size which is large
enough to upload the files in fewer than 10,000 blocks.

Change-Id: Icec604e2a357ffd38d7ae7bc3f887ff55f2d721a
2020-05-20 13:42:25 +01:00
.github HADOOP-15184. Add GitHub pull request template. (#1419) 2019-09-11 11:10:11 +09:00
dev-support HADOOP-16054. Update Dockerfile to use Bionic (#1966) 2020-04-26 02:54:45 +09:00
hadoop-assemblies HADOOP-16985. Handle release package related issues (#1957) 2020-04-15 20:38:19 +05:30
hadoop-build-tools Preparing for 3.4.0 development 2020-03-29 23:24:25 +05:30
hadoop-client-modules Preparing for 3.4.0 development 2020-03-29 23:24:25 +05:30
hadoop-cloud-storage-project HADOOP-17007. hadoop-cos fails to build. Contributed by Yang Yu. 2020-04-26 12:46:53 +05:30
hadoop-common-project HADOOP-17024. ListStatus on ViewFS root (ls "/") should list the linkFallBack root (configured target root). Contributed by Abhishek Das. 2020-05-18 22:27:12 -07:00
hadoop-dist Preparing for 3.4.0 development 2020-03-29 23:24:25 +05:30
hadoop-hdfs-project HDFS-15340. RBF: Implement BalanceProcedureScheduler basic framework. Contributed by Jinglun. 2020-05-20 10:39:40 +08:00
hadoop-mapreduce-project MAPREDUCE-6826. Job fails with InvalidStateTransitonException: Invalid event: JOB_TASK_COMPLETED at SUCCEEDED/COMMITTING. Contributed by Bilwa S T. 2020-05-19 11:06:36 +05:30
hadoop-maven-plugins Preparing for 3.4.0 development 2020-03-29 23:24:25 +05:30
hadoop-minicluster HDFS-15331. Remove invalid exclusions that minicluster dependency on HDFS (#1996). Contributed by Wanqiang Ji 2020-05-06 02:06:38 +05:30
hadoop-project YARN-10265. Upgrade Netty-all dependency to latest version 4.1.50 to fix ARM support issue. Contributed by liusheng 2020-05-14 15:09:34 +05:30
hadoop-project-dist Preparing for 3.4.0 development 2020-03-29 23:24:25 +05:30
hadoop-tools HADOOP-16900. Very large files can be truncated when written through the S3A FileSystem. 2020-05-20 13:42:25 +01:00
hadoop-yarn-project YARN-9606. Set sslfactory for AuthenticatedURL() while creating LogsCLI#webServiceClient. 2020-05-20 11:36:52 +05:30
licenses HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
licenses-binary HADOOP-15993. Upgrade Kafka to 2.4.0 in hadoop-kafka module. (#1796) 2020-01-09 16:24:58 +09:00
.gitattributes HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin. 2016-09-14 11:14:31 +09:00
.gitignore HADOOP-16952. Add .diff to gitignore. Contributed by Ayush Saxena. 2020-04-03 13:57:02 +05:30
BUILDING.txt HADOOP-16856. cmake is missing in the CentOS 8 section of BUILDING.txt. (#1841) 2020-02-12 21:17:33 +09:00
Jenkinsfile HADOOP-16944. Use Yetus 0.12.0 in GitHub PR (#1917) 2020-04-19 02:43:44 +09:00
LICENSE-binary YARN-10074. Update netty to 4.1.42Final in yarn-csi. Contributed by Wei-Chiu Chuang. (#1807) 2020-02-25 13:47:52 +09:00
LICENSE.txt YARN-9561. Add C changes for the new RuncContainerRuntime. Contributed by Eric Badger 2019-12-09 01:25:10 +00:00
NOTICE-binary HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
NOTICE.txt HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
pom.xml upate the hadoop.version property in the root pom.xml and hadoop.assemblies.version in hadoop-project/pom.xml (see HADOOP-15369) 2020-03-29 23:44:20 +05:30
README.txt HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
start-build-env.sh HADOOP-16849. start-build-env.sh behaves incorrectly when username is numeric only. Contributed by Jihyun Cho. 2020-02-12 14:06:23 +09:00

README.txt 

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/