big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
dc56fc385a
hadoop/hadoop-tools
History
Steve Loughran dc56fc385a
HADOOP-19295. S3A: large uploads can timeout over slow links (#7089) 
This sets a different timeout for data upload PUT/POST calls to all
other requests, so that slow block uploads do not trigger timeouts
as rapidly as normal requests. This was always the behavior
in the V1 AWS SDK; for V2 we have to explicitly set it on the operations
we want to give extended timeouts. 

Option:  fs.s3a.connection.part.upload.timeout
Default: 15m

Contributed by Steve Loughran
2024-10-07 17:57:13 +01:00
..
hadoop-aliyun HADOOP-15760. Upgrade commons-collections to commons-collections4 (#7006) 2024-09-24 16:50:22 +01:00
hadoop-archive-logs Preparing for 3.5.0 development (#6411) 2024-01-19 15:05:22 +08:00
hadoop-archives HADOOP-19041. Use StandardCharsets in more places (#6449) 2024-03-28 23:17:18 -04:00
hadoop-aws HADOOP-19295. S3A: large uploads can timeout over slow links (#7089) 2024-10-07 17:57:13 +01:00
hadoop-azure HADOOP-19280. [ABFS] Initialize client timer only if metric collection is enabled (#7061) 2024-09-30 16:56:18 +01:00
hadoop-azure-datalake Preparing for 3.5.0 development (#6411) 2024-01-19 15:05:22 +08:00
hadoop-benchmark Preparing for 3.5.0 development (#6411) 2024-01-19 15:05:22 +08:00
hadoop-compat-bench HADOOP-19085. Compatibility Benchmark over HCFS Implementations 2024-03-17 16:48:29 +08:00
hadoop-datajoin HADOOP-19134. Use StringBuilder instead of StringBuffer. (#6692). Contributed by PJ Fanning 2024-08-18 21:29:12 +05:30
hadoop-distcp HDFS-17381. Distcp of EC files should not be limited to DFS. (#6551) 2024-09-25 17:54:09 +01:00
hadoop-dynamometer Revert "HADOOP-19231. Add JacksonUtil to manage Jackson classes (#6953)" 2024-08-29 14:42:03 +05:30
hadoop-extras HADOOP-19024. Use bouncycastle jdk18 1.77 (#6410). Contributed 2024-03-30 19:58:12 +05:30
hadoop-federation-balance Preparing for 3.5.0 development (#6411) 2024-01-19 15:05:22 +08:00
hadoop-fs2img HADOOP-19041. Use StandardCharsets in more places (#6449) 2024-03-28 23:17:18 -04:00
hadoop-gridmix HADOOP-16928. Make javadoc work on Java 17 (#6976) 2024-09-04 11:50:59 +01:00
hadoop-kafka Preparing for 3.5.0 development (#6411) 2024-01-19 15:05:22 +08:00
hadoop-openstack Preparing for 3.5.0 development (#6411) 2024-01-19 15:05:22 +08:00
hadoop-pipes Preparing for 3.5.0 development (#6411) 2024-01-19 15:05:22 +08:00
hadoop-resourceestimator Preparing for 3.5.0 development (#6411) 2024-01-19 15:05:22 +08:00
hadoop-rumen Revert "HADOOP-19231. Add JacksonUtil to manage Jackson classes (#6953)" 2024-08-29 14:42:03 +05:30
hadoop-sls HADOOP-15760. Upgrade commons-collections to commons-collections4 (#7006) 2024-09-24 16:50:22 +01:00
hadoop-streaming HADOOP-16928. Make javadoc work on Java 17 (#6976) 2024-09-04 11:50:59 +01:00
hadoop-tools-dist Preparing for 3.5.0 development (#6411) 2024-01-19 15:05:22 +08:00
pom.xml HADOOP-19085. Compatibility Benchmark over HCFS Implementations 2024-03-17 16:48:29 +08:00