hadoop/hadoop-tools/hadoop-aws/src
Mukund Thakur 4d1f6f9b99 HADOOP-18106: Handle memory fragmentation in S3A Vectored IO. (#4445)
part of HADOOP-18103.
Handling memory fragmentation in S3A vectored IO implementation by
allocating smaller user range requested size buffers and directly
filling them from the remote S3 stream and skipping undesired
data in between ranges.
This patch also adds aborting active vectored reads when stream is
closed or unbuffer() is called.

Contributed By: Mukund Thakur
2022-06-22 17:29:32 +01:00
..
main HADOOP-18106: Handle memory fragmentation in S3A Vectored IO. (#4445) 2022-06-22 17:29:32 +01:00
site HADOOP-18104: S3A: Add configs to configure minSeekForVectorReads and maxReadSizeForVectorReads (#3964) 2022-06-22 17:29:32 +01:00
test HADOOP-18106: Handle memory fragmentation in S3A Vectored IO. (#4445) 2022-06-22 17:29:32 +01:00