hadoop

History

Mukund Thakur 5c348c41ab HADOOP-11867. Add a high-performance vectored read API. (#3904 ) part of HADOOP-18103. Add support for multiple ranged vectored read api in PositionedReadable. The default iterates through the ranges to read each synchronously, but the intent is that FSDataInputStream subclasses can make more efficient readers especially in object stores implementation. Also added implementation in S3A where smaller ranges are merged and sliced byte buffers are returned to the readers. All the merged ranged are fetched from S3 asynchronously. Contributed By: Owen O'Malley and Mukund Thakur Conflicts: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java pom.xml	2022-06-23 17:09:16 -05:00
..
src/site	HADOOP-17409. Remove s3guard from S3A module (#3534 )	2022-01-18 18:04:48 +00:00
pom.xml	HADOOP-11867. Add a high-performance vectored read API. (#3904 )	2022-06-23 17:09:16 -05:00

Mukund Thakur 5c348c41ab HADOOP-11867. Add a high-performance vectored read API. (#3904 )

part of HADOOP-18103.
Add support for multiple ranged vectored read api in PositionedReadable.
The default iterates through the ranges to read each synchronously,
but the intent is that FSDataInputStream subclasses can make more
efficient readers especially in object stores implementation.

Also added implementation in S3A where smaller ranges are merged and
sliced byte buffers are returned to the readers. All the merged ranged are
fetched from S3 asynchronously.

Contributed By: Owen O'Malley and Mukund Thakur

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java
	pom.xml

2022-06-23 17:09:16 -05:00

src/site

HADOOP-17409. Remove s3guard from S3A module (#3534 )

2022-01-18 18:04:48 +00:00

pom.xml

HADOOP-11867. Add a high-performance vectored read API. (#3904 )

2022-06-23 17:09:16 -05:00