hadoop/hadoop-tools/hadoop-aws
Alessandro Passaro 0f1a3f23a5
HADOOP-18378. Implement lazy seek in S3A prefetching. (#4955)
Make S3APrefetchingInputStream.seek() completely lazy. Calls to seek() will not affect the current buffer nor interfere with prefetching, until read() is called.

This change allows various usage patterns to benefit from prefetching, e.g. when calling readFully(position, buffer) in a loop for contiguous positions the intermediate internal calls to seek() will be noops and prefetching will have the same performance as in a sequential read.

Contributed by Alessandro Passaro.
2023-04-28 12:03:30 +01:00
..
dev-support HADOOP-18466. Limit the findbugs suppression IS2_INCONSISTENT_SYNC to S3AFileSystem field (#4926) 2023-04-28 12:03:30 +01:00
src HADOOP-18378. Implement lazy seek in S3A prefetching. (#4955) 2023-04-28 12:03:30 +01:00
pom.xml HADOOP-18377. hadoop-aws build to add a -prefetch profile to run all tests with prefetching (#4914) 2023-04-28 12:03:30 +01:00