hadoop/hadoop-tools/hadoop-azure
Pranav Saxena c67c2b7569
HADOOP-18546. ABFS. disable purging list of in progress reads in abfs stream close() (#5176)
This addresses HADOOP-18521, "ABFS ReadBufferManager buffer sharing
across concurrent HTTP requests" by not trying to cancel
in progress reads.

It supercedes HADOOP-18528, which disables the prefetching.
If that patch is applied *after* this one, prefetching
will be disabled.

As well as changing the default value in the code,
core-default.xml is updated to set
fs.azure.enable.readahead = true

As a result, if Configuration.get("fs.azure.enable.readahead")
returns a non-null value, then it can be inferred that
it was set in or core-default.xml (the fix is present)
or in core-site.xml (someone asked for it).

Contributed by Pranav Saxena.
2022-12-07 20:15:45 +00:00
..
dev-support HADOOP-17767. ABFS: Update test scripts (#3124) 2022-10-20 18:07:04 +01:00
src HADOOP-18546. ABFS. disable purging list of in progress reads in abfs stream close() (#5176) 2022-12-07 20:15:45 +00:00
.gitignore HADOOP-17767. ABFS: Update test scripts (#3124) 2022-10-20 18:07:04 +01:00
pom.xml HADOOP-17873. ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException (#3699) 2022-09-06 11:00:52 +01:00