hadoop/hadoop-tools
Pranav Saxena 419a4d7969
HADOOP-18546. ABFS. disable purging list of in progress reads in abfs stream close() (#5176)
This addresses HADOOP-18521, "ABFS ReadBufferManager buffer sharing
across concurrent HTTP requests" by not trying to cancel
in progress reads.

It supercedes HADOOP-18528, which disables the prefetching.
If that patch is applied *after* this one, prefetching
will be disabled.

As well as changing the default value in the code,
core-default.xml is updated to set
fs.azure.enable.readahead = true

As a result, if Configuration.get("fs.azure.enable.readahead")
returns a non-null value, then it can be inferred that
it was set in or core-default.xml (the fix is present)
or in core-site.xml (someone asked for it).

Note: this commit contains the followup commit:
  HADOOP-18546. Followup: ITestReadBufferManager fix (#5198)
That is needed to avoid race conditions in the test.

Contributed by Pranav Saxena.
2022-12-09 13:52:36 +00:00
..
hadoop-aliyun HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-archive-logs HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-archives HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-aws HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-azure HADOOP-18546. ABFS. disable purging list of in progress reads in abfs stream close() (#5176) 2022-12-09 13:52:36 +00:00
hadoop-azure-datalake HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-benchmark HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-datajoin HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-distcp HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-dynamometer HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-extras HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-fs2img HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-gridmix HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-kafka HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-openstack HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-pipes HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-resourceestimator HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-rumen HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-sls HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-streaming HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
hadoop-tools-dist HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00
pom.xml HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00