hadoop/hadoop-tools
Steve Loughran fb71e6c91e
HADOOP-17597. Optionally downgrade on S3A Syncable calls (#2801)
Followup to HADOOP-13327, which changed S3A output stream hsync/hflush calls
to raise an exception.

Adds a new option fs.s3a.downgrade.syncable.exceptions

When true, calls to Syncable hsync/hflush on S3A output streams will
log once at warn (for entire process life, not just the stream), then
increment IOStats with the relevant operation counter

With the downgrade option false (default)
* IOStats are incremented
* The UnsupportedOperationException current raised includes a link to the
  JIRA.

Contributed by Steve Loughran.

Change-Id: I967e077eda1d1a1a3795b4d22e003fe7997b6679
2021-04-24 18:32:39 +01:00
..
hadoop-aliyun HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753) 2021-03-11 14:57:03 +09:00
hadoop-archive-logs HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753) 2021-03-11 14:57:03 +09:00
hadoop-archives HADOOP-17288. Use shaded guava from thirdparty. Contributed by Ayush Saxena. #2505 2020-12-10 05:50:55 +05:30
hadoop-aws HADOOP-17597. Optionally downgrade on S3A Syncable calls (#2801) 2021-04-24 18:32:39 +01:00
hadoop-azure HADOOP-17471. ABFS to collect IOStatistics (#2731) (#2950) 2021-04-24 17:59:26 +01:00
hadoop-azure-datalake HADOOP-13327 Output Stream Specification. (#2587) 2021-02-10 10:31:22 +00:00
hadoop-datajoin HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753) 2021-03-11 14:57:03 +09:00
hadoop-distcp HADOOP-17620. DistCp: Use Iterator for listing target directory as well. (#2861). Contributed by Ayush Saxena. 2021-04-23 22:49:28 +05:30
hadoop-dynamometer HADOOP-17288. Use shaded guava from thirdparty. Contributed by Ayush Saxena. #2505 2020-12-10 05:50:55 +05:30
hadoop-extras Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
hadoop-fs2img HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753) 2021-03-11 14:57:03 +09:00
hadoop-gridmix HADOOP-17622. Avoid usage of deprecated IOUtils#cleanup API. (#2862) 2021-04-06 14:18:31 +09:00
hadoop-kafka HADOOP-17532. Yarn Job execution get failed when LZ4 Compression Codec is used. Contributed Bhavik Patel. 2021-03-14 21:20:44 -07:00
hadoop-openstack HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753) 2021-03-11 14:57:03 +09:00
hadoop-pipes Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
hadoop-resourceestimator Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
hadoop-rumen HADOOP-17622. Avoid usage of deprecated IOUtils#cleanup API. (#2862) 2021-04-06 14:18:31 +09:00
hadoop-sls HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753) 2021-03-11 14:57:03 +09:00
hadoop-streaming HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753) 2021-03-11 14:57:03 +09:00
hadoop-tools-dist Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
pom.xml Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00