hadoop/hadoop-tools
Steve Loughran 4fd0389153
HADOOP-18094. Disable S3A auditing by default.
See HADOOP-18091. S3A auditing leaks memory through ThreadLocal references

* Adds a new option fs.s3a.audit.enabled to controls whether or not auditing
is enabled. This is false by default.

* When false, the S3A auditing manager is NoopAuditManagerS3A,
which was formerly only used for unit tests and
during filsystem initialization.

* When true, ActiveAuditManagerS3A is used for managing auditing,
allowing auditing events to be reported.

* updates documentation and tests.

This patch does not fix the underlying leak. When auditing is enabled,
long-lived threads will retain references to the audit managers
of S3A filesystem instances which have already been closed.

Contributed by Steve Loughran.

Change-Id: I671e594cd59e8ca77a1f65be791ad0ae9530b8d9
2022-01-24 14:04:23 +00:00
..
hadoop-aliyun Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-archive-logs Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-archives Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-aws HADOOP-18094. Disable S3A auditing by default. 2022-01-24 14:04:23 +00:00
hadoop-azure HADOOP-18084. ABFS: Add testfilePath while verifying test contents are read correctly (#3903) 2022-01-19 10:18:05 +00:00
hadoop-azure-datalake Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-datajoin Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-distcp HADOOP-18056. DistCp: Filter duplicates in the source paths. (#3825). Contributed by Ayush Saxena. 2022-01-05 23:53:55 +05:30
hadoop-dynamometer HADOOP-18045. Disable TestDynamometerInfra (#3829) 2021-12-28 13:23:05 +09:00
hadoop-extras Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-fs2img Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-gridmix Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-kafka Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-openstack Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-pipes Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-resourceestimator Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-rumen Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-sls Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-streaming Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-tools-dist Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
pom.xml Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00