hadoop/hadoop-tools/hadoop-aws
Steve Loughran 4fd0389153
HADOOP-18094. Disable S3A auditing by default.
See HADOOP-18091. S3A auditing leaks memory through ThreadLocal references

* Adds a new option fs.s3a.audit.enabled to controls whether or not auditing
is enabled. This is false by default.

* When false, the S3A auditing manager is NoopAuditManagerS3A,
which was formerly only used for unit tests and
during filsystem initialization.

* When true, ActiveAuditManagerS3A is used for managing auditing,
allowing auditing events to be reported.

* updates documentation and tests.

This patch does not fix the underlying leak. When auditing is enabled,
long-lived threads will retain references to the audit managers
of S3A filesystem instances which have already been closed.

Contributed by Steve Loughran.

Change-Id: I671e594cd59e8ca77a1f65be791ad0ae9530b8d9
2022-01-24 14:04:23 +00:00
..
dev-support HADOOP-17409. Remove s3guard from S3A module (#3534) 2022-01-18 18:04:48 +00:00
src HADOOP-18094. Disable S3A auditing by default. 2022-01-24 14:04:23 +00:00
pom.xml HADOOP-17409. Remove s3guard from S3A module (#3534) 2022-01-18 18:04:48 +00:00