hadoop/hadoop-tools/hadoop-aws/src/main
Steve Loughran b795f6f9a8
HADOOP-18094. Disable S3A auditing by default.
See HADOOP-18091. S3A auditing leaks memory through ThreadLocal references

* Adds a new option fs.s3a.audit.enabled to controls whether or not auditing
is enabled. This is false by default.

* When false, the S3A auditing manager is NoopAuditManagerS3A,
which was formerly only used for unit tests and
during filsystem initialization.

* When true, ActiveAuditManagerS3A is used for managing auditing,
allowing auditing events to be reported.

* updates documentation and tests.

This patch does not fix the underlying leak. When auditing is enabled,
long-lived threads will retain references to the audit managers
of S3A filesystem instances which have already been closed.

Contributed by Steve Loughran.
2022-01-24 13:37:33 +00:00
..
java/org/apache/hadoop/fs HADOOP-18094. Disable S3A auditing by default. 2022-01-24 13:37:33 +00:00
resources/META-INF/services HDFS-13934. Multipart uploaders to be created through FileSystem/FileContext. 2020-07-13 13:30:02 +01:00
shellprofile.d HADOOP-17409. Remove s3guard from S3A module (#3534) 2022-01-17 18:08:57 +00:00