Go to file
Steve Loughran 240b25310e
HADOOP-17271. S3A connector to support IOStatistics. (#2580)
S3A connector to support the IOStatistics API of HADOOP-16830,

This is a major rework of the S3A Statistics collection to

* Embrace the IOStatistics APIs
* Move from direct references of S3AInstrumention statistics
  collectors to interface/implementation classes in new packages.
* Ubiquitous support of IOStatistics, including:
  S3AFileSystem, input and output streams, RemoteIterator instances
  provided in list calls.
* Adoption of new statistic names from hadoop-common

Regarding statistic collection, as well as all existing
statistics, the connector now records min/max/mean durations
of HTTP GET and HEAD requests, and those of LIST operations.

Contributed by Steve Loughran.

Change-Id: I182d34b6ac39e017a8b4a221dad8e930882b39cf
2021-01-14 13:21:01 +00:00
.github HADOOP-15184. Add GitHub pull request template. (#1419) 2019-09-11 11:10:11 +09:00
dev-support YARN-10560. Upgrade node.js to 10.23.1 and yarn to 1.22.5 in Web UI v2. (#2592) 2021-01-06 12:14:09 +09:00
hadoop-assemblies Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
hadoop-build-tools HADOOP-17100. Replace Guava Supplier with Java8+ Supplier in Hadoop. Contributed by Ahmed Hussein. 2020-07-22 18:21:14 +05:30
hadoop-client-modules HADOOP-17371. Bump Jetty to the latest version 9.4.34. Contributed by Wei-Chiu Chuang. (#2453) 2021-01-04 11:28:26 -08:00
hadoop-cloud-storage-project HADOOP-16080. hadoop-aws does not work with hadoop-client-api. Contributed by Chao Sun (#2522) 2020-12-12 09:37:13 -08:00
hadoop-common-project HADOOP-17450. Add Public IOStatistics API. (#2577) 2021-01-14 13:20:17 +00:00
hadoop-dist Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
hadoop-hdfs-project HDFS-15672. TestBalancerWithMultipleNameNodes#testBalancingBlockpoolsWithBlockPoolPolicy fails on trunk. (#2475) 2021-01-14 16:20:49 +09:00
hadoop-mapreduce-project MAPREDUCE-7315. LocatedFileStatusFetcher to collect/publish IOStatistics. (#2579) 2021-01-14 13:20:38 +00:00
hadoop-maven-plugins HADOOP-17288. Use shaded guava from thirdparty. Contributed by Ayush Saxena. #2505 2020-12-10 05:50:55 +05:30
hadoop-minicluster Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
hadoop-project HADOOP-17371. Bump Jetty to the latest version 9.4.34. Contributed by Wei-Chiu Chuang. (#2453) 2021-01-04 11:28:26 -08:00
hadoop-project-dist Make upstream aware of 3.2.2 release. 2021-01-09 18:07:10 +08:00
hadoop-tools HADOOP-17271. S3A connector to support IOStatistics. (#2580) 2021-01-14 13:21:01 +00:00
hadoop-yarn-project YARN-10562. Follow up changes for YARN-9833. Contributed by Jim Brennan. 2021-01-13 23:43:15 +00:00
licenses HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
licenses-binary HADOOP-15993. Upgrade Kafka to 2.4.0 in hadoop-kafka module. (#1796) 2020-01-09 16:24:58 +09:00
.gitattributes HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin. 2016-09-14 11:14:31 +09:00
.gitignore HADOOP-17055. Remove residual code of Ozone (#2039) 2020-05-29 16:50:10 +09:00
BUILDING.txt HADOOP-17125. Use snappy-java in SnappyCodec (#2297) 2020-10-06 17:15:17 +01:00
Jenkinsfile HADOOP-17438. Increase docker memory limit in Jenkins (#2560) 2021-01-12 15:35:59 +09:00
LICENSE-binary HADOOP-17343. Upgrade AWS SDK to 1.11.901 (#2468) 2020-11-23 14:09:14 +00:00
LICENSE.txt YARN-9561. Add C changes for the new RuncContainerRuntime. Contributed by Eric Badger 2019-12-09 01:25:10 +00:00
NOTICE-binary HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
NOTICE.txt HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
pom.xml Preparing for 3.3.1 development 2020-04-30 13:33:42 +09:00
README.txt HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
start-build-env.sh HADOOP-17298. Backslash in username causes build failure in the environment started by start-build-env.sh. (#2367) 2020-10-20 10:11:18 +09:00

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/