hadoop

Go to file

HADOOP-17271. S3A connector to support IOStatistics. (#2580 )

S3A connector to support the IOStatistics API of HADOOP-16830,

This is a major rework of the S3A Statistics collection to

* Embrace the IOStatistics APIs
* Move from direct references of S3AInstrumention statistics
  collectors to interface/implementation classes in new packages.
* Ubiquitous support of IOStatistics, including:
  S3AFileSystem, input and output streams, RemoteIterator instances
  provided in list calls.
* Adoption of new statistic names from hadoop-common

Regarding statistic collection, as well as all existing
statistics, the connector now records min/max/mean durations
of HTTP GET and HEAD requests, and those of LIST operations.

Contributed by Steve Loughran.

Change-Id: I182d34b6ac39e017a8b4a221dad8e930882b39cf

2021-01-14 13:21:01 +00:00

.github

HADOOP-15184. Add GitHub pull request template. (#1419 )

2019-09-11 11:10:11 +09:00

dev-support

YARN-10560. Upgrade node.js to 10.23.1 and yarn to 1.22.5 in Web UI v2. (#2592 )

2021-01-06 12:14:09 +09:00

hadoop-assemblies

Preparing for 3.3.1 development

2020-04-30 13:33:42 +09:00

hadoop-build-tools

HADOOP-17100. Replace Guava Supplier with Java8+ Supplier in Hadoop. Contributed by Ahmed Hussein.

2020-07-22 18:21:14 +05:30

hadoop-client-modules

HADOOP-17371. Bump Jetty to the latest version 9.4.34. Contributed by Wei-Chiu Chuang. (#2453 )

2021-01-04 11:28:26 -08:00

hadoop-cloud-storage-project

HADOOP-16080. hadoop-aws does not work with hadoop-client-api. Contributed by Chao Sun (#2522 )

2020-12-12 09:37:13 -08:00

hadoop-common-project

HADOOP-17450. Add Public IOStatistics API. (#2577 )

2021-01-14 13:20:17 +00:00

hadoop-dist

Preparing for 3.3.1 development

2020-04-30 13:33:42 +09:00

hadoop-hdfs-project

HDFS-15672. TestBalancerWithMultipleNameNodes#testBalancingBlockpoolsWithBlockPoolPolicy fails on trunk. (#2475 )

2021-01-14 16:20:49 +09:00

hadoop-mapreduce-project

MAPREDUCE-7315. LocatedFileStatusFetcher to collect/publish IOStatistics. (#2579 )

2021-01-14 13:20:38 +00:00

hadoop-maven-plugins

HADOOP-17288. Use shaded guava from thirdparty. Contributed by Ayush Saxena. #2505

2020-12-10 05:50:55 +05:30

hadoop-minicluster

Preparing for 3.3.1 development

2020-04-30 13:33:42 +09:00

hadoop-project

HADOOP-17371. Bump Jetty to the latest version 9.4.34. Contributed by Wei-Chiu Chuang. (#2453 )

2021-01-04 11:28:26 -08:00

hadoop-project-dist

Make upstream aware of 3.2.2 release.

2021-01-09 18:07:10 +08:00

hadoop-tools

HADOOP-17271. S3A connector to support IOStatistics. (#2580 )

2021-01-14 13:21:01 +00:00

hadoop-yarn-project

YARN-10562. Follow up changes for YARN-9833. Contributed by Jim Brennan.

2021-01-13 23:43:15 +00:00

licenses

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

licenses-binary

HADOOP-15993. Upgrade Kafka to 2.4.0 in hadoop-kafka module. (#1796 )

2020-01-09 16:24:58 +09:00

.gitattributes

…

.gitignore

HADOOP-17055. Remove residual code of Ozone (#2039 )

2020-05-29 16:50:10 +09:00

BUILDING.txt

HADOOP-17125. Use snappy-java in SnappyCodec (#2297 )

2020-10-06 17:15:17 +01:00

Jenkinsfile

HADOOP-17438. Increase docker memory limit in Jenkins (#2560 )

2021-01-12 15:35:59 +09:00

LICENSE-binary

HADOOP-17343. Upgrade AWS SDK to 1.11.901 (#2468 )

2020-11-23 14:09:14 +00:00

LICENSE.txt

YARN-9561. Add C changes for the new RuncContainerRuntime. Contributed by Eric Badger

2019-12-09 01:25:10 +00:00

NOTICE-binary

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

NOTICE.txt

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

pom.xml

Preparing for 3.3.1 development

2020-04-30 13:33:42 +09:00

README.txt

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

start-build-env.sh

HADOOP-17298. Backslash in username causes build failure in the environment started by start-build-env.sh. (#2367 )

2020-10-20 10:11:18 +09:00

README.txt

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/

Languages

Java 92.9%

C++ 2.8%

C 1.8%

JavaScript 1.1%

Shell 0.5%

Other 0.6%