hadoop

Go to file

HADOOP-17271. S3A connector to support IOStatistics. (#2580 )

S3A connector to support the IOStatistics API of HADOOP-16830,

This is a major rework of the S3A Statistics collection to

* Embrace the IOStatistics APIs
* Move from direct references of S3AInstrumention statistics
  collectors to interface/implementation classes in new packages.
* Ubiquitous support of IOStatistics, including:
  S3AFileSystem, input and output streams, RemoteIterator instances
  provided in list calls.
* Adoption of new statistic names from hadoop-common

Regarding statistic collection, as well as all existing
statistics, the connector now records min/max/mean durations
of HTTP GET and HEAD requests, and those of LIST operations.

Contributed by Steve Loughran.

2020-12-31 21:55:39 +00:00

.github

HADOOP-15184. Add GitHub pull request template. (#1419 )

2019-09-11 11:10:11 +09:00

dev-support

HDFS-15743. Fix -Pdist build failure of hadoop-hdfs-native-client. (#2569 )

2020-12-22 07:19:44 +09:00

hadoop-assemblies

HDFS-15346. FedBalance tool implementation. Contributed by Jinglun.

2020-06-18 13:33:25 +08:00

hadoop-build-tools

HADOOP-17319. Update the checkstyle config to ban some guava functions. (#2400 )

2020-10-23 04:28:17 +09:00

hadoop-client-modules

HADOOP-17373. hadoop-client-integration-tests doesn't work when building with skipShade (#2458 )

2020-11-11 11:37:23 -06:00

hadoop-cloud-storage-project

HADOOP-17288. Use shaded guava from thirdparty. (#2342 ). Contributed by Ayush Saxena.

2020-10-17 12:01:18 +05:30

hadoop-common-project

HADOOP-17450. Add Public IOStatistics API. (#2577 )

2020-12-31 11:52:42 +00:00

hadoop-dist

Preparing for 3.4.0 development

2020-03-29 23:24:25 +05:30

hadoop-hdfs-project

HDFS-15749. Make size of editPendingQ can be configurable (#2572 )

2020-12-28 14:18:18 +08:00

hadoop-mapreduce-project

MAPREDUCE-7315. LocatedFileStatusFetcher to collect/publish IOStatistics. (#2579 )

2020-12-31 16:02:10 +00:00

hadoop-maven-plugins

HADOOP-17288. Use shaded guava from thirdparty. (#2342 ). Contributed by Ayush Saxena.

2020-10-17 12:01:18 +05:30

hadoop-minicluster

HDFS-15331. Remove invalid exclusions that minicluster dependency on HDFS (#1996 ). Contributed by Wanqiang Ji

2020-05-06 02:06:38 +05:30

hadoop-project

HADOOP-17445. Update the year to 2021. Contributed by He Xiaoqiao.

2020-12-24 20:44:12 +08:00

hadoop-project-dist

HADOOP-17394. [JDK 11] Fix error in mvn package -Pdocs (#2488 )

2020-11-26 11:32:10 +09:00

hadoop-tools

HADOOP-17271. S3A connector to support IOStatistics. (#2580 )

2020-12-31 21:55:39 +00:00

hadoop-yarn-project

YARN-10541. capture the performance metrics of ZKRMStateStore (#2568 )

2020-12-30 22:20:12 -08:00

licenses

HADOOP-17144. Update Hadoop's lz4 to v1.9.2. Contributed by Hemanth Boyina.

2020-10-18 18:37:46 +05:30

licenses-binary

HADOOP-15993. Upgrade Kafka to 2.4.0 in hadoop-kafka module. (#1796 )

2020-01-09 16:24:58 +09:00

.asf.yaml

HADOOP-17234. Add .asf.yaml to allow Github to Jira integration. (#2253 ). Contributed by Ayush Saxena.

2020-08-28 17:22:46 +05:30

.gitattributes

HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin.

2016-09-14 11:14:31 +09:00

.gitignore

YARN-10407. Add phantomjsdriver.log to gitignore. (#2244 )

2020-09-01 10:44:55 +09:00

BUILDING.txt

HADOOP-17125. Use snappy-java in SnappyCodec (#2297 )

2020-10-06 17:07:54 +01:00

Jenkinsfile

HADOOP-17297. Use Yetus before YETUS-994 to enable adding comments to GitHub (#2359 )

2020-10-05 19:16:37 +09:00

LICENSE-binary

HADOOP-17343. Upgrade AWS SDK to 1.11.901 (#2468 )

2020-11-23 14:08:12 +00:00

LICENSE.txt

HADOOP-17283. Hadoop - Upgrade to jQuery 3.5.1 (#2330 )

2020-09-24 21:15:55 +09:00

NOTICE-binary

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

NOTICE.txt

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

pom.xml

upate the hadoop.version property in the root pom.xml and hadoop.assemblies.version in hadoop-project/pom.xml (see HADOOP-15369)

2020-03-29 23:44:20 +05:30

README.txt

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

start-build-env.sh

HADOOP-17298. Backslash in username causes build failure in the environment started by start-build-env.sh. (#2367 )

2020-10-20 10:09:03 +09:00

README.txt

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/

Languages

Java 92.9%

C++ 2.8%

C 1.8%

JavaScript 1.1%

Shell 0.5%

Other 0.6%