hadoop

Go to file

HADOOP-13873. log DNS addresses on s3a initialization.

Contributed by Mukund Thakur.

If you set the log org.apache.hadoop.fs.s3a.impl.NetworkBinding
to DEBUG, then when the S3A bucket probe is made -the DNS address
of the S3 endpoint is calculated and printed.

This is useful to see if a large set of processes are all using
the same IP address from the pool of load balancers to which AWS
directs clients when an AWS S3 endpoint is resolved.

This can have implications for performance: if all clients
access the same load balancer performance may be suboptimal.

Note: if bucket probes are disabled, fs.s3a.bucket.probe = 0,
the DNS logging does not take place.

Change-Id: I21b3ac429dc0b543f03e357fdeb94c2d2a328dd8

2020-04-17 14:20:54 +01:00

.github

HADOOP-15184. Add GitHub pull request template. (#1419 )

2019-09-11 11:10:11 +09:00

dev-support

HADOOP-16985. Handle release package related issues (#1957 )

2020-04-15 23:09:41 +05:30

hadoop-assemblies

HADOOP-16985. Handle release package related issues (#1957 )

2020-04-15 23:09:41 +05:30

hadoop-build-tools

HADOOP-16771. Update checkstyle to 8.26 and maven-checkstyle-plugin to 3.1.0. Contributed by Andras Bokor.

2019-12-20 13:10:26 +09:00

hadoop-client-modules

HADOOP-16905. Update jackson-databind to 2.10.3 to relieve us from the endless CVE patches. (#1876 )

2020-03-07 12:18:01 +09:00

hadoop-cloud-storage-project

HADOOP-16702. Move documentation of hadoop-cos to under src directory.

2019-11-12 17:47:17 +09:00

hadoop-common-project

HADOOP-16647. Support OpenSSL 1.1.1 LTS. Contributed by Rakesh Radhakrishnan.

2020-04-04 08:16:46 +09:00

hadoop-dist

HDFS-14639. [Dynamometer] Remove unnecessary duplicate directory from the distribution. Contributed by Erik Krogen.

2019-07-29 13:50:14 -07:00

hadoop-hdfs-project

HDFS-15283. Cache pool MAXTTL is not persisted and restored on cluster restart. Contributed by Stephen O'Donnell.

2020-04-16 20:19:00 -07:00

hadoop-mapreduce-project

MAPREDUCE-7272. TaskAttemptListenerImpl excessive log messages. Contributed by Ahmed Hussein (ahussein)

2020-04-13 18:51:00 +00:00

hadoop-maven-plugins

HADOOP-16331. Fix ASF License check in pom.xml

2019-05-29 17:25:13 +09:00

hadoop-minicluster

HADOOP-16331. Fix ASF License check in pom.xml

2019-05-29 17:25:13 +09:00

hadoop-project

HADOOP-16982. Update Netty to 4.1.48.Final. Contributed by Lisheng Sun.

2020-04-15 07:22:54 +09:00

hadoop-project-dist

Make upstream aware of 3.2.1 release.

2019-09-23 06:20:54 +00:00

hadoop-tools

HADOOP-13873. log DNS addresses on s3a initialization.

2020-04-17 14:20:54 +01:00

hadoop-yarn-project

YARN-5277. When localizers fail due to resource timestamps being out, provide more diagnostics. Contributed by Siddharth Ahuja

2020-04-15 07:54:53 +02:00

licenses

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

licenses-binary

HADOOP-15993. Upgrade Kafka to 2.4.0 in hadoop-kafka module. (#1796 )

2020-01-09 16:24:58 +09:00

.gitattributes

HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin.

2016-09-14 11:14:31 +09:00

.gitignore

HDDS-1115. Provide ozone specific top-level pom.xml.

2019-02-24 14:40:52 -08:00

BUILDING.txt

HADOOP-16856. cmake is missing in the CentOS 8 section of BUILDING.txt. (#1841 )

2020-02-12 21:17:33 +09:00

Jenkinsfile

HADOOP-16110 Upgrade to yetus 0.11.1 and use emoji vote on github pre commit (#1527 ). Contributed by Duo Zhang.

2019-11-19 14:21:49 +05:30

LICENSE-binary

YARN-10074. Update netty to 4.1.42Final in yarn-csi. Contributed by Wei-Chiu Chuang. (#1807 )

2020-02-25 13:47:52 +09:00

LICENSE.txt

YARN-9561. Add C changes for the new RuncContainerRuntime. Contributed by Eric Badger

2019-12-09 01:25:10 +00:00

NOTICE-binary

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

NOTICE.txt

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

pom.xml

Bump checkstyle from 8.26 to 8.29 (#1828 )

2020-02-07 19:32:10 +09:00

README.txt

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

start-build-env.sh

HADOOP-16849. start-build-env.sh behaves incorrectly when username is numeric only. Contributed by Jihyun Cho.

2020-02-12 14:06:23 +09:00

README.txt

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/

Languages

Java 92.9%

C++ 2.8%

C 1.8%

JavaScript 1.1%

Shell 0.5%

Other 0.6%