hadoop

Go to file

HADOOP-17771. S3AFS creation fails "Unable to find a region via the region provider chain." (#3133 )

This addresses the regression in Hadoop 3.3.1 where if no S3 endpoint
is set in fs.s3a.endpoint, S3A filesystem creation may fail on
non-EC2 deployments, depending on the local host environment setup.

* If fs.s3a.endpoint is empty/null, and fs.s3a.endpoint.region
  is null, the region is set to "us-east-1".
* If fs.s3a.endpoint.region is explicitly set to "" then the client
  falls back to the SDK region resolution chain; this works on EC2
* Details in troubleshooting.md, including a workaround for Hadoop-3.3.1+
* Also contains some minor restructuring of troubleshooting.md

Contributed by Steve Loughran.

2021-06-24 16:37:27 +01:00

.github

HADOOP-15184. Add GitHub pull request template. (#1419 )

2019-09-11 11:10:11 +09:00

dev-support

HADOOP-17766. CI for Debian 10 (#3129 )

2021-06-23 10:02:33 -07:00

hadoop-assemblies

HDFS-15346. FedBalance tool implementation. Contributed by Jinglun.

2020-06-18 13:33:25 +08:00

hadoop-build-tools

HADOOP-17109. add guava BaseEncoding to illegalClasses (#2703 )

2021-02-17 10:15:41 +09:00

hadoop-client-modules

HADOOP-16822. Provide source artifacts for hadoop-client-api. Contributed by Karel Kolman.

2021-05-13 20:30:00 +08:00

hadoop-cloud-storage-project

HADOOP-17753. Keep restrict-imports-enforcer-rule for Guava Lists in top level hadoop-main pom (#3087 )

2021-06-11 12:15:52 +09:00

hadoop-common-project

HDFS-16075. Use empty array constants present in StorageType and DatanodeInfo to avoid creating redundant objects (#3115 )

2021-06-21 10:25:12 +09:00

hadoop-dist

Preparing for 3.4.0 development

2020-03-29 23:24:25 +05:30

hadoop-hdfs-project

HDFS-16085. Move the getPermissionChecker out of the read lock (#3134 ). Contributed by tomscut.

2021-06-24 15:59:42 +05:30

hadoop-mapreduce-project

MAPREDUCE-7354. Use empty array constant present in TaskCompletionEvent to avoid creating redundant objects (#3123 )

2021-06-21 16:46:06 +09:00

hadoop-maven-plugins

HADOOP-17753. Keep restrict-imports-enforcer-rule for Guava Lists in top level hadoop-main pom (#3087 )

2021-06-11 12:15:52 +09:00

hadoop-minicluster

HDFS-15331. Remove invalid exclusions that minicluster dependency on HDFS (#1996 ). Contributed by Wanqiang Ji

2020-05-06 02:06:38 +05:30

hadoop-project

HADOOP-17769. Upgrade JUnit to 4.13.2. fixes TestBlockRecovery (#3130 ). Contributed by Ahmed Hussein.

2021-06-24 17:57:52 +05:30

hadoop-project-dist

Make upstream aware of 3.3.1 release

2021-06-15 15:43:36 +00:00

hadoop-tools

HADOOP-17771. S3AFS creation fails "Unable to find a region via the region provider chain." (#3133 )

2021-06-24 16:37:27 +01:00

hadoop-yarn-project

YARN-10826. [UI2] Upgrade Node.js to v12.22.1. (#3128 )

2021-06-23 19:33:03 +09:00

licenses

HADOOP-17144. Update Hadoop's lz4 to v1.9.2. Contributed by Hemanth Boyina.

2020-10-18 18:37:46 +05:30

licenses-binary

HADOOP-15993. Upgrade Kafka to 2.4.0 in hadoop-kafka module. (#1796 )

2020-01-09 16:24:58 +09:00

.asf.yaml

HADOOP-17234. Add .asf.yaml to allow Github to Jira integration. (#2253 ). Contributed by Ayush Saxena.

2020-08-28 17:22:46 +05:30

.gitattributes

HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin.

2016-09-14 11:14:31 +09:00

.gitignore

YARN-10407. Add phantomjsdriver.log to gitignore. (#2244 )

2020-09-01 10:44:55 +09:00

BUILDING.txt

HADOOP-17635. Update the ubuntu version in the build instruction. (#2931 )

2021-04-19 16:44:16 +09:00

LICENSE-binary

HADOOP-17769. Upgrade JUnit to 4.13.2. fixes TestBlockRecovery (#3130 ). Contributed by Ahmed Hussein.

2021-06-24 17:57:52 +05:30

LICENSE.txt

HADOOP-17283. Hadoop - Upgrade to jQuery 3.5.1 (#2330 )

2020-09-24 21:15:55 +09:00

NOTICE-binary

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

NOTICE.txt

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

pom.xml

HADOOP-17753. Keep restrict-imports-enforcer-rule for Guava Lists in top level hadoop-main pom (#3087 )

2021-06-11 12:15:52 +09:00

README.txt

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

start-build-env.sh

HADOOP-17298. Backslash in username causes build failure in the environment started by start-build-env.sh. (#2367 )

2020-10-20 10:09:03 +09:00

README.txt

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/

Languages

Java 92.9%

C++ 2.8%

C 1.8%

JavaScript 1.1%

Shell 0.5%

Other 0.6%