hadoop

Go to file

Steve Loughran 2d124f2f5e HADOOP-17483. Magic committer is enabled by default. (#2656 )

* core-default.xml updated so that fs.s3a.committer.magic.enabled = true
* CommitConstants updated to match
* All tests which previously enabled the magic committer now rely on
  default settings. This helps make sure it is enabled.
* Docs cover the switch, mention its enabled and explain why you may
  want to disable it.
Note: this doesn't switch to using the committer -it just enables the path
rewriting magic which it depends on.

Contributed by Steve Loughran.

2021-01-27 19:05:07 +00:00

.github

HADOOP-15184. Add GitHub pull request template. (#1419 )

2019-09-11 11:10:11 +09:00

dev-support

YARN-10560. Upgrade node.js to 10.23.1 and yarn to 1.22.5 in Web UI v2. (#2592 )

2021-01-06 12:14:09 +09:00

hadoop-assemblies

Preparing for 3.3.1 development

2020-04-30 13:33:42 +09:00

hadoop-build-tools

HADOOP-17100. Replace Guava Supplier with Java8+ Supplier in Hadoop. Contributed by Ahmed Hussein.

2020-07-22 18:21:14 +05:30

hadoop-client-modules

HADOOP-17371. Bump Jetty to the latest version 9.4.34. Contributed by Wei-Chiu Chuang. (#2453 )

2021-01-04 11:28:26 -08:00

hadoop-cloud-storage-project

HADOOP-16080. hadoop-aws does not work with hadoop-client-api. Contributed by Chao Sun (#2522 )

2020-12-12 09:37:13 -08:00

hadoop-common-project

HADOOP-17483. Magic committer is enabled by default. (#2656 )

2021-01-27 19:05:07 +00:00

hadoop-dist

Preparing for 3.3.1 development

2020-04-30 13:33:42 +09:00

hadoop-hdfs-project

HDFS-15783. Speed up BlockPlacementPolicyRackFaultTolerant#verifyBlockPlacement (#2626 )

2021-01-21 10:09:17 +09:00

hadoop-mapreduce-project

MAPREDUCE-7315. LocatedFileStatusFetcher to collect/publish IOStatistics. (#2579 )

2021-01-14 13:20:38 +00:00

hadoop-maven-plugins

HADOOP-17288. Use shaded guava from thirdparty. Contributed by Ayush Saxena. #2505

2020-12-10 05:50:55 +05:30

hadoop-minicluster

Preparing for 3.3.1 development

2020-04-30 13:33:42 +09:00

hadoop-project

HDFS-15731. Reduce threadCount for unit tests to reduce the memory usage (#2556 )

2021-01-24 22:52:51 +09:00

hadoop-project-dist

Make upstream aware of 3.2.2 release.

2021-01-09 18:07:10 +08:00

hadoop-tools

HADOOP-17483. Magic committer is enabled by default. (#2656 )

2021-01-27 19:05:07 +00:00

hadoop-yarn-project

YARN-10519. Refactor QueueMetricsForCustomResources class to move to yarn-common package. Contributed by Minni Mittal

2021-01-22 08:30:12 +05:30

licenses

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

licenses-binary

HADOOP-15993. Upgrade Kafka to 2.4.0 in hadoop-kafka module. (#1796 )

2020-01-09 16:24:58 +09:00

.gitattributes

…

.gitignore

HADOOP-17055. Remove residual code of Ozone (#2039 )

2020-05-29 16:50:10 +09:00

BUILDING.txt

HADOOP-17125. Use snappy-java in SnappyCodec (#2297 )

2020-10-06 17:15:17 +01:00

Jenkinsfile

HADOOP-17438. Increase docker memory limit in Jenkins (#2560 )

2021-01-12 15:35:59 +09:00

LICENSE-binary

HADOOP-17343. Upgrade AWS SDK to 1.11.901 (#2468 )

2020-11-23 14:09:14 +00:00

LICENSE.txt

YARN-9561. Add C changes for the new RuncContainerRuntime. Contributed by Eric Badger

2019-12-09 01:25:10 +00:00

NOTICE-binary

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

NOTICE.txt

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

pom.xml

Preparing for 3.3.1 development

2020-04-30 13:33:42 +09:00

README.txt

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

start-build-env.sh

HADOOP-17298. Backslash in username causes build failure in the environment started by start-build-env.sh. (#2367 )

2020-10-20 10:11:18 +09:00

README.txt

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/

Languages

Java 92.9%

C++ 2.8%

C 1.8%

JavaScript 1.1%

Shell 0.5%

Other 0.6%