big-data/hadoop
big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Projects Wiki Activity
26,917 Commits 2 Branches 2 Tags
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Anmol Asrani 666af58700
HADOOP-18876. ABFS: Change default for fs.azure.data.blocks.buffer to bytebuffer (#6009) 
The default value for fs.azure.data.blocks.buffer is changed from "disk" to "bytebuffer"

This will speed up writing to azure storage, at the risk of running out of memory
-especially if there are many threads writing to abfs at the same time and the
upload bandwidth is limited.

If jobs do run out of memory writing to abfs, change the option back to "disk"

Contributed by Anmol Asrani
2023-10-09 16:51:12 +01:00
.github
HADOOP-18823. Add Labeler Github Action. (#5874). Contributed by Ayush Saxena.
2023-07-25 03:04:49 +05:30
.yetus
Add .yetus/excludes.txt (#4984)
2022-10-11 09:23:34 -07:00
dev-support
HADOOP-18789. Remove ozone from hadoop dev support. (#5800). Contributed by Xiaoqiao He.
2023-07-02 15:23:32 +08:00
hadoop-assemblies
HDFS-15346. FedBalance tool implementation. Contributed by Jinglun.
2020-06-18 13:33:25 +08:00
hadoop-build-tools
HADOOP-17968 Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports (#3584)
2021-10-28 15:57:15 +09:00
hadoop-client-modules
HADOOP-18890. Remove use of okhttp in runtime code (#6057)
2023-09-19 12:38:36 +01:00
hadoop-cloud-storage-project
HADOOP-18890. Remove use of okhttp in runtime code (#6057)
2023-09-19 12:38:36 +01:00
hadoop-common-project
HDFS-17200. Add some datanode related metrics to Metrics.md. (#6099). Contributed by huangzhaobo99
2023-10-06 12:40:44 +05:30
hadoop-dist
HADOOP-18718. Fix several maven build warnings (#5592). Contributed by Dongjoon Hyun.
2023-06-11 11:38:13 +05:30
hadoop-hdfs-project
HDFS-17171. CONGESTION_RATIO should be configurable (#5996)
2023-10-08 10:36:09 +08:00
hadoop-mapreduce-project
MAPREDUCE-7453. Revert HADOOP-18649. (#6102). Contributed by zhengchenyu.
2023-10-01 17:25:32 +05:30
hadoop-maven-plugins
HADOOP-18441. Remove hadoop custom ServicesResourceTransformer (#4850). Contributed by PJ Fanning.
2022-09-07 17:11:12 +05:30
hadoop-minicluster
HADOOP-18131. Upgrade maven enforcer plugin and relevant dependencies (#4000)
2022-03-08 17:27:04 +09:00
hadoop-project
HADOOP-18917. Upgrade to commons-io 2.14.0 (#6133). Contributed by PJ Fanning
2023-10-06 01:58:21 +05:30
hadoop-project-dist
HADOOP-18751. Fix incorrect output path in javadoc build phase (#5688)
2023-06-26 15:52:17 -07:00
hadoop-tools
HADOOP-18876. ABFS: Change default for fs.azure.data.blocks.buffer to bytebuffer (#6009)
2023-10-09 16:51:12 +01:00
hadoop-yarn-project
YARN-11583. Improve Node Link for YARN Federation Web Page. (#6145) Contributed by Shilun Fan.
2023-10-08 08:20:11 +08:00
licenses
HADOOP-17144. Update Hadoop's lz4 to v1.9.2. Contributed by Hemanth Boyina.
2020-10-18 18:37:46 +05:30
licenses-binary
HADOOP-15993. Upgrade Kafka to 2.4.0 in hadoop-kafka module. (#1796)
2020-01-09 16:24:58 +09:00
.asf.yaml
HADOOP-18630. Add gh-pages in asf.yaml to deploy the current trunk doc (#5393). Contributed by Simhadri Govindappa.
2023-02-14 18:13:29 +05:30
.gitattributes
…
.gitignore
HADOOP-18774. Add .vscode to gitignore. (#5756). Contributed by Xiaoqiao He.
2023-06-18 14:08:38 +08:00
BUILDING.txt
HADOOP-18506. Update build instructions for Windows using VS2019 (#5066)
2022-10-24 09:28:29 -07:00
LICENSE-binary
HADOOP-18917. Upgrade to commons-io 2.14.0 (#6133). Contributed by PJ Fanning
2023-10-06 01:58:21 +05:30
LICENSE.txt
YARN-11356. Upgrade DataTables to 1.11.5 to fix CVEs. Contributed by Bence Kosztolnik.
2022-10-26 22:29:01 +02:00
NOTICE-binary
HADOOP-18890. Remove use of okhttp in runtime code (#6057)
2023-09-19 12:38:36 +01:00
NOTICE.txt
HADOOP-15958. Revisiting LICENSE and NOTICE files.
2019-08-27 13:47:12 +09:00
pom.xml
HADOOP-18923. Switch to SPDX identifier for license name (#6149). Contributed by Colm O hEigeartaigh.
2023-10-07 22:50:38 +05:30
README.txt
HADOOP-15958. Revisiting LICENSE and NOTICE files.
2019-08-27 13:47:12 +09:00
start-build-env.sh
HADOOP-18052. Support Apple Silicon in start-build-env.sh (#3817)
2021-12-23 18:13:18 +09:00

README.txt 

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/
Description
No description provided
big-datahadoopjava
Readme 264 MiB
Languages
Java 92.9%
C++ 2.8%
C 1.8%
JavaScript 1.1%
Shell 0.5%
Other 0.6%