2024-06-02 06:28:41 +00:00
|
|
|
|
|
2024-07-28 14:30:59 +00:00
|
|
|
|
# 简介
|
|
|
|
|
本仓库用于记录学习Hadoop相关笔记,菜就多做笔记。
|
|
|
|
|
|
|
|
|
|
# 编译
|
2024-06-02 06:28:41 +00:00
|
|
|
|
|
|
|
|
|
执行下面编译命令:
|
|
|
|
|
```bash
|
2024-07-28 14:30:59 +00:00
|
|
|
|
# -T 是编译的线程数,可以按照具体操作系统增加或者减少
|
|
|
|
|
mvn -T 8 package -Pdist,native -DskipTests -Dmaven.javadoc.skip=true
|
2024-06-02 06:28:41 +00:00
|
|
|
|
```
|
|
|
|
|
|
2024-07-28 14:30:59 +00:00
|
|
|
|
# 知识树
|
|
|
|
|
|
2023-10-22 05:13:53 +00:00
|
|
|
|
## HDFS
|
2024-07-28 14:30:59 +00:00
|
|
|
|
- [HDFS概览](./hdfs/README.md)
|
|
|
|
|
- NameNode相关
|
|
|
|
|
- [namenode全景](./hdfs/namenode全景.md)
|
|
|
|
|
- [NameNode启动过程](./hdfs/nameNode启动过程.md)
|
|
|
|
|
- [FsIMage](./hdfs/fsImages.md)
|
|
|
|
|
- [NamenodeProtocols详解](./hdfs/NamenodeProtocols详解.md)
|
|
|
|
|
- [leaseManager详解](./hdfs/leaseManager详解.md)
|
|
|
|
|
- [FSDirectory详解](./hdfs/FSDirectory详解.md)
|
|
|
|
|
- [文件上传](./hdfs/file_upload.md)
|
|
|
|
|
- DataNode相关
|
|
|
|
|
- [dataNode启动过程](./hdfs/dataNode启动过程.md)
|
|
|
|
|
- [BPServiceActor详解](./hdfs/BPServiceActor详解.md)
|
|
|
|
|
|
2023-10-15 04:25:58 +00:00
|
|
|
|
|
2023-10-22 05:13:53 +00:00
|
|
|
|
## Yarn
|
2024-07-28 14:30:59 +00:00
|
|
|
|
- [Yarn概览](./yarn/README.md)
|
|
|
|
|
- [ResourceManager详解](./yarn/resourcemanager.md)
|
|
|
|
|
- [作业启动](./yarn/job_start.md)
|
2024-08-04 09:41:04 +00:00
|
|
|
|
- Yarn NodeManager相关
|
2024-08-06 16:30:33 +00:00
|
|
|
|
- [containerManager 详解](./yarn/containerManager.md)
|
2024-08-04 09:41:04 +00:00
|
|
|
|
|
2024-07-28 14:30:59 +00:00
|
|
|
|
- Yarn 事件相关
|
|
|
|
|
- [Yarn状态机](./yarn/yarn_event.md)
|
|
|
|
|
- [Yarn事件处理机制](./yarn/yarn_event_detail.md)
|
|
|
|
|
- JobHistory 相关
|
|
|
|
|
- [jobhistory 作业缓存](./yarn/jobhistory_cache.md)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## Zookeeper
|
|
|
|
|
- [Zookeeper概览](./zookeeper/README.md)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## OZone
|
|
|
|
|
- [OZone概览](./ozone/README.md)
|
|
|
|
|
|
2023-10-11 15:04:44 +00:00
|
|
|
|
|