hadoop_book/README.md

60 lines
1.5 KiB
Markdown
Raw Normal View History

2024-06-02 06:28:41 +00:00
2024-07-28 14:30:59 +00:00
# 简介
本仓库用于记录学习Hadoop相关笔记菜就多做笔记。
# 编译
2024-06-02 06:28:41 +00:00
执行下面编译命令:
```bash
2024-07-28 14:30:59 +00:00
# -T 是编译的线程数,可以按照具体操作系统增加或者减少
mvn -T 8 package -Pdist,native -DskipTests -Dmaven.javadoc.skip=true
# or 忽略 本地方法编译
mvn -T 8 package -P\!dist,\!native -DskipTests -Dmaven.javadoc.skip=true
2024-06-02 06:28:41 +00:00
```
2024-07-28 14:30:59 +00:00
# 知识树
2024-09-01 11:24:08 +00:00
## Common 模块
## HDFS 模块
2024-07-28 14:30:59 +00:00
- [HDFS概览](./hdfs/README.md)
- NameNode相关
- [namenode全景](./hdfs/namenode全景.md)
- [NameNode启动过程](./hdfs/nameNode启动过程.md)
- [FsIMage](./hdfs/fsImages.md)
- [NamenodeProtocols详解](./hdfs/NamenodeProtocols详解.md)
- [leaseManager详解](./hdfs/leaseManager详解.md)
- [FSDirectory详解](./hdfs/FSDirectory详解.md)
- [文件上传](./hdfs/file_upload.md)
- DataNode相关
- [dataNode启动过程](./hdfs/dataNode启动过程.md)
- [BPServiceActor详解](./hdfs/BPServiceActor详解.md)
2024-09-01 11:24:08 +00:00
## Yarn 模块
2024-07-28 14:30:59 +00:00
- [Yarn概览](./yarn/README.md)
- [ResourceManager详解](./yarn/resourcemanager.md)
- [作业启动](./yarn/job_start.md)
2024-08-04 09:41:04 +00:00
- Yarn NodeManager相关
2024-08-06 16:30:33 +00:00
- [containerManager 详解](./yarn/containerManager.md)
2024-08-04 09:41:04 +00:00
2024-07-28 14:30:59 +00:00
- Yarn 事件相关
- [Yarn状态机](./yarn/yarn_event.md)
- [Yarn事件处理机制](./yarn/yarn_event_detail.md)
- JobHistory 相关
- [jobhistory 作业缓存](./yarn/jobhistory_cache.md)
2024-09-01 11:24:08 +00:00
## Zookeeper模块
2024-07-28 14:30:59 +00:00
- [Zookeeper概览](./zookeeper/README.md)
2024-09-01 11:24:08 +00:00
## OZone 模块
2024-07-28 14:30:59 +00:00
- [OZone概览](./ozone/README.md)
2023-10-11 15:04:44 +00:00