2023-10-22 05:13:53 +00:00
|
|
|
|
|
|
|
# 作业提交流程
|
|
|
|
|
|
|
|
![pic](https://pan.zeekling.cn/zeekling/hadoop/hadoop_namenode_00002.png)
|
|
|
|
|
|
|
|
|
|
|
|
# Yarn 调度器
|
|
|
|
|
|
|
|
## 先进先出调度器
|
|
|
|
|
|
|
|
|
|
|
|
## 容量调度器
|
|
|
|
|
|
|
|
![pic](https://pan.zeekling.cn/zeekling/hadoop/yarn_00002.png)
|
|
|
|
|
|
|
|
### 分配算法
|
|
|
|
|
|
|
|
![pic](https://pan.zeekling.cn/zeekling/hadoop/yarn_00001.png)
|
|
|
|
|
|
|
|
|
|
|
|
## 公平调度器
|
|
|
|
|
|
|
|
### 调度原理
|
|
|
|
|
|
|
|
![pic](https://pan.zeekling.cn/zeekling/hadoop/yarn_00003.png)
|
|
|
|
|
|
|
|
#### 缺额
|
|
|
|
|
|
|
|
![pic](https://pan.zeekling.cn/zeekling/hadoop/yarn_00004.png)
|
|
|
|
|
|
|
|
#### 资源分配方式
|
|
|
|
|
|
|
|
![pic](https://pan.zeekling.cn/zeekling/hadoop/yarn_00005.png)
|
|
|
|
|
|
|
|
样例 :
|
|
|
|
|
|
|
|
![pic](https://pan.zeekling.cn/zeekling/hadoop/yarn_00006.png)
|
|
|
|
|
|
|
|
DRF策略
|
|
|
|
![pic](https://pan.zeekling.cn/zeekling/hadoop/yarn_00007.png)
|
|
|
|
|
|
|
|
|
2023-11-02 15:45:06 +00:00
|
|
|
# 核心参数配置
|
|
|
|
|
|
|
|
![pic](https://pan.zeekling.cn/zeekling/hadoop/yarn_00008.png)
|
|
|
|
|
|
|
|
|