Skip to content

Commit a17f792

Browse files
ghm02708vainhope
authored andcommitted
[1.3_beta_doc][taier-data-develop] 补充文档
1 parent 5cc02ee commit a17f792

File tree

1 file changed

+76
-0
lines changed

1 file changed

+76
-0
lines changed
Lines changed: 76 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,76 @@
1+
---
2+
title: Flink-standalone
3+
sidebar_label: Flink-standalone
4+
---
5+
6+
## 启动Flink Standalone环境
7+
8+
**1、下载 flink**
9+
* flink官网下载 [release 1.12.7](https://flink.apache.org/downloads.html)
10+
11+
**2、chunjun的插件**
12+
* 拉取最新的chunjun [1.12](https://github.com/DTStack/chunjun/releases/tag/v1.12.3) 版本项目,打包 mvn clean package -DskipTests, 将生成的chunjun-dist 拷贝至 $FLINK_HOME/lib
13+
* chunjun 在chunjun-core中将logback的依赖改为了provided, 需要将以下logback包放到$FLINK_HOME/lib
14+
logback-core-1.2.11.jar
15+
logback-classic-1.2.11.jar
16+
17+
**3、flink1.12 standalone服务参数**
18+
所有节点都需要配置
19+
```
20+
# 类加载配置
21+
classloader.resolve-order: parent-first
22+
classloader.check-leaked-classloader: false
23+
24+
# 高可用配置(单机 None)
25+
high-availability: zookeeper
26+
high-availability.zookeeper.quorum: kudu1:2181,kudu2:2181,kudu3:2181
27+
high-availability.zookeeper.path.root: /flink112
28+
high-availability.storageDir: hdfs://ns1/dtInsight/flink112/ha
29+
high-availability.cluster-id: /standalone_ha
30+
31+
# 指标配置
32+
metrics.reporter.promgateway.class: org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporter
33+
metrics.reporter.promgateway.host: 172.16.23.25
34+
metrics.reporter.promgateway.port: 9091
35+
metrics.reporter.promgateway.jobName: flink112
36+
metrics.reporter.promgateway.randomJobNameSuffix: true
37+
metrics.reporter.promgateway.deleteOnShutdown: false
38+
```
39+
40+
## Flink1.12 on Standalone 控制台参数
41+
42+
| 参数名 | 含义 | 是否必填 * 为必填 | 默认值 |
43+
| --- | --- | --- | --- |
44+
| clusterMode |flink部署模式 | * | standalone |
45+
| flinkLibDir | flink libs的路径 | * | /data/flink112_lib |
46+
| chunjunDistDir | chunjun 插件地址 | * | /data/chunjun/chunjun-dist |
47+
| remoteChunjunDistDir | chunjun 插件远端地址 | * | /data/chunjun/chunjun-dist |
48+
| pluginLoadMode | 加载文件的方式 | * | classpath |
49+
| jobmanager.rpc.address | jobmanager rpc地址 | | |
50+
| jobmanager.rpc.port | jobmanager rpc端口号 | | |
51+
| rest.port | ui端口号 | | |
52+
| high-availability | 高可用服务类型 | | NONE |
53+
| high-availability.zookeeper.quorum | zookeeper集群地址 | | |
54+
| high-availability.zookeeper.path.root | flink存储状态在zookeeper的根节点路径 | | |
55+
| high-availability.storageDir | flink高可用模式下存储元数据的文件系统路径(URI) | | |
56+
| high-availability.cluster-id | flink集群的id, 用于区分多个flink集群 | | |
57+
| prometheusHost | prometheus地址 | * | |
58+
| prometheusPort | prometheus端口 | * | |
59+
| state.backend | 状态后端 | | jobmanager |
60+
61+
62+
63+
## 新增集群
64+
65+
1. 进入控制台 > 2. 多集群管理 > 3. 新增集群
66+
配置集群参考 [集群配置](././functions/multi-cluster.md)
67+
配置组件参考 [组件配置](././functions/component/sftp.md)
68+
69+
## 绑定集群
70+
71+
> 控制台>资源管理>绑定新租户 会初始化相关目录、schema、默认数据源信息
72+
73+
![bing-tenant](/img/readme/bind-tenant.png)
74+
75+
76+

0 commit comments

Comments
 (0)