|
| 1 | +--- |
| 2 | +title: Flink-standalone |
| 3 | +sidebar_label: Flink-standalone |
| 4 | +--- |
| 5 | + |
| 6 | +## 启动Flink Standalone环境 |
| 7 | + |
| 8 | +**1、下载 flink** |
| 9 | +* flink官网下载 [release 1.12.7](https://flink.apache.org/downloads.html) |
| 10 | + |
| 11 | +**2、chunjun的插件** |
| 12 | +* 拉取最新的chunjun [1.12](https://github.com/DTStack/chunjun/releases/tag/v1.12.3) 版本项目,打包 mvn clean package -DskipTests, 将生成的chunjun-dist 拷贝至 $FLINK_HOME/lib |
| 13 | +* chunjun 在chunjun-core中将logback的依赖改为了provided, 需要将以下logback包放到$FLINK_HOME/lib |
| 14 | + logback-core-1.2.11.jar |
| 15 | + logback-classic-1.2.11.jar |
| 16 | + |
| 17 | +**3、flink1.12 standalone服务参数** |
| 18 | +所有节点都需要配置 |
| 19 | +``` |
| 20 | +# 类加载配置 |
| 21 | +classloader.resolve-order: parent-first |
| 22 | +classloader.check-leaked-classloader: false |
| 23 | +
|
| 24 | +# 高可用配置(单机 None) |
| 25 | +high-availability: zookeeper |
| 26 | +high-availability.zookeeper.quorum: kudu1:2181,kudu2:2181,kudu3:2181 |
| 27 | +high-availability.zookeeper.path.root: /flink112 |
| 28 | +high-availability.storageDir: hdfs://ns1/dtInsight/flink112/ha |
| 29 | +high-availability.cluster-id: /standalone_ha |
| 30 | +
|
| 31 | +# 指标配置 |
| 32 | +metrics.reporter.promgateway.class: org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporter |
| 33 | +metrics.reporter.promgateway.host: 172.16.23.25 |
| 34 | +metrics.reporter.promgateway.port: 9091 |
| 35 | +metrics.reporter.promgateway.jobName: flink112 |
| 36 | +metrics.reporter.promgateway.randomJobNameSuffix: true |
| 37 | +metrics.reporter.promgateway.deleteOnShutdown: false |
| 38 | +``` |
| 39 | + |
| 40 | +## Flink1.12 on Standalone 控制台参数 |
| 41 | + |
| 42 | +| 参数名 | 含义 | 是否必填 * 为必填 | 默认值 | |
| 43 | +| --- | --- | --- | --- | |
| 44 | +| clusterMode |flink部署模式 | * | standalone | |
| 45 | +| flinkLibDir | flink libs的路径 | * | /data/flink112_lib | |
| 46 | +| chunjunDistDir | chunjun 插件地址 | * | /data/chunjun/chunjun-dist | |
| 47 | +| remoteChunjunDistDir | chunjun 插件远端地址 | * | /data/chunjun/chunjun-dist | |
| 48 | +| pluginLoadMode | 加载文件的方式 | * | classpath | |
| 49 | +| jobmanager.rpc.address | jobmanager rpc地址 | | | |
| 50 | +| jobmanager.rpc.port | jobmanager rpc端口号 | | | |
| 51 | +| rest.port | ui端口号 | | | |
| 52 | +| high-availability | 高可用服务类型 | | NONE | |
| 53 | +| high-availability.zookeeper.quorum | zookeeper集群地址 | | | |
| 54 | +| high-availability.zookeeper.path.root | flink存储状态在zookeeper的根节点路径 | | | |
| 55 | +| high-availability.storageDir | flink高可用模式下存储元数据的文件系统路径(URI) | | | |
| 56 | +| high-availability.cluster-id | flink集群的id, 用于区分多个flink集群 | | | |
| 57 | +| prometheusHost | prometheus地址 | * | | |
| 58 | +| prometheusPort | prometheus端口 | * | | |
| 59 | +| state.backend | 状态后端 | | jobmanager | |
| 60 | + |
| 61 | + |
| 62 | + |
| 63 | +## 新增集群 |
| 64 | + |
| 65 | +1. 进入控制台 > 2. 多集群管理 > 3. 新增集群 |
| 66 | + 配置集群参考 [集群配置](././functions/multi-cluster.md) |
| 67 | + 配置组件参考 [组件配置](././functions/component/sftp.md) |
| 68 | + |
| 69 | +## 绑定集群 |
| 70 | + |
| 71 | +> 控制台>资源管理>绑定新租户 会初始化相关目录、schema、默认数据源信息 |
| 72 | +
|
| 73 | + |
| 74 | + |
| 75 | + |
| 76 | + |
0 commit comments