You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: ha-example/README.md
+19-4Lines changed: 19 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -87,22 +87,26 @@ spec:
87
87
image: quay.io/streamshub/flink-sql-runner:0.2.0
88
88
flinkVersion: v2_0
89
89
flinkConfiguration:
90
-
# job manager HA settings
91
-
execution.checkpointing.interval: 1min
92
-
state.checkpoints.dir: s3://test/cp
90
+
# job manager HA settings
91
+
execution.checkpointing.interval: 1min
92
+
state.checkpoints.dir: s3://test/cp
93
93
```
94
94
The settings above will checkpoint the Task state every 1 minute under the s3 path provided.
95
95
96
96
## Example: Making the `recommendation-app` fault-tolerant and highly available
97
97
98
98
Here, we will use the [recommendation-app](../recommendation-app) as an example to demonstrate the job manager HA.
99
-
99
+
We are installing several additional components for this example so you may need a larger K8s cluster (more CPU and memory for you minikube deployment), than for the other examples.
100
100
101
101
1. If you haven't already, install cert-manager (this creates cert-manager in a namespace called `cert-manager`):
@@ -115,6 +119,17 @@ Here, we will use the [recommendation-app](../recommendation-app) as an example
115
119
-n flink
116
120
```
117
121
1. Follow the [guide](minio-install/README.md) to deploy and create a local S3 compatible storage service using minio and add a bucket named `test`.
122
+
1. Deploy Apicurio, Strimzi and Kafka as per the instructions in the [README](../README.md#installing-apache-kafka-apache-flink-and-apicurio-registry).
123
+
1. Deploy the data generator application to generate data for the recommendation app:
Copy file name to clipboardExpand all lines: ha-example/minio-install/README.md
+2-5Lines changed: 2 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -3,9 +3,10 @@
3
3
This folder contains an example minio deployment yaml and the instructions are based on the [minio documentation](https://min.io/docs/minio/kubernetes/upstream/index.html).
4
4
5
5
1. Deploy the minio with default configurations:
6
-
```
6
+
```shell
7
7
kubectl -n flink apply -f minio.yaml
8
8
```
9
+
This will create the minio deployment and service for the minio API endpoint (that Flink will use to store state).
@@ -22,10 +23,6 @@ This folder contains an example minio deployment yaml and the instructions are b
22
23
1. Create a bucket via MinIO WebUI. To do this, open the address found above and login with username: `minioadmin` and password: `minioadmin`, then go to `Buckets` -> `Create Bucket` to create a bucket called `test`.
23
24
1. Monitor the files in the bucket.
24
25
Click on the `Object Browser` to view the files in the buckets.
0 commit comments