Skip to content

Commit aa8c1e0

Browse files
authored
Merge pull request #269049 from sreekzz/patch-8
Updated with kafka 1.17.0 jar
2 parents 179cfd2 + 03d5005 commit aa8c1e0

File tree

2 files changed

+10
-10
lines changed

2 files changed

+10
-10
lines changed

articles/hdinsight-aks/flink/create-kafka-table-flink-kafka-sql-connector.md

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,9 @@
11
---
22
title: How to create Apache Kafka table on an Apache Flink® on HDInsight on AKS
3-
description: Learn how to create Apache Kafka table on Apache Flink®
3+
description: Learn how to create Apache Kafka table on Apache Flink®.
44
ms.service: hdinsight-aks
55
ms.topic: how-to
6-
ms.date: 10/27/2023
6+
ms.date: 03/14/2024
77
---
88

99
# Create Apache Kafka® table on Apache Flink® on HDInsight on AKS
@@ -19,7 +19,7 @@ Using this example, learn how to Create Kafka table on Apache FlinkSQL.
1919

2020
## Kafka SQL connector on Apache Flink
2121

22-
The Kafka connector allows for reading data from and writing data into Kafka topics. For more information, refer [Apache Kafka SQL Connector](https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/kafka)
22+
The Kafka connector allows for reading data from and writing data into Kafka topics. For more information, refer [Apache Kafka SQL Connector](https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/kafka).
2323

2424
## Create a Kafka table on Flink SQL
2525

@@ -119,21 +119,21 @@ sshuser@hn0-contsk:~$ /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.s
119119

120120
### Apache Flink SQL client
121121

122-
Detailed instructions are provided on how to use Secure Shell for [Flink SQL client](./flink-web-ssh-on-portal-to-flink-sql.md)
122+
Detailed instructions are provided on how to use Secure Shell for [Flink SQL client](./flink-web-ssh-on-portal-to-flink-sql.md).
123123

124124
### Download Kafka SQL Connector & Dependencies into SSH
125125

126126
We're using the **Kafka 3.2.0** dependencies in the below step, You're required to update the command based on your Kafka version on HDInsight cluster.
127127
```
128128
wget https://repo1.maven.org/maven2/org/apache/kafka/kafka-clients/3.2.0/kafka-clients-3.2.0.jar
129-
wget https://repo1.maven.org/maven2/org/apache/flink/flink-connector-kafka/1.16.0/flink-connector-kafka-1.16.0.jar
129+
wget https://repo1.maven.org/maven2/org/apache/flink/flink-connector-kafka/1.17.0/flink-connector-kafka-1.17.0.jar
130130
```
131131

132132
### Connect to Apache Flink SQL Client
133133

134-
Let's now connect to the Flink SQL Client with Kafka SQL client jars
134+
Let's now connect to the Flink SQL Client with Kafka SQL client jars.
135135
```
136-
msdata@pod-0 [ /opt/flink-webssh ]$ bin/sql-client.sh -j flink-connector-kafka-1.16.0.jar -j kafka-clients-3.2.0.jar
136+
msdata@pod-0 [ /opt/flink-webssh ]$ bin/sql-client.sh -j flink-connector-kafka-1.17.0.jar -j kafka-clients-3.2.0.jar
137137
```
138138

139139
### Create Kafka table on Apache Flink SQL
@@ -163,18 +163,18 @@ select * from KafkaTable;
163163

164164
### Produce Kafka messages
165165

166-
Let's now produce Kafka messages to the same topic, using HDInsight Kafka
166+
Let's now produce Kafka messages to the same topic, using HDInsight Kafka.
167167
```
168168
python weblog.py | /usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh --bootstrap-server wn0-contsk:9092 --topic click_events
169169
```
170170

171171
### Table on Apache Flink SQL
172172

173-
You can monitor the table on Flink SQL
173+
You can monitor the table on Flink SQL.
174174

175175
:::image type="content" source="./media/create-kafka-table-flink-kafka-sql-connector/monitor-table-data-on-flink-sql.png" alt-text="Screenshot showing How to monitor table date on Flink SQL.":::
176176

177-
Here are the streaming jobs on Flink Web UI
177+
Here are the streaming jobs on Flink Web UI.
178178

179179
:::image type="content" source="./media/create-kafka-table-flink-kafka-sql-connector/flink-web-ui-kafka-jobs.png" alt-text="Screenshot showing jobs on the Flink web UI.":::
180180

25.9 KB
Loading

0 commit comments

Comments
 (0)