You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/hdinsight-aks/flink/azure-databricks.md
+36-36Lines changed: 36 additions & 36 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,9 +1,9 @@
1
1
---
2
2
title: Incorporate Apache Flink® DataStream into Azure Databricks Delta Lake Table
3
-
description: Learn about incorporate Apache Flink® DataStream into Azure Databricks Delta Lake Table
3
+
description: Learn about incorporate Apache Flink® DataStream into Azure Databricks Delta Lake Table.
4
4
ms.service: hdinsight-aks
5
5
ms.topic: how-to
6
-
ms.date: 10/27/2023
6
+
ms.date: 04/10/2024
7
7
---
8
8
9
9
# Incorporate Apache Flink® DataStream into Azure Databricks Delta Lake Tables
@@ -12,9 +12,9 @@ This example shows how to sink stream data in Azure ADLS Gen2 from Apache Flink
12
12
13
13
## Prerequisites
14
14
15
-
-[Apache Flink 1.16.0 on HDInsight on AKS](../flink/flink-create-cluster-portal.md)
15
+
-[Apache Flink 1.17.0 on HDInsight on AKS](../flink/flink-create-cluster-portal.md)
16
16
-[Apache Kafka 3.2 on HDInsight](../../hdinsight/kafka/apache-kafka-get-started.md)
17
-
-[Azure Databricks](/azure/databricks/getting-started/) in the same VNET as HDInsight on AKS
17
+
-[Azure Databricks](/azure/databricks/getting-started/) in the same virtual network as HDInsight on AKS
18
18
-[ADLS Gen2](/azure/databricks/getting-started/connect-to-azure-storage/) and Service Principal
19
19
20
20
## Azure Databricks Auto Loader
@@ -25,9 +25,9 @@ Here are the steps how you can use data from Flink in Azure Databricks delta liv
25
25
26
26
### Create Apache Kafka® table on Apache Flink® SQL
27
27
28
-
In this step, you can create Kafka table and ADLS Gen2 on Flink SQL. For the purpose of this document, we are using a airplanes_state_real_time table, you can use any topic of your choice.
28
+
In this step, you can create Kafka table and ADLS Gen2 on Flink SQL. In this document, we're using a `airplanes_state_real_time table`. You can use any article of your choice.
29
29
30
-
You are required to update the broker IPs with your Kafka cluster in the code snippet.
30
+
You need to update the broker IPs with your Kafka cluster in the code snippet.
31
31
32
32
```SQL
33
33
CREATETABLEkafka_airplanes_state_real_time (
@@ -68,34 +68,34 @@ Update the container-name and storage-account-name in the code snippet with your
Further, you can insert Kafka table into ADLSgen2 table on Flink SQL.
@@ -114,9 +114,9 @@ Further, you can insert Kafka table into ADLSgen2 table on Flink SQL.
114
114
115
115
ADLS Gen2 provides OAuth 2.0 with your Microsoft Entra application service principal for authentication from an Azure Databricks notebook and then mount into Azure Databricks DBFS.
116
116
117
-
**Let's get service principle appid, tenant id and secret key.**
117
+
**Let's get service principle appid, tenant ID, and secret key.**
118
118
119
-
:::image type="content" source="media/azure-databricks/service-id.png" alt-text="Screenshot shows get service principle appid, tenant ID and secret key." lightbox="media/azure-databricks/service-id.png":::
119
+
:::image type="content" source="media/azure-databricks/service-id.png" alt-text="Screenshot shows get service principle appid, tenant ID, and secret key." lightbox="media/azure-databricks/service-id.png":::
120
120
121
121
**Grant service principle the Storage Blob Data Owner on Azure portal**
0 commit comments