You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/partner-solutions/apache-kafka-confluent-cloud/add-confluent-connectors.md
+20-18Lines changed: 20 additions & 18 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -20,10 +20,10 @@ In this guide, you learn how to connect an instance of Apache Kafka & Apache Fli
20
20
## Prerequisites
21
21
22
22
* An Azure account with an active subscription. [Create an account for free](https://azure.microsoft.com/free)
23
-
* An [Azure Blob Storage](/azure/storage/blobs/storage-quickstart-blobs-portal).
23
+
* An [Azure Blob Storage](/azure/storage/blobs/storage-quickstart-blobs-portal) resource.
24
24
* A [Confluent organization](./create.md) created on Azure Native ISV Services
25
25
* The Azure subscription Owner or subscription Contributor role is required. If necessary, contact your subscription administrator to assign you one of these roles.
26
-
* A [Configured environment, cluster, and topic](https://docs.confluent.io/cloud/current/get-started/index.html) inside the confluent organization. lIf you do not have one already, please go to Confluent to create these constructs.
26
+
* A [configured environment, cluster, and topic](https://docs.confluent.io/cloud/current/get-started/index.html) inside the confluent organization. lIf you do not have one already, please go to Confluent to create these constructs.
27
27
28
28
## Create a Confluent sink connector for Azure Blob Storage (preview)
29
29
@@ -39,17 +39,17 @@ Follow these steps to create a sink connector for Azure Blob Storage.
39
39
40
40
Set the basic settings below, then select **Next**.
|**Connector Type**|*Sink*| A sink connector pulls data from Kafka topics and pushes it into an external database or system for storage or further processing. |
45
-
|**Connector Class**|*Azure Blob Storage Sink*| Select the Azure service you want to connect. Azure Blob Storage is currently the only available option. |
46
-
|**Connector name**|*blob-source-connector*| Enter a name for your connector. |
47
-
|**Environment**|*env1*| Select the environment where you would like to create this connector. |
48
-
|**Cluster**|*cluster1*| Select the cluster where you would like to create this connector. |
49
-
|**Topics**|*topic_1*| Select one or more topic from where the data needs to be pulled. |
50
-
|**Subscription**|*My subscription*| Select the Azure subscription for the Azure Blob Storage where the data needs to be pushed. |
51
-
|**Storage Account**|*storageaccount1*| Select the storage account where the data needs to be pushed. If needed, select **Create new** to create a new [storage account](../../storage/common/storage-account-create.md#basics-tab). |
52
-
|**Container**|*container1*| Select the container within the storage account where the data needs to be pushed. If needed, [create a new container](../../storage/blobs/storage-quickstart-blobs-portal.md#create-a-container). |
|**Connector Type**|*Sink*| A sink connector pulls data from Kafka topics and pushes it into an external database or system for storage or further processing. |
45
+
|**Connector Class**|*Azure Blob Storage Sink*| Select the Azure service you want to connect. Azure Blob Storage is currently the only available option. |
46
+
|**Connector name**|*blob-sink-connector*| Enter a name for your connector.|
47
+
|**Environment**|*env1*| Select the environment where you would like to create this connector. |
48
+
|**Cluster**|*cluster1*| Select the cluster where you would like to create this connector. |
49
+
|**Topics**|*topic_1*| Select one or more topic from where the data needs to be pulled. If there are no topics in the cluster in the selected cluster, create one by selecting **new topic**, which will open the Confluent website.|
50
+
|**Subscription**|*My subscription*| Select the Azure subscription for the Azure Blob Storage where the data needs to be pushed. |
51
+
|**Storage Account**|*storageaccount1*| Select the storage account where the data needs to be pushed. If needed, select **Create new** to create a new [storage account](../../storage/common/storage-account-create.md#basics-tab). |
52
+
|**Container**|*container1*| Select the container within the storage account where the data needs to be pushed. If needed, [create a new container](../../storage/blobs/storage-quickstart-blobs-portal.md#create-a-container). |
53
53
54
54
:::image type="content" source="./media/confluent-connectors/basic-sink.png" alt-text="Screenshot from the Azure portal showing the Basic tab, creating a sink connector.":::
55
55
@@ -69,11 +69,11 @@ Configure the authentication of your Kafka cluster via API keys. **Create New**
69
69
|**Flush size**|*1000*| Optionally enter a flush size. Default flush size is 1000. |
70
70
|**Number of tasks**|*1*| Optionally enter the maximum number of tasks you would like your connector to support simultaneously. Default is 1. |
71
71
72
-
:::image type="content" source="./media/confluent-connectors/configuration.png" alt-text="Screenshot from the Azure portal showing the Configuration tab.":::
72
+
:::image type="content" source="./media/confluent-connectors/configuration-sink.png" alt-text="Screenshot from the Azure portal showing the Configuration tab for a sink connector.":::
73
73
74
74
Select **Review + create** to continue.
75
75
76
-
### Review + Create*
76
+
### Review + Create
77
77
78
78
Review the listed settings for your new connector to ensure that the details are good to go. Once done, select **Create** to begin the connector deployment.
79
79
@@ -119,7 +119,7 @@ Configure the authentication of your Kafka cluster via API keys. **Create New**
119
119
|**Topic name and regex**|`my-topic:.*\.json+`| Configure the topic name and the regex pattern of your messages to ensure they are mapped. For example, *my-topic:.*\.json+** moves all the files ending with .json into *my-topic*. |
120
120
|**Number of tasks**|*1*| Optionally enter the maximum number of tasks you would like your connector to support simultaneously. Default is 1. |
121
121
122
-
:::image type="content" source="./media/confluent-connectors/configuration.png" alt-text="Screenshot from the Azure portal showing the Configuration tab.":::
122
+
:::image type="content" source="./media/confluent-connectors/configuration-source.png" alt-text="Screenshot from the Azure portal showing the Configuration tab, createing asource connetor .":::
123
123
124
124
Select **Review + create** to continue.
125
125
@@ -134,10 +134,12 @@ A notification is displayed on the top right, calling out the status of the depl
134
134
1. Open your Confluent organization and select **Confluent** > **Confluent Connectors** from the left menu.
135
135
1. Select your **Environment** and **Cluster** from the dropdown menu. The Azure portal now displays the list of Azure connectors in the respective environment and cluster. The following optional actions are available:
136
136
137
-
* Filter connectors by **Type** (**Source** or **Sink**) and **Status** (**Failed**or **Running**)
137
+
* Filter connectors by **Type** (**Source** or **Sink**) and **Status** (**Running**, **Failed**, **Provisioning**or **Paused**).
138
138
* Search for a connector by entering a name in the search bar on the right hand side.
139
139
140
-
To learn more about a connector, select the connector tile, which opens the Confluent UI. On this page, you can see the connector health, throughput and other stats, edit, and delete the connector.
140
+
:::image type="content" source="./media/confluent-connectors/display-connectors.png" alt-text="Screenshot of the Azure platform that shows a list of existing connectors in the Confluent Connectors (Preview) tab." lightbox="./media/confluent-connectors/display-connectors.png":::
141
+
142
+
To learn more about a connector, select the connector tile, which opens the Confluent UI. On this page, you can see the connector health, throughput and other stats, edit, and delete the connector.
0 commit comments