You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/partner-solutions/apache-kafka-confluent-cloud/add-confluent-connectors.md
+36-18Lines changed: 36 additions & 18 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -21,37 +21,44 @@ In this guide, you learn how to connect an instance of Apache Kafka & Apache Fli
21
21
22
22
* An Azure account with an active subscription. [Create an account for free](https://azure.microsoft.com/free)
23
23
* An [Azure Blob Storage](/azure/storage/blobs/storage-quickstart-blobs-portal).
24
-
* A [Confluent organization](./create-cli.md) created on Azure Native ISV Services
24
+
* A [Confluent organization](./create.md) created on Azure Native ISV Services
25
25
* The Azure subscription Owner or subscription Contributor role is required. If necessary, contact your subscription administrator to assign you one of these roles.
26
-
* A [Configured environment, cluster, and topic](https://docs.confluent.io/cloud/current/get-started/index.html) inside the confluent organization
26
+
* A [Configured environment, cluster, and topic](https://docs.confluent.io/cloud/current/get-started/index.html) inside the confluent organization. lIf you do not have one already, please go to Confluent to create these constructs.
27
27
28
28
## Create a Confluent sink connector for Azure Blob Storage (preview)
29
29
30
30
Follow these steps to create a sink connector for Azure Blob Storage.
31
31
32
-
1. Open your Confluent organization and select **Confluent** > **Confluent Connectors** from the left menu.
32
+
1. Open your Confluent organization and select **Confluent** > **Confluent Connectors (Preview)** from the left menu.
33
+
34
+
:::image type="content" source="./media/confluent-connectors/create-new-connector.png" alt-text="Screenshot from the Azure portal showing the Confluent Connectors menu.":::
35
+
33
36
2. Select **Create new connector**. A connector pane opens up on the right hand side. Select or enter the following information under **Create a new connector**.
34
37
35
38
### Basics
36
39
37
40
Set the basic settings below, then select **Next**.
|**Connector Type**|*Sink*| A sink connector pulls data from Kafka topics and pushes it into an external database or system for storage or further processing. |
42
-
|**Connector Class**|*Azure Blob Storage*| Select the Azure service you want to connect. Azure Blob Storage is currently the only available option. |
43
-
|**Connector name**|*blob-source-connector*| Enter a name for your connector. |
44
-
|**Environment**|*env1*| Select the environment where you would like to create this connector. |
45
-
|**Cluster**|*cluster1*| Select the cluster where you would like to create this connector. |
46
-
|**Topics**|*topic_1*| Select one or more topic from where the data needs to be pulled. |
47
-
|**Subscription**|*My subscription*| Select the Azure subscription for the Azure Blob Storage where the data needs to be pushed. |
48
-
|**Storage Account**|*storageaccount1*| Select the storage account where the data needs to be pushed. If needed, select **Create new** to create a new [storage account](../../storage/common/storage-account-create.md#basics-tab). |
49
-
|**Container**|*container1*| Select the container within the storage account where the data needs to be pushed. If needed, [create a new container](../../storage/blobs/storage-quickstart-blobs-portal.md#create-a-container). |
|**Connector Type**|*Sink*| A sink connector pulls data from Kafka topics and pushes it into an external database or system for storage or further processing. |
45
+
|**Connector Class**|*Azure Blob Storage Sink*| Select the Azure service you want to connect. Azure Blob Storage is currently the only available option. |
46
+
|**Connector name**|*blob-source-connector*| Enter a name for your connector. |
47
+
|**Environment**|*env1*| Select the environment where you would like to create this connector. |
48
+
|**Cluster**|*cluster1*| Select the cluster where you would like to create this connector. |
49
+
|**Topics**|*topic_1*| Select one or more topic from where the data needs to be pulled. |
50
+
|**Subscription**|*My subscription*| Select the Azure subscription for the Azure Blob Storage where the data needs to be pushed. |
51
+
|**Storage Account**|*storageaccount1*| Select the storage account where the data needs to be pushed. If needed, select **Create new** to create a new [storage account](../../storage/common/storage-account-create.md#basics-tab). |
52
+
|**Container**|*container1*| Select the container within the storage account where the data needs to be pushed. If needed, [create a new container](../../storage/blobs/storage-quickstart-blobs-portal.md#create-a-container). |
53
+
54
+
:::image type="content" source="./media/confluent-connectors/basic-sink.png" alt-text="Screenshot from the Azure portal showing the Basic tab, creating a sink connector.":::
50
55
51
56
### Authentication
52
57
53
58
Configure the authentication of your Kafka cluster via API keys. **Create New** is selected by default, which means that API keys will be automatically generated and configured when the connector is created. Proceed to the next tab.
54
59
60
+
:::image type="content" source="./media/confluent-connectors/authentication.png" alt-text="Screenshot from the Azure portal showing the Authentication tab.":::
61
+
55
62
### Configuration
56
63
57
64
| Setting | Example value | Description |
@@ -62,17 +69,22 @@ Configure the authentication of your Kafka cluster via API keys. **Create New**
62
69
|**Flush size**|*1000*| Optionally enter a flush size. Default flush size is 1000. |
63
70
|**Number of tasks**|*1*| Optionally enter the maximum number of tasks you would like your connector to support simultaneously. Default is 1. |
64
71
65
-
Select **Next** to continue.
72
+
:::image type="content" source="./media/confluent-connectors/configuration.png" alt-text="Screenshot from the Azure portal showing the Configuration tab.":::
73
+
74
+
Select **Review + create** to continue.
66
75
67
76
### Review + Create*
68
77
69
78
Review the listed settings for your new connector to ensure that the details are good to go. Once done, select **Create** to begin the connector deployment.
70
79
71
-
A notification is displayed on the top right, calling out the status of the deployment. Once it shows **Completed**, refresh the **Confluent Connectors** page. You can now see the new connector tile on this page.
80
+
A notification is displayed on the top right, calling out the status of the deployment. Once it shows **created**, refresh the **Confluent Connectors (Preview)** page. You can now see the new connector tile on this page.
72
81
73
82
## Create a Confluent source connector for Azure Blob Storage (preview)
74
83
75
-
1. Open your Confluent organization and select **Confluent** > **Confluent Connectors** from the left menu.
84
+
1. Open your Confluent organization and select **Confluent** > **Confluent Connectors (Preview)** from the left menu.
85
+
86
+
:::image type="content" source="./media/confluent-connectors/create-new-connector.png" alt-text="Screenshot from the Azure portal showing the Confluent Connectors menu.":::
87
+
76
88
2. Select **Create new connector**. A connector pane opens up on the right hand side. Select or enter the following information under **Create a new connector**.
77
89
78
90
### Basics
@@ -90,10 +102,14 @@ Set the basic settings below, then select **Next**.
90
102
|**Storage Account**|*storageaccount1*| Select the storage account where the data needs to be pulled. If needed, select **Create new** to create a new [storage account](../../storage/common/storage-account-create.md#basics-tab). |
91
103
|**Container**|*container1*| Select the container within the storage account where the data needs to be pushed. If needed, [create a new container](../../storage/blobs/storage-quickstart-blobs-portal.md#create-a-container). |
92
104
105
+
:::image type="content" source="./media/confluent-connectors/basic-source.png" alt-text="Screenshot from the Azure portal showing the Basic tab, creating a source connector.":::
106
+
93
107
### Authentication
94
108
95
109
Configure the authentication of your Kafka cluster via API keys. **Create New** is selected by default, which means that API keys will be automatically generated and configured when the connector is created. Proceed to the next tab.
96
110
111
+
:::image type="content" source="./media/confluent-connectors/authentication.png" alt-text="Screenshot from the Azure portal showing the Authentication tab.":::
112
+
97
113
### Configuration
98
114
99
115
| Setting | Example value | Description |
@@ -103,7 +119,9 @@ Configure the authentication of your Kafka cluster via API keys. **Create New**
103
119
|**Topic name and regex**|`my-topic:.*\.json+`| Configure the topic name and the regex pattern of your messages to ensure they are mapped. For example, *my-topic:.*\.json+** moves all the files ending with .json into *my-topic*. |
104
120
|**Number of tasks**|*1*| Optionally enter the maximum number of tasks you would like your connector to support simultaneously. Default is 1. |
105
121
106
-
Select **Next** to continue.
122
+
:::image type="content" source="./media/confluent-connectors/configuration.png" alt-text="Screenshot from the Azure portal showing the Configuration tab.":::
0 commit comments