You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Update steps for multi storage account data collection and updating screenshot. Vnet integration is not associated with multi storage account - have made it a seperate step
Copy file name to clipboardExpand all lines: docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs.md
+10-25Lines changed: 10 additions & 25 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -134,7 +134,6 @@ The following steps assume you have noted down the resource group name, storage
134
134
135
135
*[Step 1: Authorize App Service read from storage account](#step-1-authorize-app-service-to-read-from-storage-account) - Enables the Azure functions to read from the storage account.
136
136
*[Step 2: Create an Event Grid Subscription](#step-2-create-an-event-grid-subscription) - Subscribes all blob creation events to the Event Hub created by ARM template in [Step 3](#step-3-enabling-vnet-integration-optional) above.
### Step 1: Authorize App Service to read from storage account
140
139
@@ -157,61 +156,47 @@ To authorize the App Service to list the Storage Account key, do the following:
157
156
158
157
***Subscription**: Choose Pay as you Go.
159
158
***Managed Identity**: Choose Function App.
160
-
***Select**: **Select SUMOBRDLQProcessor\<unique_prefix\>** and **SUMORTaskConsumer\<unique_prefix\>** app services which are created by the ARM template. Click **Select**.
159
+
***Select**: **Select SUMOBRDLQProcessor\<unique_prefix\>** and **SUMOBRTaskConsumer\<unique_prefix\>** app services which are created by the ARM template. Click **Select**.
161
160
1. Click **Review + assign**
162
161
1. Click **Save**.
163
162
164
163
### Step 2: Create an Event Grid Subscription
165
164
166
-
This section provides instructions for creating an event grid subscription, that subscribes all blob creation events to the Event Hub created by ARM template in [Step 3](#step-3-enabling-vnet-integration-optional) above.
165
+
This section provides instructions for creating an event grid subscription, that subscribes all blob creation events to the Event Hub created by ARM template in [Step 3](#step-3-configure-azure-resources-using-arm-template) above.
167
166
168
167
To create an event grid subscription, do the following:
169
168
170
-
1.In the left pane of Azure portal click **All Services**, then search for and click **Event Grid Subscriptions**.
169
+
1.Go to the storage account which needs to be monitored additionally. Go under Events blade in left pane.
1. Specify the following values for **Event Subscription Details**:
183
176
184
177
***Name:** Fill the event subscription name.
185
178
***Event Schema:** Select **Event Grid Schema**.
186
179
187
180
1. Specify the following values for **Topic Details**:
188
181
189
-
***Topic Type**. Select Storage Accounts.
190
-
***Subscription**. Select Pay As You Go
191
-
***Resource Group**. Select the Resource Group for the Storage Account to which your Azure service will export logs, from where you want to ingest logs.
192
-
***Resource**. Select the Storage Account you configured, from where you want to ingest logs.
193
182
***System Topic Name**. Provide the topic name, if the system topic already exists then it will automatically select the existing topic.
194
-
:::note
195
-
If you do not see your configured Storage Account in the dropdown menu, make sure you met the requirements in [Requirements](#requirements) section.
196
-
:::
197
-
183
+
198
184
1. Specify the following details for Event Types:
199
185
200
-
* Uncheck the **Subscribe to all event types** box.
201
-
* Select **Blob Created** from the **Define Event Types** dropdown.
186
+
* Select **Blob Created** from the **Filter to Event Types** dropdown.
202
187
203
188
1. Specify the following details for Endpoint Types:
204
189
205
190
***Endpoint Type**. Select **Event Hubs** from the dropdown.
206
-
***Endpoint.** Click on **Select an endpoint.**
191
+
***Endpoint.** Click on **Configure an endpoint.**
1. Specify the following Select Event Hub parameters, then click **Confirm Selection.**
213
198
214
-
***Resource Group**. Select the resource group you created [Step 3](#step-3-enabling-vnet-integration-optional) in which all the resources created by ARM template are present.
199
+
***Resource Group**. Select the resource group you created [Step 3](#step-3-configure-azure-resources-using-arm-template) in which all the resources created by ARM template are present.
***Event Hub**. Select **blobreadereventhub** from the dropdown.
217
202
@@ -226,9 +211,9 @@ To create an event grid subscription, do the following:
226
211
227
212
1. Verify the deployment was successful by checking **Notifications** in the top right corner of the Azure Portal.
228
213
229
-
### Step 3: Enabling VNet Integration (Optional)
214
+
## Enabling VNet Integration (Optional)
230
215
231
-
Assuming you have used the modified template which uses standard/premium plan for BlobTaskConsumer and [DLQTaskConsumer](https://portal.azure.com/#blade/WebsitesExtension/FunctionMenuBlade/resourceId/%2Fsubscriptions%2Fc088dc46-d692-42ad-a4b6-9a542d28ad2a%2FresourceGroups%2Fleast%2Fproviders%2FMicrosoft.Web%2Fsites%2FSUMOBRDLQProcessorekbxzlepnhs4g%2Ffunctions%2FDLQTaskConsumer) functions. This assumes that your storage account access is enabled for selected networks.
216
+
This assumes that your storage account access is not public and is enabled for selected networks i.e. your storage account is behind a virtual network. This requires you to used the modified template which uses standard/premium plan for BlobTaskConsumer and DLQTaskConsumer functions. In case you want the whole data pipeline sending logs to sumo logic, to be under a virtual network follow the instruction [here](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/full-vnet-integration.md).
232
217
233
218
1. Create a subnet in a virtual network using the instructions in the [doc](https://docs.microsoft.com/en-us/azure/virtual-network/virtual-network-manage-subnet#add-a-subnet). If you have multiple accounts in the same region you can skip step 2 below and use the same subnet and add it to the storage account as mentioned in step 3.
234
219
1. Perform below steps for both BlobTaskConsumer and [DLQTaskConsumer](https://portal.azure.com/#blade/WebsitesExtension/FunctionMenuBlade/resourceId/%2Fsubscriptions%2Fc088dc46-d692-42ad-a4b6-9a542d28ad2a%2FresourceGroups%2Fleast%2Fproviders%2FMicrosoft.Web%2Fsites%2FSUMOBRDLQProcessorekbxzlepnhs4g%2Ffunctions%2FDLQTaskConsumer) function apps.
0 commit comments