Skip to content

Commit b4fe0cb

Browse files
committed
Update steps for multi storage account data collection and updating screenshot. Vnet integration is not associated with multi storage account - have made it a seperate step
1 parent 9c19f6d commit b4fe0cb

File tree

3 files changed

+10
-25
lines changed

3 files changed

+10
-25
lines changed

docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs.md

Lines changed: 10 additions & 25 deletions
Original file line numberDiff line numberDiff line change
@@ -134,7 +134,6 @@ The following steps assume you have noted down the resource group name, storage
134134

135135
* [Step 1: Authorize App Service read from storage account](#step-1-authorize-app-service-to-read-from-storage-account) - Enables the Azure functions to read from the storage account.
136136
* [Step 2: Create an Event Grid Subscription](#step-2-create-an-event-grid-subscription) - Subscribes all blob creation events to the Event Hub created by ARM template in [Step 3](#step-3-enabling-vnet-integration-optional) above.
137-
* [Step 3. Enabling Vnet Integration(Optional)](#step-3-enabling-vnet-integration-optional)
138137

139138
### Step 1: Authorize App Service to read from storage account
140139

@@ -157,61 +156,47 @@ To authorize the App Service to list the Storage Account key, do the following:
157156

158157
* **Subscription**: Choose Pay as you Go.
159158
* **Managed Identity**: Choose Function App.
160-
* **Select**: **Select SUMOBRDLQProcessor\<unique_prefix\>** and **SUMORTaskConsumer\<unique_prefix\>** app services which are created by the ARM template. Click **Select**.
159+
* **Select**: **Select SUMOBRDLQProcessor\<unique_prefix\>** and **SUMOBRTaskConsumer\<unique_prefix\>** app services which are created by the ARM template. Click **Select**.
161160
1. Click **Review + assign**
162161
1. Click **Save**.
163162

164163
### Step 2: Create an Event Grid Subscription
165164

166-
This section provides instructions for creating an event grid subscription, that subscribes all blob creation events to the Event Hub created by ARM template in [Step 3](#step-3-enabling-vnet-integration-optional) above.
165+
This section provides instructions for creating an event grid subscription, that subscribes all blob creation events to the Event Hub created by ARM template in [Step 3](#step-3-configure-azure-resources-using-arm-template) above.
167166

168167
To create an event grid subscription, do the following:
169168

170-
1. In the left pane of Azure portal click **All Services**, then search for and click **Event Grid Subscriptions**.
169+
1. Go to the storage account which needs to be monitored additionally. Go under Events blade in left pane.
171170

172-
![AzureBlob_EventGridSubscriptions.png](/img/send-data/AzureBlob_EventGridSubscriptions.png)
173-
174-
1. At the top of the **Event subscriptions** page, click **+Event Subscription**.
171+
1. At the top of the **Event subscriptions** tab, click **+Event Subscription** to create new event subscription.
175172

176173
![AzureBlob_EventSubscriptionsPage.png](/img/send-data/AzureBlob_EventSubscriptionsPage.png)
177174

178-
The Create Event Subscription dialog appears.
179-
180-
![AzureBlob_CreatEventSubscription_dialog.png](/img/send-data/AzureBlob_CreatEventSubscription_dialog.png)
181-
182175
1. Specify the following values for **Event Subscription Details**:
183176

184177
* **Name:** Fill the event subscription name.
185178
* **Event Schema:** Select **Event Grid Schema**.
186179

187180
1. Specify the following values for **Topic Details**:
188181

189-
* **Topic Type**. Select Storage Accounts.
190-
* **Subscription**. Select Pay As You Go
191-
* **Resource Group**. Select the Resource Group for the Storage Account to which your Azure service will export logs, from where you want to ingest logs.
192-
* **Resource**. Select the Storage Account you configured, from where you want to ingest logs.
193182
* **System Topic Name**. Provide the topic name, if the system topic already exists then it will automatically select the existing topic.
194-
:::note
195-
If you do not see your configured Storage Account in the dropdown menu, make sure you met the requirements in [Requirements](#requirements) section.
196-
:::
197-
183+
198184
1. Specify the following details for Event Types:
199185

200-
* Uncheck the **Subscribe to all event types** box.
201-
* Select **Blob Created** from the **Define Event Types** dropdown.
186+
* Select **Blob Created** from the **Filter to Event Types** dropdown.
202187

203188
1. Specify the following details for Endpoint Types:
204189

205190
* **Endpoint Type**. Select **Event Hubs** from the dropdown.
206-
* **Endpoint.** Click on **Select an endpoint.**
191+
* **Endpoint.** Click on **Configure an endpoint.**
207192

208193
The Select Event Hub dialog appears.
209194

210195
![AzureBlob_SelectEventHub-EventGrid.png](/img/send-data/AzureBlob_SelectEventHub-EventGrid.png)
211196

212197
1. Specify the following Select Event Hub parameters, then click **Confirm Selection.**
213198

214-
* **Resource Group**. Select the resource group you created [Step 3](#step-3-enabling-vnet-integration-optional) in which all the resources created by ARM template are present.
199+
* **Resource Group**. Select the resource group you created [Step 3](#step-3-configure-azure-resources-using-arm-template) in which all the resources created by ARM template are present.
215200
* **Event Hub Namespace**. Select **SUMOBREventHubNamespace\<*unique string*\\>**.
216201
* **Event Hub**. Select **blobreadereventhub** from the dropdown.
217202

@@ -226,9 +211,9 @@ To create an event grid subscription, do the following:
226211

227212
1. Verify the deployment was successful by checking **Notifications** in the top right corner of the Azure Portal.
228213

229-
### Step 3: Enabling VNet Integration (Optional)
214+
## Enabling VNet Integration (Optional)
230215

231-
Assuming you have used the modified template which uses standard/premium plan for BlobTaskConsumer and [DLQTaskConsumer](https://portal.azure.com/#blade/WebsitesExtension/FunctionMenuBlade/resourceId/%2Fsubscriptions%2Fc088dc46-d692-42ad-a4b6-9a542d28ad2a%2FresourceGroups%2Fleast%2Fproviders%2FMicrosoft.Web%2Fsites%2FSUMOBRDLQProcessorekbxzlepnhs4g%2Ffunctions%2FDLQTaskConsumer) functions. This assumes that your storage account access is enabled for selected networks.
216+
This assumes that your storage account access is not public and is enabled for selected networks i.e. your storage account is behind a virtual network. This requires you to used the modified template which uses standard/premium plan for BlobTaskConsumer and DLQTaskConsumer functions. In case you want the whole data pipeline sending logs to sumo logic, to be under a virtual network follow the instruction [here](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/full-vnet-integration.md).
232217

233218
1. Create a subnet in a virtual network using the instructions in the [doc](https://docs.microsoft.com/en-us/azure/virtual-network/virtual-network-manage-subnet#add-a-subnet). If you have multiple accounts in the same region you can skip step 2 below and use the same subnet and add it to the storage account as mentioned in step 3.
234219
1. Perform below steps for both BlobTaskConsumer and [DLQTaskConsumer](https://portal.azure.com/#blade/WebsitesExtension/FunctionMenuBlade/resourceId/%2Fsubscriptions%2Fc088dc46-d692-42ad-a4b6-9a542d28ad2a%2FresourceGroups%2Fleast%2Fproviders%2FMicrosoft.Web%2Fsites%2FSUMOBRDLQProcessorekbxzlepnhs4g%2Ffunctions%2FDLQTaskConsumer) function apps.
244 KB
Loading
88.1 KB
Loading

0 commit comments

Comments
 (0)