Skip to content

Commit 3563ef1

Browse files
authored
Merge pull request #93812 from normesta/normesta-premium-on-hns
Premium available for Data Lake Storage
2 parents 3e28be3 + 85c3be4 commit 3563ef1

File tree

4 files changed

+102
-46
lines changed

4 files changed

+102
-46
lines changed

articles/storage/blobs/TOC.yml

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -702,8 +702,10 @@
702702
items:
703703
- name: Create
704704
items:
705-
- name: Create a general purpose v2 storage account
705+
- name: Create a storage account (general purpose v2)
706706
href: ../common/storage-account-create.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
707+
- name: Create a storage account (block blob)
708+
href: storage-blob-create-account-block-blob.md
707709
- name: Migrate
708710
items:
709711
- name: Migrate from Data Lake Storage Gen1

articles/storage/blobs/data-lake-storage-known-issues.md

Lines changed: 35 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ author: normesta
55
ms.subservice: data-lake-storage-gen2
66
ms.service: storage
77
ms.topic: conceptual
8-
ms.date: 03/20/2020
8+
ms.date: 05/10/2020
99
ms.author: normesta
1010
ms.reviewer: jamesbak
1111
---
@@ -64,13 +64,12 @@ Unmanaged VM disks are not supported in accounts that have a hierarchical namesp
6464

6565
## Lifecycle management policies
6666

67-
* The deletion of blob snapshots is not yet supported.
67+
The deletion of blob snapshots is not yet supported.
6868

6969
## Archive Tier
7070

7171
There is currently a bug that affects the archive access tier.
7272

73-
7473
## Blobfuse
7574

7675
Blobfuse is not supported.
@@ -104,6 +103,39 @@ Applications that call Blob APIs will likely work.
104103

105104
If [anonymous read access](storage-manage-access-to-resources.md) has been granted to a container, then ACLs have no effect on that container or the files in that container.
106105

106+
## Premium-performance block blob storage accounts
107+
108+
### Diagnostic logs
109+
110+
Diagnostics logs can't yet be enabled by using the Azure portal. You can enable them by using PowerShell. For example:
111+
112+
```powershell
113+
#To login
114+
Connect-AzAccount
115+
116+
#Set default block blob storage account.
117+
Set-AzCurrentStorageAccount -Name premiumGen2Account -ResourceGroupName PremiumGen2Group
118+
119+
#Enable logging
120+
Set-AzStorageServiceLoggingProperty -ServiceType Blob -LoggingOperations read,write,delete -RetentionDays 14
121+
```
122+
123+
### Lifecycle management policies
124+
125+
- Lifecycle management policies aren't yet supported in premium block blob storage accounts.
126+
127+
- Data can't be moved from the premium tier to lower tiers.
128+
129+
- The **Delete Blob** action is currently not supported.
130+
131+
### HDInsight support
132+
133+
When you create a n HDInsight cluster, you can't yet select a block blob storage account that has the hierarchical namespace feature enabled on it. However, you can attach the account to the cluster after you've created it.
134+
135+
### Dremio support
136+
137+
Dremio doesn't yet connect to a block blob storage account that has the hierarchical namespace feature enabled on it.
138+
107139
## Windows Azure Storage Blob (WASB) driver (unsupported with Data Lake Storage Gen2)
108140

109141
Currently, the WASB driver, which was designed to work with the Blob API only, encounters problems in a few common scenarios. Specifically, when it is a client to a hierarchical namespace-enabled storage account. Multi-protocol access on Data Lake Storage won't mitigate these issues.

articles/storage/blobs/data-lake-storage-supported-blob-storage-features.md

Lines changed: 28 additions & 25 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ author: normesta
55
ms.subservice: data-lake-storage-gen2
66
ms.service: storage
77
ms.topic: conceptual
8-
ms.date: 04/03/2020
8+
ms.date: 05/10/2020
99
ms.author: normesta
1010
ms.reviewer: stewu
1111
---
@@ -14,36 +14,39 @@ ms.reviewer: stewu
1414

1515
Blob Storage features such as [diagnostic logging](../common/storage-analytics-logging.md), [access tiers](storage-blob-storage-tiers.md), and [Blob Storage lifecycle management policies](storage-lifecycle-management-concepts.md) now work with accounts that have a hierarchical namespace. Therefore, you can enable hierarchical namespaces on your Blob storage accounts without losing access to these features.
1616

17-
This table lists the Blob storage features that you can use with Azure Data Lake Storage Gen2. The items that appear in these tables will change over time as support continues to expand.
17+
This table lists the Blob storage features that you can use with Azure Data Lake Storage Gen2. The items that appear in these tables will change over time as support continues to expand. To learn more about specific issues associated with the preview status of a feature, see the [Known issues](data-lake-storage-known-issues.md) article.
1818

1919
## Supported Blob storage features
2020

2121
> [!NOTE]
22-
> Support level refers only to how the feature is supported with Data Lake Storage Gen2.
22+
> Support level refers only to how the feature is supported with Data Lake Storage Gen2.
23+
>
24+
> [Premium-performance block blob storage accounts](storage-blob-create-account-block-blob.md) for Data Lake Storage Gen2 are currently in public preview. Support-levels for these types of accounts appear in the **Premium block blob storage accounts** column.
2325
24-
|Blob Storage feature |Support level |Related articles |
26+
|Blob Storage feature |General-purpose V2 storage accounts|Premium block blob storage accounts |Related articles |
2527
|---------------|-------------------|---|
26-
|Hot access tier|Generally available|[Azure Blob storage: hot, cool, and archive access tiers](storage-blob-storage-tiers.md)|
27-
|Cool access tier|Generally available|[Azure Blob storage: hot, cool, and archive access tiers](storage-blob-storage-tiers.md)|
28-
|Events|Generally available|[Reacting to Blob storage events](storage-blob-event-overview.md)|
29-
|Metrics (Classic)|Generally available|[Azure Storage analytics metrics (Classic)](../common/storage-analytics-metrics.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json)|
30-
|Metrics in Azure Monitor|Generally available|[Azure Storage metrics in Azure Monitor](../common/storage-metrics-in-azure-monitor.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json)|
31-
|Blob storage PowerShell commands|Generally available|[Quickstart: Upload, download, and list blobs with PowerShell](storage-quickstart-blobs-powershell.md)|
32-
|Blob storage Azure CLI commands|Generally available|[Quickstart: Create, download, and list blobs with Azure CLI](storage-quickstart-blobs-cli.md)|
33-
|Blob storage APIs|Generally available|[Quickstart: Azure Blob storage client library v12 for .NET](storage-quickstart-blobs-dotnet.md)<br>[Quickstart: Manage blobs with Java v12 SDK](storage-quickstart-blobs-java.md)<br>[Quickstart: Manage blobs with Python v12 SDK](storage-quickstart-blobs-python.md)<br>[Quickstart: Manage blobs with JavaScript v12 SDK in Node.js](storage-quickstart-blobs-nodejs.md)|
34-
|Archive Access Tier|Preview|[Azure Blob storage: hot, cool, and archive access tiers](storage-blob-storage-tiers.md)|
35-
|Lifecycle management policies|Preview|[Manage the Azure Blob storage lifecycle](storage-lifecycle-management-concepts.md)|
36-
|Diagnostic logs|Generally available|[Azure Storage analytics logging](../common/storage-analytics-logging.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json)|
37-
|Change feed|Not yet supported|[Change feed support in Azure Blob storage](storage-blob-change-feed.md)|
38-
|Account failover|Not yet supported|[Disaster recovery and storage account failover](../common/storage-disaster-recovery-guidance.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json)|
39-
|Blob container ACL|Not yet supported|[Set Container ACL](https://docs.microsoft.com/rest/api/storageservices/set-container-acl)|
40-
|Custom domains|Not yet supported|[Map a custom domain to an Azure Blob storage endpoint](storage-custom-domain-name.md)|
41-
|Immutable storage|Not yet supported|[Store business-critical blob data with immutable storage](storage-blob-immutable-storage.md)|
42-
|Snapshots|Not yet supported|[Create and manage a blob snapshot in .NET](storage-blob-snapshots.md)|
43-
|Soft Delete|Not yet supported|[Soft delete for Azure Storage blobs](storage-blob-soft-delete.md)|
44-
|Static websites|Not yet supported|[Static website hosting in Azure Storage](storage-blob-static-website.md)|
45-
|Logging in Azure Monitor|Not yet supported|Not yet available|
46-
|Premium block blobs|Not yet supported|[Create a BlockBlobStorage account](storage-blob-create-account-block-blob.md)|
28+
|Hot access tier|Generally available|Not supported|[Azure Blob storage: hot, cool, and archive access tiers](storage-blob-storage-tiers.md)|
29+
|Cool access tier|Generally available|Not supported|[Azure Blob storage: hot, cool, and archive access tiers](storage-blob-storage-tiers.md)|
30+
|Events|Generally available|Preview|[Reacting to Blob storage events](storage-blob-event-overview.md)|
31+
|Metrics (Classic)|Generally available|Not supported|[Azure Storage analytics metrics (Classic)](../common/storage-analytics-metrics.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json)|
32+
|Metrics in Azure Monitor|Generally available|Preview|[Azure Storage metrics in Azure Monitor](../common/storage-metrics-in-azure-monitor.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json)|
33+
|Blob storage PowerShell commands|Generally available|Preview|[Quickstart: Upload, download, and list blobs with PowerShell](storage-quickstart-blobs-powershell.md)|
34+
|Blob storage Azure CLI commands|Generally available|Preview|[Quickstart: Create, download, and list blobs with Azure CLI](storage-quickstart-blobs-cli.md)|
35+
|Blob storage APIs|Generally available|Preview|[Quickstart: Azure Blob storage client library v12 for .NET](storage-quickstart-blobs-dotnet.md)<br>[Quickstart: Manage blobs with Java v12 SDK](storage-quickstart-blobs-java.md)<br>[Quickstart: Manage blobs with Python v12 SDK](storage-quickstart-blobs-python.md)<br>[Quickstart: Manage blobs with JavaScript v12 SDK in Node.js](storage-quickstart-blobs-nodejs.md)|
36+
|Diagnostic logs|Generally available|Preview <div role="complementary" aria-labelledby="diagnostic-logging"><sup>1</sup></div> |[Azure Storage analytics logging](../common/storage-analytics-logging.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json)|
37+
|Archive Access Tier|Preview|Not supported|[Azure Blob storage: hot, cool, and archive access tiers](storage-blob-storage-tiers.md)|
38+
|Lifecycle management policies|Preview|Not yet supported|[Manage the Azure Blob storage lifecycle](storage-lifecycle-management-concepts.md)|
39+
|Change feed|Not yet supported|Not yet supported|[Change feed support in Azure Blob storage](storage-blob-change-feed.md)|
40+
|Account failover|Not yet supported|Not yet supported|[Disaster recovery and account failover](../common/storage-disaster-recovery-guidance.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json)|
41+
|Blob container ACL|Not yet supported|Not yet supported|[Set Container ACL](https://docs.microsoft.com/rest/api/storageservices/set-container-acl)|
42+
|Custom domains|Not yet supported|Not yet supported|[Map a custom domain to an Azure Blob storage endpoint](storage-custom-domain-name.md)|
43+
|Immutable storage|Not yet supported|Not yet supported|[Store business-critical blob data with immutable storage](storage-blob-immutable-storage.md)|
44+
|Snapshots|Not yet supported|Not yet supported|[Create and manage a blob snapshot in .NET](storage-blob-snapshots.md)|
45+
|Soft Delete|Not yet supported|Not yet supported|[Soft delete for Azure Storage blobs](storage-blob-soft-delete.md)|
46+
|Static websites|Not yet supported|Not yet supported|[Static website hosting in Azure Storage](storage-blob-static-website.md)|
47+
|Logging in Azure Monitor|Not yet supported|Not yet supported|Not yet available|
48+
49+
<div id="diagnostic-logging"><sup>1</sup>For premium block blob storage accounts, diagnostic logs (classic) can't be enabled by using the Azure portal. Enable them by using PowerShell.</div>
4750

4851
## See also
4952

articles/storage/blobs/storage-blob-create-account-block-blob.md

Lines changed: 36 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ services: storage
66

77
ms.service: storage
88
ms.topic: conceptual
9-
ms.date: 03/23/2019
9+
ms.date: 05/10/2020
1010
ms.author: tamram
1111
ms.subservice: blobs
1212
---
@@ -15,7 +15,8 @@ ms.subservice: blobs
1515

1616
The BlockBlobStorage account kind lets you create block blobs with premium performance characteristics. This type of storage account is optimized for workloads with high transactions rates or that require very fast access times. This article shows how to create a BlockBlobStorage account by using the Azure portal, the Azure CLI, or Azure PowerShell.
1717

18-
[!INCLUDE [updated-for-az](../../../includes/storage-data-lake-gen2-support.md)]
18+
> [!NOTE]
19+
> The hierarchical namespace feature in a block blob storage account is in public preview, and is available in the US East, US East 2, US Central, US South Central, US West 2, UK South, Canada Central and Australia East regions. To review limitations, see [Blob storage features available in Azure Data Lake Storage Gen2](data-lake-storage-supported-blob-storage-features.md) and [Known issues](data-lake-storage-known-issues.md). To enroll in the preview, see [this form](https://aka.ms/adlspremiumonboard).
1920
2021
For more information about BlockBlobStorage accounts, see [Azure storage account overview](https://docs.microsoft.com/azure/storage/common/storage-account-overview).
2122

@@ -87,21 +88,21 @@ To create a BlockBlobStorage account in the Azure portal, follow these steps:
8788

8889
1. In the Azure portal, select **All services** > the **Storage** category > **Storage accounts**.
8990

90-
1. Under **Storage accounts**, select **Add**.
91+
2. Under **Storage accounts**, select **Add**.
9192

92-
1. In the **Subscription** field, select the subscription in which to create the storage account.
93+
3. In the **Subscription** field, select the subscription in which to create the storage account.
9394

94-
1. In the **Resource group** field, select an existing resource group or select **Create new**, and enter a name for the new resource group.
95+
4. In the **Resource group** field, select an existing resource group or select **Create new**, and enter a name for the new resource group.
9596

96-
1. In the **Storage account name** field, enter a name for the account. Note the following guidelines:
97+
5. In the **Storage account name** field, enter a name for the account. Note the following guidelines:
9798

9899
- The name must be unique across Azure.
99100
- The name must be between three and 24 characters long.
100101
- The name can include only numbers and lowercase letters.
101102

102-
1. In the **Location** field, select a location for the storage account, or use the default location.
103+
6. In the **Location** field, select a location for the storage account, or use the default location.
103104

104-
1. For the rest of the settings, configure the following:
105+
7. For the rest of the settings, configure the following:
105106

106107
|Field |Value |
107108
|---------|---------|
@@ -111,37 +112,46 @@ To create a BlockBlobStorage account in the Azure portal, follow these steps:
111112

112113
![Shows portal UI to create a block blob storage account](media/storage-blob-create-account-block-blob/create-block-blob-storage-account.png)
113114

114-
1. Select **Review + create** to review the storage account settings.
115+
8. Choose the **Advanced** tab.
115116

116-
1. Select **Create**.
117+
9. If you want to optimize your storage account for data analytics, then set **Hierarchical namespace** to **Enabled**. Otherwise, leave this option set to it's default value.
117118

118-
## [Azure Powershell](#tab/azure-powershell)
119+
To learn more, see [Introduction to Azure Data Lake Storage Gen2](data-lake-storage-introduction.md).
120+
121+
> [!NOTE]
122+
> The hierarchical namespace feature in a block blob storage account is in public preview, and is available in the US East, US East 2, US Central, US South Central, US West 2, UK South, Canada Central and Australia East regions. To review limitations, see [Blob storage features available in Azure Data Lake Storage Gen2](data-lake-storage-supported-blob-storage-features.md) and [Known issues](data-lake-storage-known-issues.md). To enroll in the preview, see [this form](https://aka.ms/adlspremiumonboard).
123+
124+
8. Select **Review + create** to review the storage account settings.
125+
126+
9. Select **Create**.
127+
128+
## [Azure PowerShell](#tab/azure-powershell)
119129

120130
[!INCLUDE [updated-for-az](../../../includes/updated-for-az.md)]
121131

122132
1. Open an elevated Windows PowerShell session (Run as administrator).
123133

124-
1. Run the following command to make sure the latest version of the `Az` PowerShell module is installed.
134+
2. Run the following command to make sure the latest version of the `Az` PowerShell module is installed.
125135

126136
```powershell
127137
Install-Module -Name Az -AllowClobber
128138
```
129139

130-
1. Open a new PowerShell console and sign in with your Azure account.
140+
3. Open a new PowerShell console and sign in with your Azure account.
131141

132142
```powershell
133143
Connect-AzAccount -SubscriptionId <SubscriptionID>
134144
```
135145

136-
1. If needed, create a new resource group. Replace the values in quotations, and run the following command.
146+
4. If needed, create a new resource group. Replace the values in quotations, and run the following command.
137147

138148
```powershell
139149
$resourcegroup = "new_resource_group_name"
140150
$location = "region_name"
141151
New-AzResourceGroup -Name $resourceGroup -Location $location
142152
```
143153

144-
1. Create the BlockBlobStorage account. Replace the values in quotations, and run the following command.
154+
5. Create the BlockBlobStorage account. Replace the values in quotations, and run the following command.
145155

146156
```powershell
147157
$resourcegroup = "resource_group_name"
@@ -150,6 +160,10 @@ To create a BlockBlobStorage account in the Azure portal, follow these steps:
150160
151161
New-AzStorageAccount -ResourceGroupName $resourcegroup -Name $storageaccount -Location $location -Kind "BlockBlobStorage" -SkuName "Premium_LRS"
152162
```
163+
If you want to optimize your storage account for data analytics, then add `-EnableHierarchicalNamespace $True` to the command. To learn more, see [Introduction to Azure Data Lake Storage Gen2](data-lake-storage-introduction.md).
164+
165+
> [!NOTE]
166+
> The hierarchical namespace feature in a block blob storage account is in public preview, and is available in the US East, US East 2, US Central, US South Central, US West 2, UK South, Canada Central and Australia East regions. To review limitations, see [Blob storage features available in Azure Data Lake Storage Gen2](data-lake-storage-supported-blob-storage-features.md) and [Known issues](data-lake-storage-known-issues.md). To enroll in the preview, see [this form](https://aka.ms/adlspremiumonboard).
153167
154168
## [Azure CLI](#tab/azure-cli)
155169

@@ -161,15 +175,15 @@ To create a block blob account by using the Azure CLI, you must first install Az
161175
az login
162176
```
163177

164-
1. If needed, create a new resource group. Replace the values in brackets (including the brackets), and run the following command.
178+
2. If needed, create a new resource group. Replace the values in brackets (including the brackets), and run the following command.
165179

166180
```azurecli
167181
az group create \
168182
--name "<new_resource_group_name>" \
169183
--location "<location>"
170184
```
171185

172-
1. Create the BlockBlobStorage account. Replace the values in brackets (including the brackets), and run the following command.
186+
3. Create the BlockBlobStorage account. Replace the values in brackets (including the brackets), and run the following command.
173187

174188
```azurecli
175189
az storage account create \
@@ -180,6 +194,11 @@ To create a block blob account by using the Azure CLI, you must first install Az
180194
--sku "Premium_LRS"
181195
```
182196

197+
If you want to optimize your storage account for data analytics, then add `--hierarchical-namespace true` to the command. To learn more, see [Introduction to Azure Data Lake Storage Gen2](data-lake-storage-introduction.md).
198+
199+
> [!NOTE]
200+
> The hierarchical namespace feature in a block blob storage account is in public preview, and is available in the US East, US East 2, US Central, US South Central, US West 2, UK South, Canada Central and Australia East regions. To review limitations, see [Blob storage features available in Azure Data Lake Storage Gen2](data-lake-storage-supported-blob-storage-features.md) and [Known issues](data-lake-storage-known-issues.md). To enroll in the preview, see [this form](https://aka.ms/adlspremiumonboard).
201+
183202
---
184203

185204
## Next steps

0 commit comments

Comments
 (0)