Skip to content

Commit 641704e

Browse files
authored
Merge pull request #102148 from normesta/normesta-adlsgen2
Streamlining the Data Lake TOC
2 parents df3d917 + dd94c37 commit 641704e

11 files changed

+92
-418
lines changed

.openpublishing.redirection.json

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -45180,6 +45180,16 @@
4518045180
"redirect_url": "/azure/storage/common/storage-security-guide",
4518145181
"redirect_document_id": false
4518245182
},
45183+
{
45184+
"source_path": "articles/storage/blobs/data-lake-storage-quickstart-create-account.md",
45185+
"redirect_url": "/azure/storage/common/storage-account-create",
45186+
"redirect_document_id": false
45187+
},
45188+
{
45189+
"source_path": "articles/storage/blobs/data-lake-storage-how-to-set-permissions-storage-explorer.md",
45190+
"redirect_url": "/azure/storage/blobs/data-lake-storage-explorer",
45191+
"redirect_document_id": false
45192+
},
4518345193
{
4518445194
"source_path": "articles/security/fundamentals/global-admin.md",
4518545195
"redirect_url": "/azure/active-directory/authentication/multi-factor-authentication",

articles/storage/blobs/TOC.yml

Lines changed: 12 additions & 111 deletions
Original file line numberDiff line numberDiff line change
@@ -619,18 +619,6 @@
619619
items:
620620
- name: Analyze data with Databricks
621621
href: ../blobs/data-lake-storage-quickstart-create-databricks-account.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
622-
- name: Manage blobs without code
623-
items:
624-
- name: PowerShell
625-
href: storage-quickstart-blobs-powershell.md
626-
- name: CLI
627-
href: storage-quickstart-blobs-cli.md
628-
- name: Develop with blobs
629-
items:
630-
- name: .NET
631-
href: storage-quickstart-blobs-dotnet.md
632-
- name: Python
633-
href: storage-quickstart-blobs-python.md
634622
- name: Tutorials
635623
items:
636624
- name: Extract, transform, and load data using Azure Databricks
@@ -657,36 +645,12 @@
657645
href: ../blobs/data-lake-storage-namespace.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
658646
- name: Best practices
659647
href: data-lake-storage-best-practices.md
660-
- name: Access tiers
661-
items:
662-
- name: Access tiers
663-
href: storage-blob-storage-tiers.md
664-
- name: Managing the Azure Blob Storage Lifecycle
665-
href: storage-lifecycle-management-concepts.md
666-
- name: Security
667-
items:
668-
- name: Storage security overview
669-
href: ../blobs/security-recommendations.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
670-
- name: Access control
671-
href: data-lake-storage-access-control.md
672-
- name: Logging
673-
items:
674-
- name: Storage analytics
675-
href: ../common/storage-analytics.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
676-
- name: Storage analytics logs
677-
href: ../common/storage-analytics-logging.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
678-
- name: Event handling
679-
href: storage-blob-event-overview.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
648+
- name: Access control (directories and files)
649+
href: data-lake-storage-access-control.md
680650
- name: How to
681651
items:
682-
- name: Create and manage storage accounts
683-
items:
684-
- name: Create a storage account for your Data Lake
685-
href: ../blobs/data-lake-storage-quickstart-create-account.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
686-
- name: Manage data with Storage Explorer
687-
href: ../blobs/data-lake-storage-explorer.md
688-
- name: Upgrade a storage account
689-
href: ../common/storage-account-upgrade.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
652+
- name: Create a storage account for your Data Lake
653+
href: ../common/storage-account-create.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
690654
- name: Manage directories, files, and ACLs
691655
items:
692656
- name: .NET
@@ -700,43 +664,7 @@
700664
- name: CLI
701665
href: data-lake-storage-directory-file-acl-cli.md
702666
- name: Storage Explorer
703-
href: data-lake-storage-how-to-set-permissions-storage-explorer.md
704-
- name: Transfer data
705-
items:
706-
- name: AzCopy
707-
items:
708-
- name: Get started
709-
href: ../common/storage-use-azcopy-v10.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
710-
- name: Use with Data Lake Storage Gen2
711-
href: ../common/storage-use-azcopy-blobs.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
712-
- name: Configure, optimize, troubleshoot
713-
href: ../common/storage-use-azcopy-configure.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
714-
- name: Use Distcp
715-
href: ../blobs/data-lake-storage-use-distcp.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
716-
- name: Use Azure Data Factory
717-
href: ../../data-factory/load-azure-data-lake-storage-gen2.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
718-
- name: Secure data
719-
items:
720-
- name: Configure firewalls and virtual networks
721-
href: ../common/storage-network-security.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
722-
- name: Configure customer-managed keys for service encryption
723-
items:
724-
- name: Portal
725-
href: ../common/storage-encryption-keys-portal.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
726-
- name: PowerShell
727-
href: ../common/storage-encryption-keys-powershell.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
728-
- name: Azure CLI
729-
href: ../common/storage-encryption-keys-cli.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
730-
- name: Manage access rights with RBAC
731-
items:
732-
- name: Portal
733-
href: ../common/storage-auth-aad-rbac-portal.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
734-
- name: PowerShell
735-
href: ../common/storage-auth-aad-rbac-powershell.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
736-
- name: Azure CLI
737-
href: ../common/storage-auth-aad-rbac-cli.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
738-
- name: Set file and directory-level permissions
739-
href: ../blobs/data-lake-storage-how-to-set-permissions-storage-explorer.md
667+
href: data-lake-storage-explorer.md
740668
- name: Optimize performance
741669
items:
742670
- name: Overview
@@ -761,43 +689,16 @@
761689
href: ../blobs/data-lake-storage-use-power-bi.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
762690
- name: Reference
763691
items:
764-
- name: PowerShell
765-
href: /powershell/module/azure.storage
766-
- name: Azure CLI
767-
href: /cli/azure/storage
768692
- name: .NET
769-
items:
770-
- name: Blobs (version 12.x)
771-
href: /dotnet/api/azure.storage.blobs
772-
- name: Data Movement
773-
href: /dotnet/api/microsoft.azure.storage.datamovement
774-
- name: Storage Resource Provider
775-
href: /dotnet/api/overview/azure/storage/management
693+
href: /dotnet/api/azure.storage.files.datalake
776694
- name: Java
777-
items:
778-
- name: Blobs (version 12.x)
779-
href: https://azuresdkdocs.blob.core.windows.net/$web/java/azure-storage-blob/12.0.0/index.html
780-
- name: Blobs (version 8.x)
781-
href: /java/api/com.microsoft.azure.storage.blob
782-
- name: Storage Resource Provider
783-
href: /java/api/overview/azure/storage/management
784-
- name: JavaScript (version 12.x)
785-
href: /javascript/api/@azure/storage-blob/
786-
- name: Python (version 12.x)
787-
href: /python/api/azure-storage-blob/
695+
href: https://azuresdkdocs.blob.core.windows.net/$web/java/azure-storage-file-datalake/12.0.0-preview.6/index.html
696+
- name: Python
697+
href: https://azuresdkdocs.blob.core.windows.net/$web/python/azure-storage-file-datalake/12.0.0b5/index.html
698+
- name: Javascript
699+
href: https://www.npmjs.com/package/@azure/storage-file-datalake/v/12.0.0-preview.6
788700
- name: REST
789-
items:
790-
- name: Blobs, Queues, Tables, and Files
791-
href: /rest/api/storageservices
792-
- name: Data Lake Storage Gen2
793-
href: /rest/api/storageservices/data-lake-storage-gen2
794-
- name: Resource provider
795-
href: /rest/api/storagerp
796-
- name: Import/Export
797-
href: /rest/api/storageimportexport
798-
- name: Resource Manager template
799-
displayName: ARM
800-
href: /azure/templates/microsoft.storage/allversions
701+
href: /rest/api/storageservices/data-lake-storage-gen2
801702
- name: Resources
802703
items:
803704
- name: Known issues
Lines changed: 55 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -1,32 +1,35 @@
11
---
22
title: 'Use Azure Storage Explorer with Azure Data Lake Storage Gen2'
3-
description: Learn how to use Azure Storage Explorer to create a file system in an Azure Data Lake Storage Gen2 account, as well as a directory and a file. Next, you learn how to download the file to your local computer, and how to view all of the file in a directory.
3+
description: Use the Azure Storage Explorer to manage directories and file and directory access control lists (ACL) in storage accounts that has hierarchical namespace (HNS) enabled.
44
author: normesta
55
ms.subservice: data-lake-storage-gen2
66
ms.service: storage
77
ms.topic: conceptual
8-
ms.date: 11/19/2019
8+
ms.date: 01/23/2019
99
ms.author: normesta
1010
ms.reviewer: stewu
1111
---
1212

13-
# Use Azure Storage Explorer with Azure Data Lake Storage Gen2
13+
# Use Azure Storage Explorer to manage directories, files, and ACLs in Azure Data Lake Storage Gen2
1414

15-
In this article, you'll learn how to use [Azure Storage Explorer](https://azure.microsoft.com/features/storage-explorer/) to create a directory and a blob. Next, you learn how to download the blob to your local computer, and how to view all of the blobs in a directory. You also learn how to create a snapshot of a blob, manage directory access policies, and create a shared access signature.
15+
This article shows you how to use [Azure Storage Explorer](https://azure.microsoft.com/features/storage-explorer/) to create and manage directories, files, and permissions in storage accounts that has hierarchical namespace (HNS) enabled.
1616

1717
## Prerequisites
1818

19-
[!INCLUDE [storage-quickstart-prereq-include](../../../includes/storage-quickstart-prereq-include.md)]
20-
21-
This quickstart requires that you install Azure Storage Explorer. To install Azure Storage Explorer for Windows, Macintosh, or Linux, see [Azure Storage Explorer](https://azure.microsoft.com/features/storage-explorer/).
19+
> [!div class="checklist"]
20+
> * An Azure subscription. See [Get Azure free trial](https://azure.microsoft.com/pricing/free-trial/).
21+
> * A storage account that has hierarchical namespace (HNS) enabled. Follow [these](data-lake-storage-quickstart-create-account.md) instructions to create one.
22+
> * Azure Storage Explorer installed on your local computer. To install Azure Storage Explorer for Windows, Macintosh, or Linux, see [Azure Storage Explorer](https://azure.microsoft.com/features/storage-explorer/).
2223
2324
## Sign in to Storage Explorer
2425

25-
On first launch, the **Microsoft Azure Storage Explorer - Connect** window is shown. While Storage Explorer provides several ways to connect to storage accounts, only one way is currently supported for managing ACLs.
26+
When you first start Storage Explorer, the **Microsoft Azure Storage Explorer - Connect** window appears. While Storage Explorer provides several ways to connect to storage accounts, only one way is currently supported for managing ACLs.
2627

2728
|Task|Purpose|
2829
|---|---|
29-
|Add an Azure Account | Redirects you to your organizations login page to authenticate you to Azure. Currently this is the only supported authentication method if you want to manage and set ACLs. |
30+
|Add an Azure Account | Redirects you to your organization's sign-in page to authenticate you to Azure. Currently this is the only supported authentication method if you want to manage and set ACLs.|
31+
|Use a connection string or shared access signature URI | Can be used to directly access a container or storage account with a SAS token or a shared connection string. |
32+
|Use a storage account name and key| Use the storage account name and key of your storage account to connect to Azure storage.|
3033

3134
Select **Add an Azure Account** and click **Sign in..**. Follow the on-screen prompts to sign into your Azure account.
3235

@@ -38,41 +41,69 @@ When it completes connecting, Azure Storage Explorer loads with the **Explorer**
3841

3942
## Create a container
4043

41-
Blobs are always uploaded into a directory. This allows you to organize groups of blobs like you organize your files on your computer in folders.
42-
43-
To create a directory, expand the storage account you created in the proceeding step. Select **Blob container**, right-click and select **Create Blob container**. Enter the name for your container. When complete, press **Enter** to create the container. Once the blob directory has been successfully created, it is displayed under the **Blob container** folder for the selected storage account.
44+
A container holds directories and files. To create one, expand the storage account you created in the proceeding step. Select **Blob Containers**, right-click and select **Create Blob Container**. Enter the name for your container. See the [Create a container](storage-quickstart-blobs-dotnet.md#create-a-container) section for a list of rules and restrictions on naming containers. When complete, press **Enter** to create the container. Once the container has been successfully created, it is displayed under the **Blob Containers** folder for the selected storage account.
4445

45-
![Microsoft Azure Storage Explorer - Creating a container](media/storage-quickstart-blobs-storage-explorer/creating-a-filesystem.png)
46+
![Microsoft Azure Storage Explorer - Creating a container](media/data-lake-storage-explorer/creating-a-filesystem.png)
4647

47-
## Upload blobs to the directory
48+
## Create a directory
4849

49-
Blob storage supports block blobs, append blobs, and page blobs. VHD files used to back IaaS VMs are page blobs. Append blobs are used for logging, such as when you want to write to a file and then keep adding more information. Most files stored in Blob storage are block blobs.
50+
To create a directory, select the container that you created in the proceeding step. In the container ribbon, choose the **New Folder** button. Enter the name for your directory. When complete, press **Enter** to create the directory. Once the directory has been successfully created, it appears in the editor window.
5051

51-
On the directory ribbon, select **Upload**. This operation gives you the option to upload a folder or a file.
52+
![Microsoft Azure Storage Explorer - Creating a directory](media/data-lake-storage-explorer/creating-a-directory.png)
5253

53-
Choose the files or folder to upload. Select the **blob type**. Acceptable choices are **Append**, **Page**, or **Block** blob.
54+
## Upload blobs to the directory
5455

55-
If uploading a .vhd or .vhdx file, choose **Upload .vhd/.vhdx files as page blobs (recommended)**.
56+
On the directory ribbon, chose the **Upload** button. This operation gives you the option to upload a folder or a file.
5657

57-
In the **Upload to folder (optional)** field either a folder name to store the files or folders in a folder under the directory. If no folder is chosen, the files are uploaded directly under the directory.
58+
Choose the files or folder to upload.
5859

59-
![Microsoft Azure Storage Explorer - upload a blob](media/storage-quickstart-blobs-storage-explorer/uploadblob.png)
60+
![Microsoft Azure Storage Explorer - upload a blob](media/data-lake-storage-explorer/upload-file.png)
6061

6162
When you select **OK**, the files selected are queued to upload, each file is uploaded. When the upload is complete, the results are shown in the **Activities** window.
6263

6364
## View blobs in a directory
6465

6566
In the **Azure Storage Explorer** application, select a directory under a storage account. The main pane shows a list of the blobs in the selected directory.
6667

67-
![Microsoft Azure Storage Explorer - list blobs in a directory](media/storage-quickstart-blobs-storage-explorer/listblobs.png)
68+
![Microsoft Azure Storage Explorer - list blobs in a directory](media/data-lake-storage-explorer/list-files.png)
6869

6970
## Download blobs
7071

71-
To download blobs using **Azure Storage Explorer**, with a blob selected, select **Download** from the ribbon. A file dialog opens and provides you the ability to enter a file name. Select **Save** to start the download of a blob to the local location.
72+
To download files by using **Azure Storage Explorer**, with a file selected, select **Download** from the ribbon. A file dialog opens and provides you the ability to enter a file name. Select **Save** to start the download of a file to the local location.
73+
74+
## Managing access
75+
76+
You can set permissions at the root of your container. To do so, you must be logged into Azure Storage Explorer with your individual account with rights to do so (as opposed to with a connection string). Right-click your container and select **Manage Permissions**, bringing up the **Manage Permission** dialog box.
77+
78+
![Microsoft Azure Storage Explorer - Manage directory access](media/storage-quickstart-blobs-storage-Explorer/manageperms.png)
79+
80+
The **Manage Permission** dialog box allows you to manage permissions for owner and the owners group. It also allows you to add new users and groups to the access control list for whom you can then manage permissions.
81+
82+
To add a new user or group to the access control list, select the **Add user or group** field.
83+
84+
Enter the corresponding Azure Active Directory (AAD) entry you wish to add to the list and then select **Add**.
85+
86+
The user or group will now appear in the **Users and groups:** field, allowing you to begin managing their permissions.
87+
88+
> [!NOTE]
89+
> It is a best practice, and recommended, to create a security group in AAD and maintain permissions on the group rather than individual users. For details on this recommendation, as well as other best practices, see [best practices for Data Lake Storage Gen2](data-lake-storage-best-practices.md).
90+
91+
There are two categories of permissions you can assign: access ACLs and default ACLs.
92+
93+
* **Access**: Access ACLs control access to an object. Files and directories both have access ACLs.
94+
95+
* **Default**: A template of ACLs associated with a directory that determines the access ACLs for any child items that are created under that directory. Files do not have default ACLs.
96+
97+
Within both of these categories, there are three permissions you can then assign on files or directories: **Read**, **Write**, and **Execute**.
98+
99+
>[!NOTE]
100+
> Making selections here will not set permissions on any currently existing item inside the directory. You must go to each individual item and set the permissions manually, if the file already exists.
101+
102+
You can manage permissions on individual directories, as well as individual files, which are what allows you fine grained access control. The process for managing permissions for both directories and files is the same as described above. Right-click the file or directory you wish to manage permissions on and follow the same process.
72103

73104
## Next steps
74105

75-
In this quickstart, you learned how to transfer files between a local disk and Azure Blob storage using **Azure Storage Explorer**. To learn about how to set ACLs on your files and directories, continue to our How-to on the subject.
106+
Learn access control lists in Data Lake Storage Gen2.
76107

77108
> [!div class="nextstepaction"]
78-
> [How to set ACLs on files and directories](data-lake-storage-how-to-set-permissions-storage-explorer.md)
109+
> [Access control in Azure Data Lake Storage Gen2](https://docs.microsoft.com/azure/storage/blobs/data-lake-storage-access-control)

0 commit comments

Comments
 (0)