Merge pull request #90188 from normesta/normesta-interop

tiburd · web-flow · commit f230621f1e1f · 2019-10-11T14:21:01.000-07:00
Normesta interop
diff --git a/articles/storage/blobs/TOC.yml b/articles/storage/blobs/TOC.yml
@@ -270,7 +270,7 @@
     - name: Create and manage storage accounts
       items:
       - name: Create a general-purpose storage account
-        displayName: resource manager, resource manager template, template, ARM
+        displayName: Resource Manager, Resource Manager template, template, ARM
         href: ../common/storage-quickstart-create-account.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
       - name: Create a block blob storage account
         href: storage-blob-create-account-block-blob.md
@@ -585,8 +585,6 @@
     items:
     - name: Introduction to Data Lake Storage
       href: ../blobs/data-lake-storage-introduction.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
-    - name: Processing big data
-      href: ../blobs/data-lake-storage-data-scenarios.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
   - name: Quickstarts
     items:
     - name: Analyze data with Databricks
@@ -617,6 +615,10 @@
     items:
     - name: Multi-protocol access
       href: ../blobs/data-lake-storage-multi-protocol-access.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
+    - name: Processing big data
+      href: ../blobs/data-lake-storage-data-scenarios.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
+    - name: Integrating with Azure services
+      href: ../blobs/data-lake-store-integrate-with-azure-services.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
     - name: Azure Blob File System driver for Hadoop
       href: ../blobs/data-lake-storage-abfs-driver.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
     - name: Azure Blob File System URI
@@ -693,18 +695,6 @@
             href: ../common/storage-auth-aad-rbac-cli.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
         - name: Set file and directory-level permissions
           href: ../blobs/data-lake-storage-how-to-set-permissions-storage-explorer.md
-    - name: Integrate with Azure services
-      items:
-        - name: Use with HDInsight clusters
-          href: ../../hdinsight/hdinsight-hadoop-use-data-lake-storage-gen2.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
-        - name: Use with Hadoop File System CLI
-          href: ../blobs/data-lake-storage-use-hdfs-data-lake-storage.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
-        - name: Use with Azure Databricks
-          href: https://docs.azuredatabricks.net/spark/latest/data-sources/azure/azure-datalake-gen2.html
-        - name: Use with Azure SQL Data Warehouse
-          href: ../../sql-database/sql-database-vnet-service-endpoint-rule-overview.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json#azure-sql-data-warehouse-polybase   
-        - name: Use with Power BI
-          href: ../blobs/data-lake-storage-use-power-bi.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json   
     - name: Optimize performance
       items:
         - name: Overview
@@ -717,6 +707,8 @@
           href: ../blobs/data-lake-storage-performance-tuning-mapreduce.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
         - name: Optimize Storm on HDInsight
           href: ../blobs/data-lake-storage-performance-tuning-storm.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
+
+      href: ../blobs/data-lake-storage-use-power-bi.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json  
     - name: Manage files (blobs)
       items:
        - name: PowerShell
@@ -729,6 +721,9 @@
           href: ../blobs/data-lake-storage-upgrade.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
         - name: Migrate an on-premises HDFS store
           href: ../blobs/data-lake-storage-migrate-on-premises-HDFS-cluster.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
+    - name: Use with Hadoop File System CLI
+      href: ../blobs/data-lake-storage-use-hdfs-data-lake-storage.md?toc=%2fazure%2fstorage%2fblobs%2ftoc.json
+    - name: Use with Power BI
   - name: Reference
     items:
     - name: PowerShell
diff --git a/articles/storage/blobs/data-lake-storage-data-scenarios.md b/articles/storage/blobs/data-lake-storage-data-scenarios.md
@@ -5,7 +5,7 @@ author: normesta
 ms.subservice: data-lake-storage-gen2
 ms.service: storage
 ms.topic: conceptual
-ms.date: 07/23/2019
+ms.date: 10/11/2019
 ms.author: normesta
 ms.reviewer: stewu
 ---
@@ -21,6 +21,8 @@ There are four key stages in big data processing:
 
 Begin by creating a storage account and a container. Then, grant access to the data. The first few sections of this article help you accomplish those tasks. In the remaining sections, we'll highlight the options and tools for each  processing phase.
 
+For a complete list of Azure services that you can use with Azure Data Lake Storage Gen2, see [Integrate Azure Data Lake Storage with Azure services](data-lake-store-integrate-with-azure-services.md)
+
 ## Create a Data Lake Storage Gen2 account
 
 A Data Lake Storage Gen2 account is a storage account that has a hierarchical namespace. 
@@ -65,7 +67,7 @@ This table shows how to grant access for each Azure service or tool.
 |Storage Explorer| Assign a role to users and groups | [Assign administrator and non-administrator roles to users with Azure Active Directory](https://docs.microsoft.com/azure/active-directory/fundamentals/active-directory-users-assign-role-azure-portal) |
 |AzCopy| Assign a role to users and groups <br>**or**<br> Use a SAS token| [Assign administrator and non-administrator roles to users with Azure Active Directory](https://docs.microsoft.com/azure/active-directory/fundamentals/active-directory-users-assign-role-azure-portal)<br><br>[Easily Create a SAS to Download a File from Azure Storage–Using Azure Storage Explorer](https://blogs.msdn.microsoft.com/jpsanders/2017/10/12/easily-create-a-sas-to-download-a-file-from-azure-storage-using-azure-storage-explorer/)|
 |Apache DistCp | Assign a role to a user-assigned managed identity | [Creating an HDInsight cluster with Data Lake Storage Gen2](https://docs.microsoft.com/azure/hdinsight/hdinsight-hadoop-use-data-lake-storage-gen2) |
-|Azure Data Factory| Assign a role to a user-assigned-managed identity<br>**or**<br> Assing a role to a service principal<br>**or**<br> Use a storage account key | [Linked service properties](https://docs.microsoft.com/azure/data-factory/connector-azure-data-lake-storage#linked-service-properties) |
+|Azure Data Factory| Assign a role to a user-assigned-managed identity<br>**or**<br> Assign a role to a service principal<br>**or**<br> Use a storage account key | [Linked service properties](https://docs.microsoft.com/azure/data-factory/connector-azure-data-lake-storage#linked-service-properties) |
 |Azure HDInsight| Assign a role to a user-assigned managed identity | [Creating an HDInsight cluster with Data Lake Storage Gen2](https://docs.microsoft.com/azure/hdinsight/hdinsight-hadoop-use-data-lake-storage-gen2)|
 |Azure Databricks| Assign a role to a service principal | [How to: Use the portal to create an Azure AD application and service principal that can access resources](https://docs.microsoft.com/azure/active-directory/develop/howto-create-service-principal-portal)|
 
@@ -96,7 +98,7 @@ Here's a list of tools that you can use to ingest ad hoc data.
 
 ### Streamed data
 
-This represents data that can be generated by various sources such as applications, devices, sensors, etc. This data can be ingested into Data Lake Sorage Gen2 by a variety of tools. These tools will usually capture and process the data on an event-by-event basis in real-time, and then write the events in batches into Data Lake Storage Gen2 so that they can be further processed.
+This represents data that can be generated by various sources such as applications, devices, sensors, etc. This data can be ingested into Data Lake Storage Gen2 by a variety of tools. These tools will usually capture and process the data on an event-by-event basis in real-time, and then write the events in batches into Data Lake Storage Gen2 so that they can be further processed.
 
 Here's a list of tools that you can use to ingest streamed data.
 
diff --git a/articles/storage/blobs/data-lake-storage-introduction.md b/articles/storage/blobs/data-lake-storage-introduction.md
@@ -4,7 +4,7 @@ description: Provides an overview of Azure Data Lake Storage Gen2
 author: normesta
 ms.service: storage
 ms.topic: overview
-ms.date: 12/06/2018
+ms.date: 10/11/2019
 ms.author: normesta
 ms.reviewer: jamesbak
 ms.subservice: data-lake-storage-gen2
@@ -60,7 +60,7 @@ The following are the equivalent entities, as described by different concepts. U
 | Concept                                | Top Level Organization | Lower Level Organization                                            | Data Container |
 |----------------------------------------|------------------------|---------------------------------------------------------------------|----------------|
 | Blobs – General purpose object storage | Container              | Virtual directory (SDK only – does not provide atomic manipulation) | Blob           |
-| ADLS Gen2 – Analytics Storage          | Container            | Directory                                                           | File           |
+| Azure Data Lake Storage Gen2 – Analytics Storage          | Container            | Directory                                                           | File           |
 
 ## Supported open source platforms
 
@@ -77,10 +77,15 @@ Several open source platforms support Data Lake Storage Gen2. Those platforms ap
 | [Azure Databricks](https://azure.microsoft.com/services/databricks/) | 5.1+ | [Databricks Runtime versions](https://docs.databricks.com/release-notes/runtime/databricks-runtime-ver.html) |
 |[Hortonworks](https://hortonworks.com/)| 3.1.x++ | [Configuring cloud data access](https://docs.hortonworks.com/HDPDocuments/Cloudbreak/Cloudbreak-2.9.0/cloud-data-access/content/cb_configuring-access-to-adls2.html) |
 
+## Supported Azure services
+
+Data Lake Storage gen2 supports several Azure services that you can use to ingest data, perform analytics, and create visual representations. For a list of supported Azure services, see [Integrate Azure Data Lake Storage with Azure services](data-lake-store-integrate-with-azure-services.md).
+
 ## Next steps
 
 The following articles describe some of the main concepts of Data Lake Storage Gen2 and detail how to store, access, manage, and gain insights from your data:
 
--   [Hierarchical namespace](data-lake-storage-namespace.md)
--   [Create a storage account](data-lake-storage-quickstart-create-account.md)
--   [Use a Data Lake Storage Gen2 account in Azure Databricks](data-lake-storage-quickstart-create-databricks-account.md)
+- [Hierarchical namespace](data-lake-storage-namespace.md)
+- [Create a storage account](data-lake-storage-quickstart-create-account.md)
+- [Multi-protocol access on Azure Data Lake Storage](data-lake-storage-multi-protocol-access.md)
+- [Integrate Azure Data Lake Storage with Azure services](data-lake-store-integrate-with-azure-services.md);
diff --git a/articles/storage/blobs/data-lake-storage-multi-protocol-access.md b/articles/storage/blobs/data-lake-storage-multi-protocol-access.md
@@ -20,7 +20,7 @@ Until recently, you might have had to maintain separate storage solutions for ob
 
 ## Use the entire ecosystem of applications, tools, and services
 
-With multi-protocol access on Data Lake Storage, you can work with all of your data by using the entire ecosystem of tools, applications, and services. This includes Azure services such as [Azure Stream Analytics](https://docs.microsoft.com/azure/stream-analytics/stream-analytics-introduction), [IOT Hub](https://docs.microsoft.com/azure/iot-hub/), [Power BI](https://docs.microsoft.com/power-bi/desktop-data-sources), and many others. 
+With multi-protocol access on Data Lake Storage, you can work with all of your data by using the entire ecosystem of tools, applications, and services. This includes Azure services such as [Azure Stream Analytics](https://docs.microsoft.com/azure/stream-analytics/stream-analytics-introduction), [IOT Hub](https://docs.microsoft.com/azure/iot-hub/), [Power BI](https://docs.microsoft.com/power-bi/desktop-data-sources), and many others. For a complete list, see [Integrate Azure Data Lake Storage with Azure services](data-lake-store-integrate-with-azure-services.md).
 
 This also includes third-party tools and applications. You can point them to accounts that have a hierarchical namespace without having to modify them. These applications work *as is* even if they call Blob APIs, because Blob APIs can now operate on data in accounts that have a hierarchical namespace.
 
diff --git a/articles/storage/blobs/data-lake-store-integrate-with-azure-services.md b/articles/storage/blobs/data-lake-store-integrate-with-azure-services.md
@@ -0,0 +1,39 @@
+---
+title: Integrate Azure Data Lake Storage with Azure services | Microsoft Docs
+description: Learn about which Azure services integrate with Azure Data Lake Storage Gen2.
+author: normesta
+ms.subservice: data-lake-storage-gen2
+ms.service: storage
+ms.topic: conceptual
+ms.date: 10/11/2019
+ms.author: normesta
+
+---
+# Integrate Azure Data Lake Storage with Azure services
+
+You can use Azure services to ingest data, perform analytics, and create visual representations. This article provides a list of supported Azure services and provides you with links to articles that help you to use these services with Azure Data Lake Storage Gen2.
+
+## Azure services that support Azure Data Lake Storage Gen2
+
+The following table lists the Azure services that support Azure Data Lake Storage Gen2.
+
+| Azure service |  Related articles |
+|---------------|-------------------|
+|Azure Data Factory | [Load data into Azure Data Lake Storage Gen2 with Azure Data Factory](https://docs.microsoft.com/azure/data-factory/load-azure-data-lake-storage-gen2?toc=%2fazure%2fstorage%2fblobs%2ftoc.json)|
+|Azure Databricks | [Use with Azure Databricks](https://docs.azuredatabricks.net/data/data-sources/azure/azure-datalake-gen2.html) <br> [Quickstart: Analyze data in Azure Data Lake Storage Gen2 by using Azure Databricks](data-lake-storage-quickstart-create-databricks-account.md) <br>[Tutorial: Extract, transform, and load data by using Azure Databricks](https://docs.microsoft.com/azure/azure-databricks/databricks-extract-load-sql-data-warehouse) <br>[Tutorial: Access Data Lake Storage Gen2 data with Azure Databricks using Spark](data-lake-storage-use-databricks-spark.md) |
+|Azure Event Hubs capture| [Capture events through Azure Event Hubs in Azure Blob Storage or Azure Data Lake Storage](https://docs.microsoft.com/azure/event-hubs/event-hubs-capture-overview)|
+|Azure Logic Apps | [Overview - What is Azure Logic Apps?](https://docs.microsoft.com/azure/logic-apps/logic-apps-overview)|
+|Azure Search | [Searching Blob storage with Azure Search](https://docs.microsoft.com/azure/search/search-blob-storage-integration)|
+|Azure Stream Analytics| [Egress to Azure Data Lake Gen2](https://docs.microsoft.com/azure/stream-analytics/stream-analytics-define-outputs#blob-storage-and-azure-data-lake-gen2) |
+|DataBox|  [Use Azure Data Box to migrate data from an on-premises HDFS store to Azure Storage](data-lake-storage-migrate-on-premises-hdfs-cluster.md)|
+|HDInsight | [Use Azure Data Lake Storage Gen2 with Azure HDInsight clusters](https://docs.microsoft.com/azure/hdinsight/hdinsight-hadoop-use-data-lake-storage-gen2?toc=%2fazure%2fstorage%2fblobs%2ftoc.json)<br>[Using the HDFS CLI with Data Lake Storage Gen2](data-lake-storage-use-hdfs-data-lake-storage.md) <br>[Tutorial: Extract, transform, and load data by using Apache Hive on Azure HDInsight](data-lake-storage-tutorial-extract-transform-load-hive.md) |
+|IOT Hub | [Use IoT Hub message routing to send device-to-cloud messages to different endpoints](https://docs.microsoft.com/azure/iot-hub/iot-hub-devguide-messages-d2c)|
+|Power BI|  [Analyze data in Data Lake Storage Gen2 using Power BI](data-lake-storage-use-power-bi.md) |
+|SQL Data Warehouse | [Use with Azure SQL Data Warehouse](https://docs.microsoft.com/azure/sql-database/sql-database-vnet-service-endpoint-rule-overview?toc=%2fazure%2fstorage%2fblobs%2ftoc.json#azure-sql-data-warehouse-polybase)|
+|SQL Server Integration Services (SSIS) | [Azure Storage connection manager](https://docs.microsoft.com/sql/integration-services/connection-manager/azure-storage-connection-manager?view=sql-server-2017)|
+
+## Next steps
+
+- Learn more about which tools you can use to process data in your data lake. See [Using Azure Data Lake Storage Gen2 for big data requirements](data-lake-storage-data-scenarios.md).
+
+- Learn more about Data Lake Storage Gen2, and how to get started with it. See [Introduction to Azure Data Lake Storage Gen2](data-lake-storage-introduction.md)
