Skip to content

Commit 17e7fe4

Browse files
author
helenz-msft
committed
updated with new template
1 parent 25064f3 commit 17e7fe4

23 files changed

+192
-53
lines changed
Lines changed: 114 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,114 @@
1+
---
2+
title: Linking Tables in OneLake to Azure Machine Learning Through UI
3+
titleSuffix: Azure Machine Learning, Microsoft Fabric
4+
description: Learn how to link table in Lakehouse to Azure Machine Learning studio through UI.
5+
services: machine-learning
6+
ms.service: azure-machine-learning
7+
ms.subservice: mldata
8+
ms.topic: how-to
9+
ms.author: helenzeng
10+
author: helenzusa1
11+
ms.reviewer: franksolomon
12+
ms.date: 02/11/2025
13+
ms.custom: data4ml
14+
# Customer intent: They have some Tables in OneLake, they want to use Azure ML studio for ML activities, so they need to link the Tables in AML, and they prefer to do it through UI.
15+
---
16+
17+
# Introduction of the solution
18+
There were some existing solutions which can build a link in Azure Machine Learning to OneLake, get the data, and create a datastore in AML. However, in those solutions, the data in OneLake is of type "Files. Refer to the reference section. Some customers have data in OneLake as type "Tables." The existing solutions creating datastore in AML don’t work.
19+
20+
:::image type="content" source="media/create-datastore-with-UI/1-table-in-fabric.png" alt-text="Screenshot that shows how the table looks like in Microsoft Fabric." lightbox="./media/create-datastore-with-UI/1-table-in-fabric.png":::
21+
22+
Also some customers prefer doing in UI. Therefore, a new solution is needed to link AML to Tables in OneLake using UI.
23+
24+
In this article, you learn how to link tables in OneLake to Azure Machine Learning studio through UI.
25+
26+
## Overall idea
27+
28+
:::image type="content" source="media/create-datastore-with-UI/2-overall-idea.png" alt-text="Screenshot that shows overall idea." lightbox="./media/create-datastore-with-UI/2-overall-idea.png":::
29+
30+
31+
## Step 1. Create data lake storage account in Azure portal
32+
33+
:::image type="content" source="media/create-datastore-with-UI/3-create-storage-account.png" alt-text="Screenshot that shows an example of data lake storage account in Azure portal." lightbox="./media/create-datastore-with-UI/3-create-storage-account.png":::
34+
35+
## Step 2. Enable storage account key access
36+
37+
:::image type="content" source="media/create-datastore-with-UI/4-enable-key-access.png" alt-text="Screenshot that shows how to enable key access of data lake storage account in Azure portal." lightbox="./media/create-datastore-with-UI/4-enable-key-access.png":::
38+
39+
## Step 3. Assign roles to the storage account
40+
41+
:::image type="content" source="media/create-datastore-with-UI/5-assign-roles.png" alt-text="Screenshot that shows how to assign roles of data lake storage account in Azure portal." lightbox="./media/create-datastore-with-UI/5-assign-roles.png":::
42+
43+
## Step 4. Create a container
44+
45+
:::image type="content" source="media/create-datastore-with-UI/6-create-container.png" alt-text="Screenshot that shows how to create a container of data lake storage account in Azure portal." lightbox="./media/create-datastore-with-UI/6-create-container.png":::
46+
47+
## Step 5. In Fabric, create a pipeline
48+
49+
:::image type="content" source="media/create-datastore-with-UI/7-create-pipeline.png" alt-text="Screenshot that shows how to create a data pipeline in Fabric." lightbox="./media/create-datastore-with-UI/7-create-pipeline.png":::
50+
51+
## Step 6. With the pipeline, start the 'Copy data assistant'
52+
53+
:::image type="content" source="media/create-datastore-with-UI/8-copy-data-assistant.png" alt-text="Screenshot that shows how to start Copy data assistant in Fabric." lightbox="./media/create-datastore-with-UI/8-copy-data-assistant.png":::
54+
55+
## Step 7. In the 'Copy data assistant,' select Azure Blobs
56+
57+
:::image type="content" source="media/create-datastore-with-UI/9-select-azure-blob.png" alt-text="Screenshot that shows how to select Azure blobs in Copy data assistant in Fabric." lightbox="./media/create-datastore-with-UI/9-select-azure-blob.png":::
58+
59+
## Step 8. Set storage account, create connection
60+
61+
:::image type="content" source="media/create-datastore-with-UI/10-create-connection.png" alt-text="Screenshot that shows how to create connection in Fabric data pipeline." lightbox="./media/create-datastore-with-UI/10-create-connection.png":::
62+
63+
## Step 9. Select destination folder
64+
65+
:::image type="content" source="media/create-datastore-with-UI/11-select-destination-folder.png" alt-text="Screenshot that shows how to select destination folder." lightbox="./media/create-datastore-with-UI/11-select-destination-folder.png":::
66+
67+
## Step 10. Connect to data destination
68+
69+
:::image type="content" source="media/create-datastore-with-UI/12-connect-data-destination.png" alt-text="Screenshot that shows how to connect to data destination." lightbox="./media/create-datastore-with-UI/12-connect-data-destination.png":::
70+
71+
## Step 11. Copy activity is scheduled
72+
73+
:::image type="content" source="media/create-datastore-with-UI/13-copy-activity-scheduled.png" alt-text="Screenshot that shows the copy activity is scheduled." lightbox="./media/create-datastore-with-UI/13-copy-activity-scheduled.png":::
74+
75+
## Step 12. Copy success
76+
77+
:::image type="content" source="media/create-datastore-with-UI/14-copy-activity-success.png" alt-text="Screenshot that shows the copy is successful." lightbox="./media/create-datastore-with-UI/14-copy-activity-success.png":::
78+
79+
## Step 13. Check storage account, container in Azure portal
80+
81+
:::image type="content" source="media/create-datastore-with-UI/15-check-container.png" alt-text="Screenshot that shows how to verify the data in Azure storage account container." lightbox="./media/create-datastore-with-UI/15-check-container.png":::
82+
83+
## Step 14. In ML studio create data asset, type 'File'
84+
85+
:::image type="content" source="media/create-datastore-with-UI/16-create-data-asset.png" alt-text="Screenshot that shows how to create a data asset in Azure Machine Learning studio." lightbox="./media/create-datastore-with-UI/16-create-data-asset.png":::
86+
87+
## Step 15. Select 'From Azure storage'
88+
89+
:::image type="content" source="media/create-datastore-with-UI/17-select-azure-storage.png" alt-text="Screenshot that shows how to select Azure storage." lightbox="./media/create-datastore-with-UI/17-select-azure-storage.png":::
90+
91+
## Step 16. Create a 'New datastore'
92+
93+
:::image type="content" source="media/create-datastore-with-UI/18-new-datastore.png" alt-text="Screenshot that shows how to create new datastore in Azure Machine Learning." lightbox="./media/create-datastore-with-UI/18-new-datastore.png":::
94+
95+
## Step 17. Or you can directly 'Create datastore' from the beginning
96+
97+
:::image type="content" source="media/create-datastore-with-UI/19-create-datastore.png" alt-text="Screenshot that shows how to create a datastore in Azure Machine Learning." lightbox="./media/create-datastore-with-UI/19-create-datastore.png":::
98+
99+
## Step 18. Datastore is created
100+
101+
:::image type="content" source="media/create-datastore-with-UI/20-datastore-created.png" alt-text="Screenshot that shows the datastore looks like after creation." lightbox="./media/create-datastore-with-UI/20-datastore-created.png":::
102+
103+
## Step 19. Access the datastore
104+
105+
:::image type="content" source="media/create-datastore-with-UI/21-access-datastore.png" alt-text="Screenshot that shows how to access a datastore in Azure Machine Learning." lightbox="./media/create-datastore-with-UI/21-access-datastore.png":::
106+
107+
## References
108+
109+
- https://community.fabric.microsoft.com/t5/Data-Engineering/Read-from-a-specified-table-from-lakehouse-in-One-workspace/m-p/4234885
110+
- https://fabric.guru/delta-lake-tables-for-optimal-direct-lake-performance-in-fabric-python-notebook
111+
- https://learn.microsoft.com/en-us/azure/machine-learning/how-to-datastore?view=azureml-api-2&tabs=sdk-identity-based-access%2Csdk-adls-identity-access%2Csdk-azfiles-accountkey%2Csdk-adlsgen1-identity-access%2Csdk-onelake-identity-access#create-a-onelake-microsoft-fabric-datastore-preview
112+
- https://learn.microsoft.com/en-us/fabric/data-engineering/spark-data-warehouse-connector
113+
- https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-abfs-driver
114+
- https://github.com/azeltov/aml_one_lake

0 commit comments

Comments
 (0)