Skip to content

Commit dcf6050

Browse files
authored
Merge pull request #217897 from jess-hu-340/1110-update-file-system
[Supportability] Update file system
2 parents f807be3 + 3ee5267 commit dcf6050

File tree

5 files changed

+50
-6
lines changed

5 files changed

+50
-6
lines changed

articles/data-factory/TOC.yml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1199,6 +1199,9 @@ items:
11991199
- name: Dynamics 365, Dataverse (Common Data Service), and Dynamics CRM
12001200
href: connector-troubleshoot-dynamics-dataverse.md
12011201
displayName: troubleshooting
1202+
- name: File System
1203+
href: connector-troubleshoot-file-system.md
1204+
displayName: troubleshooting
12021205
- name: FTP, SFTP, and HTTP
12031206
href: connector-troubleshoot-ftp-sftp-http.md
12041207
displayName: troubleshooting

articles/data-factory/connector-file-system.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ ms.service: data-factory
77
ms.subservice: data-movement
88
ms.custom: synapse
99
ms.topic: conceptual
10-
ms.date: 12/13/2021
10+
ms.date: 11/10/2022
1111
ms.author: jianleishen
1212
---
1313

@@ -34,13 +34,10 @@ This file system connector is supported for the following capabilities:
3434

3535
Specifically, this file system connector supports:
3636

37-
- Copying files from/to local machine or network file share. To use a Linux file share, install [Samba](https://www.samba.org/) on your Linux server.
37+
- Copying files from/to network file share. To use a Linux file share, install [Samba](https://www.samba.org/) on your Linux server.
3838
- Copying files using **Windows** authentication.
3939
- Copying files as-is or parsing/generating files with the [supported file formats and compression codecs](supported-file-formats-and-compression-codecs.md).
4040

41-
> [!NOTE]
42-
> Mapped network drive is not supported when loading data from a network file share. Use the actual path instead e.g. ` \\server\share`.
43-
4441
## Prerequisites
4542

4643
[!INCLUDE [data-factory-v2-integration-runtime-requirements](includes/data-factory-v2-integration-runtime-requirements.md)]
@@ -91,12 +88,15 @@ The following properties are supported for file system linked service:
9188

9289
| Scenario | "host" in linked service definition | "folderPath" in dataset definition |
9390
|:--- |:--- |:--- |
94-
| Local folder on Integration Runtime machine: <br/><br/>Examples: D:\\\* or D:\folder\subfolder\\* |In JSON: `D:\\`<br/>On UI: `D:\` |In JSON: `.\\` or `folder\\subfolder`<br>On UI: `.\` or `folder\subfolder` |
9591
| Remote shared folder: <br/><br/>Examples: \\\\myserver\\share\\\* or \\\\myserver\\share\\folder\\subfolder\\* |In JSON: `\\\\myserver\\share`<br/>On UI: `\\myserver\share` |In JSON: `.\\` or `folder\\subfolder`<br/>On UI: `.\` or `folder\subfolder` |
9692

9793
>[!NOTE]
9894
>When authoring via UI, you don't need to input double backslash (`\\`) to escape like you do via JSON, specify single backslash.
9995
96+
>[!NOTE]
97+
>Copying files from local machine is not supported under Azure Integration Runtime.<br>
98+
>Refer to the command line from [here](create-self-hosted-integration-runtime.md#set-up-an-existing-self-hosted-ir-via-local-powershell) to enable the access to the local machine under Self-hosted integration runtime. By default, it's disabled.
99+
100100
**Example:**
101101

102102
```json
Lines changed: 39 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,39 @@
1+
---
2+
title: Troubleshoot the file system connector
3+
titleSuffix: Azure Data Factory & Azure Synapse
4+
description: Learn how to troubleshoot issues with the file system connector in Azure Data Factory and Azure Synapse Analytics.
5+
author: jianleishen
6+
ms.service: data-factory
7+
ms.subservice: data-movement
8+
ms.topic: troubleshooting
9+
ms.date: 11/23/2022
10+
ms.author: jianleishen
11+
ms.custom: has-adal-ref, synapse
12+
---
13+
14+
# Troubleshoot the file system connector in Azure Data Factory and Azure Synapse
15+
16+
[!INCLUDE[appliesto-adf-asa-md](includes/appliesto-adf-asa-md.md)]
17+
18+
This article provides suggestions to troubleshoot common problems with the file system connector in Azure Data Factory and Azure Synapse.
19+
20+
## Error code: AccessToOnPremFileSystemDenied
21+
22+
- **Message**: `Access to '%path;' is not allowed.`
23+
24+
- **Cause**: Copying files from local machine is not supported under Azure Integration Runtime. For Self-hosted Integration Runtime (versions >= 5.22.8297.1) , Azure Data Factory is introducing a new security control to allow or disallow local SHIR file system access through the connector. By default, it's disabled.
25+
26+
- **Recommendation**: Using command line from [Set up an existing self-hosted IR via local PowerShell](create-self-hosted-integration-runtime.md#set-up-an-existing-self-hosted-ir-via-local-powershell) , you could allow or disallow local SHIR file system access.
27+
28+
29+
## Next steps
30+
31+
For more troubleshooting help, try these resources:
32+
33+
- [Connector troubleshooting guide](connector-troubleshoot-guide.md)
34+
- [Data Factory blog](https://azure.microsoft.com/blog/tag/azure-data-factory/)
35+
- [Data Factory feature requests](/answers/topics/azure-data-factory.html)
36+
- [Azure videos](https://azure.microsoft.com/resources/videos/index/?sort=newest&services=data-factory)
37+
- [Microsoft Q&A page](/answers/topics/azure-data-factory.html)
38+
- [Stack Overflow forum for Data Factory](https://stackoverflow.com/questions/tagged/azure-data-factory)
39+
- [Twitter information about Data Factory](https://twitter.com/hashtag/DataFactory)

articles/data-factory/create-self-hosted-integration-runtime.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -199,6 +199,8 @@ Here are details of the application's actions and arguments:
199199
|`-ssa`,<br/>`-SwitchServiceAccount`|"`<domain\user>`" ["`<password>`"]|Set DIAHostService to run as a new account. Use the empty password "" for system accounts and virtual accounts.|
200200
|`-elma`,<br/>`-EnableLocalMachineAccess`|| Enable local machine access (localhost, private IP) on the current self-hosted IR node. In self-hosted IR High Availability scenario, the action needs to be invoked on every self-hosted IR node.|
201201
|`-dlma`,<br/>`-DisableLocalMachineAccess`|| Disable local machine access (localhost, private IP) on the current self-hosted IR node. In self-hosted IR High Availability scenario, the action needs to be invoked on every self-hosted IR node.|
202+
|`-DisableLocalFolderPathValidation`|| Disable security validation to enable access to file system of the local machine.|
203+
|`-EnableLocalFolderPathValidation`|| Enable security validation to disable access to file system of the local machine. |
202204

203205
## Install and register a self-hosted IR from Microsoft Download Center
204206

7.98 KB
Loading

0 commit comments

Comments
 (0)