You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This article explores common troubleshooting methods for connectors in Azure Data Factory.
18
-
19
+
19
20
20
21
## Azure Blob Storage
21
22
@@ -58,8 +59,8 @@ This article explores common troubleshooting methods for connectors in Azure Dat
58
59
-**Symptoms**: When copying data into Cosmos DB, you hit the following error:
59
60
60
61
```
61
-
Message=Partition range id 0 | Failed to import mini-batch.
62
-
Exception was Message: {"Errors":["Encountered exception while executing function. Exception = Error: {\"Errors\":[\"Unique index constraint violation.\"]}...
62
+
Message=Partition range id 0 | Failed to import mini-batch.
63
+
Exception was Message: {"Errors":["Encountered exception while executing function. Exception = Error: {\"Errors\":[\"Unique index constraint violation.\"]}...
63
64
```
64
65
65
66
- **Cause**: There are two possible causes:
@@ -68,7 +69,7 @@ This article explores common troubleshooting methods for connectors in Azure Dat
68
69
69
70
- If you use **Upsert** as write behavior and you set another unique key to the container, this error means you source data have rows/objects with different IDs but same value for the defined unique key.
70
71
71
-
- **Resolution**:
72
+
- **Resolution**:
72
73
73
74
- For cause1, set **Upsert** as write behavior.
74
75
- For cause 2, make sure each document has different value for defined unique key.
@@ -87,13 +88,13 @@ Cosmos DB calculates RU from [here](../cosmos-db/request-units.md#request-unit-c
87
88
88
89
- **Resolution**: Here are two solutions:
89
90
90
-
1. **Increase the container RU** to bigger value in Cosmos DB, which will improve the copy activity performance, though incur more cost in Cosmos DB.
91
+
1. **Increase the container RU** to bigger value in Cosmos DB, which will improve the copy activity performance, though incur more cost in Cosmos DB.
91
92
92
93
2. Decrease **writeBatchSize** to smaller value (such as 1000) and set **parallelCopies** to smaller value such as 1, which will make copy run performance worse than current but will not incur more cost in Cosmos DB.
93
94
94
95
### Column missing in column mapping
95
96
96
-
- **Symptoms**: When you import schema for Cosmos DB for column mapping, some columns are missing.
97
+
- **Symptoms**: When you import schema for Cosmos DB for column mapping, some columns are missing.
97
98
98
99
- **Cause**: ADF infers the schema from the first 10 Cosmos DB documents. If some columns/properties don't have value in those documents, they won't be detected by ADF thus won't show up.
99
100
@@ -116,7 +117,7 @@ Cosmos DB calculates RU from [here](../cosmos-db/request-units.md#request-unit-c
116
117
- **Cause**: There are two ways to represent UUID in BSON - UuidStardard and UuidLegacy. By default, UuidLegacy is used to read data. You will hit error if your UUID data in MongoDB is UuidStandard.
117
118
118
119
- **Resolution**: In MongoDB connection string, add option "**uuidRepresentation=standard**". For more information, see [MongoDB connection string](connector-mongodb.md#linked-service-properties).
119
-
120
+
120
121
121
122
## Azure Data Lake Storage Gen2
122
123
@@ -161,10 +162,10 @@ Cosmos DB calculates RU from [here](../cosmos-db/request-units.md#request-unit-c
161
162
162
163
### Error message: The remote server returned an error: (403) Forbidden
163
164
164
-
- **Symptoms**: Copy activity fail with the following error:
165
+
- **Symptoms**: Copy activity fail with the following error:
165
166
166
167
```
167
-
Message: The remote server returned an error: (403) Forbidden..
168
+
Message: The remote server returned an error: (403) Forbidden..
168
169
Response details: {"RemoteException":{"exception":"AccessControlException""message":"CREATE failed with error 0x83090aa2 (Forbidden. ACL verification failed. Either the resource does not exist or the user is not authorized to perform the requested operation.)....
169
170
```
170
171
@@ -177,15 +178,15 @@ Cosmos DB calculates RU from [here](../cosmos-db/request-units.md#request-unit-c
177
178
- **Symptoms**: Copy activity fail with the following error:
178
179
179
180
```
180
-
Failed to get access token by using service principal.
181
+
Failed to get access token by using service principal.
181
182
ADAL Error: service_unavailable, The remote server returned an error: (503) Server Unavailable.
182
183
```
183
184
184
185
- **Cause**: When the Service Token Server (STS) owned by Azure Active Directory is not unavailable, i.e., too
185
-
busy to handle requests, it returns an HTTP error 503.
186
+
busy to handle requests, it returns an HTTP error 503.
186
187
187
188
- **Resolution**: Rerun the copy activity after several minutes.
188
-
189
+
189
190
190
191
## Azure SQL Data Warehouse/Azure SQL Database/SQL Server
191
192
@@ -360,7 +361,7 @@ busy to handle requests, it returns an HTTP error 503.
Message=Query aborted-- the maximum reject threshold (0 rows) was reached while reading from an external source: 1 rows rejected out of total 415 rows processed. (/file_name.txt)
364
+
Message=Query aborted-- the maximum reject threshold (0 rows) was reached while reading from an external source: 1 rows rejected out of total 415 rows processed. (/file_name.txt)
364
365
Column ordinal: 18, Expected data type: DECIMAL(x,x), Offending value:..
365
366
```
366
367
@@ -373,9 +374,9 @@ busy to handle requests, it returns an HTTP error 503.
373
374
- **Symptoms**: You copy data into Azure SQL Data Warehouse using PolyBase, and hit the following error:
374
375
375
376
```
376
-
Message=110802;An internal DMS error occurred that caused this operation to fail.
Message: Java exception raised on call to HdfsBridge_CreateRecordReader.
379
380
Java exception message:HdfsBridge::CreateRecordReader - Unexpected error encountered creating the record reader.: Error [HdfsBridge::CreateRecordReader - Unexpected error encountered creating the record reader.] occurred while accessing external file.....
380
381
```
381
382
@@ -412,7 +413,7 @@ busy to handle requests, it returns an HTTP error 503.
412
413
- **Cause**: Azure SQL Data Warehouse hit issue querying the external table in Azure Storage.
413
414
414
415
- **Resolution**: Run the same query in SSMS and check if you see the same result. If yes, open a support ticket to Azure SQL Data Warehouse and provide your SQL DW server and database name to further troubleshoot.
415
-
416
+
416
417
417
418
## Delimited Text Format
418
419
@@ -677,4 +678,3 @@ For more troubleshooting help, try these resources:
Copy file name to clipboardExpand all lines: articles/sql-database/active-directory-interactive-connect-azure-sql-db.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,10 +1,10 @@
1
1
---
2
-
title: ActiveDirectoryInteractive connects to SQL
2
+
title: ActiveDirectoryInteractive connects to SQL
3
3
description: "C# Code example, with explanations, for connecting to Azure SQL Database by using SqlAuthenticationMethod.ActiveDirectoryInteractive mode."
4
4
services: sql-database
5
5
ms.service: sql-database
6
6
ms.subservice: security
7
-
ms.custom: active directory
7
+
ms.custom: active directory, has-adal-ref
8
8
ms.devlang:
9
9
ms.topic: conceptual
10
10
author: GithubMirek
@@ -75,7 +75,7 @@ To register and set necessary permissions for your application:
75
75
76
76
### Set an Azure AD admin for your SQL Database server
77
77
78
-
For your C# program to run, an Azure SQL server admin needs to assign an Azure AD admin for your SQL Database server.
78
+
For your C# program to run, an Azure SQL server admin needs to assign an Azure AD admin for your SQL Database server.
79
79
80
80
On the **SQL Server** page, select **Active Directory admin** > **Set admin**.
81
81
@@ -238,9 +238,9 @@ namespace ADInteractive5
238
238
/// <summary>
239
239
/// SqlAuthenticationProvider - Is a public class that defines 3 different Azure AD
240
240
/// authentication methods. The methods are supported in the new .NET 4.7.2.
241
-
/// .
241
+
/// .
242
242
/// 1. Interactive, 2. Integrated, 3. Password
243
-
/// .
243
+
/// .
244
244
/// All 3 authentication methods are based on the Azure
245
245
/// Active Directory Authentication Library (ADAL) managed library.
Copy file name to clipboardExpand all lines: articles/sql-database/sql-database-aad-authentication-configure.md
+10-10Lines changed: 10 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,8 +4,8 @@ description: Learn how to connect to SQL Database, managed instance, and Azure S
4
4
services: sql-database
5
5
ms.service: sql-database
6
6
ms.subservice: security
7
-
ms.custom: azure-synapse
8
-
ms.devlang:
7
+
ms.custom: azure-synapse, has-adal-ref
8
+
ms.devlang:
9
9
ms.topic: conceptual
10
10
author: GithubMirek
11
11
ms.author: mireks
@@ -19,7 +19,7 @@ This article shows you how to create and populate Azure AD, and then use Azure A
19
19
> [!NOTE]
20
20
> This article applies to Azure SQL server, and to both SQL Database and Azure Synapse. For simplicity, SQL Database is used when referring to both SQL Database and Azure Synapse.
21
21
22
-
> [!IMPORTANT]
22
+
> [!IMPORTANT]
23
23
> Connecting to SQL Server running on an Azure VM is not supported using an Azure Active Directory account. Use a domain Active Directory account instead.
24
24
25
25
## Azure AD authentication methods
@@ -184,7 +184,7 @@ As a best practice for existing Azure AD admins for MI created before GA, and st
184
184
- If an Azure AD login exists in the master database for MI, created using the T-SQL command `CREATE LOGIN [myaadaccount] FROM EXTERNAL PROVIDER`,
185
185
it can't be set up as an Azure AD admin for MI. You'll experience an error setting the login as an Azure AD admin using the Azure portal, PowerShell, or CLI commands to create the Azure AD login.
186
186
- The login must be dropped in the master database using the command `DROP LOGIN [myaadaccount]`, before the account can be created as an Azure AD admin.
187
-
- Set up the Azure AD admin account in the Azure portal after the `DROP LOGIN` succeeds.
187
+
- Set up the Azure AD admin account in the Azure portal after the `DROP LOGIN` succeeds.
188
188
- If you can't set up the Azure AD admin account, check in the master database of the managed instance for the login. Use the following command: `SELECT * FROM sys.server_principals`
189
189
- Setting up an Azure AD admin for MI will automatically create a login in the master database for this account. Removing the Azure AD admin will automatically drop the login from the master database.
190
190
@@ -271,11 +271,11 @@ The following two procedures show you how to provision an Azure Active Directory
271
271
272
272
4. In the **Active Directory admin** page, select **Set admin**.
273
273
274
-

274
+

275
275
276
276
5. In the **Add admin** page, search for a user, select the user or group to be an administrator, and then select **Select**. (The Active Directory admin page shows all members and groups of your Active Directory. Users or groups that are grayed out cannot be selected because they are not supported as Azure AD administrators. (See the list of supported admins in the **Azure AD Features and Limitations** section of [Use Azure Active Directory Authentication for authentication with SQL Database or Azure Synapse](sql-database-aad-authentication.md).) Role-based access control (RBAC) applies only to the portal and is not propagated to SQL Server.
277
277
278
-

278
+

279
279
280
280
6. At the top of the **Active Directory admin** page, select **SAVE**.
281
281
@@ -437,7 +437,7 @@ A federated domain user account that is imported into a managed domain as an ext
437
437
> [!NOTE]
438
438
> Azure AD users are marked in the database metadata with type E (EXTERNAL_USER) and for groups with type X (EXTERNAL_GROUPS). For more information, see [sys.database_principals](https://msdn.microsoft.com/library/ms187328.aspx).
439
439
440
-
## Connect to the user database or Azure Synapse by using SSMS or SSDT
440
+
## Connect to the user database or Azure Synapse by using SSMS or SSDT
441
441
442
442
To confirm the Azure AD administrator is properly set up, connect to the **master** database using the Azure AD administrator account.
443
443
To provision an Azure AD-based contained database user (other than the server administrator that owns the database), connect to the database with an Azure AD identity that has access to the database.
@@ -447,7 +447,7 @@ To provision an Azure AD-based contained database user (other than the server ad
447
447
448
448
## Using an Azure AD identity to connect using SSMS or SSDT
449
449
450
-
The following procedures show you how to connect to a SQL database with an Azure AD identity using SQL Server Management Studio or SQL Server Database Tools.
450
+
The following procedures show you how to connect to a SQL database with an Azure AD identity using SQL Server Management Studio or SQL Server Database Tools.
451
451
452
452
### Active Directory integrated authentication
453
453
@@ -457,7 +457,7 @@ Use this method if you are logged into Windows using your Azure Active Directory
457
457
458
458
![Select AD Integrated Authentication][11]
459
459
460
-
2. Select the **Options** button, and on the **Connection Properties** page, in the **Connect to database** box, type the name of the user database you want to connect to. For more information, see the article [Multi-factor AAD auth](sql-database-ssms-mfa-authentication.md#azure-ad-domain-name-or-tenant-id-parameter) on the differences between the Connection Properties for SSMS 17.x and 18.x.
460
+
2. Select the **Options** button, and on the **Connection Properties** page, in the **Connect to database** box, type the name of the user database you want to connect to. For more information, see the article [Multi-factor AAD auth](sql-database-ssms-mfa-authentication.md#azure-ad-domain-name-or-tenant-id-parameter) on the differences between the Connection Properties for SSMS 17.x and 18.x.
461
461
462
462
![Select the database name][13]
463
463
@@ -547,7 +547,7 @@ The following statements, connect using version 13.1 of sqlcmd, which is availab
547
547
> `sqlcmd` with the `-G` command does not work with system identities, and requires a user principal login.
0 commit comments