You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/synapse-analytics/synapse-link/faq.yml
+12-8Lines changed: 12 additions & 8 deletions
Original file line number
Diff line number
Diff line change
@@ -7,7 +7,7 @@ metadata:
7
7
ms.topic: faq
8
8
ms.subservice: synapse-link
9
9
ms.custom: event-tier1-build-2022
10
-
ms.date: 11/02/2022
10
+
ms.date: 11/09/2022
11
11
ms.author: yexu
12
12
ms.reviewer: wiassaf, imotiwala
13
13
title: Azure Synapse Link for SQL FAQ
@@ -27,12 +27,12 @@ sections:
27
27
- question: |
28
28
Do I need to stop the link connection when I want to add or remove tables to be replicated?
29
29
answer: |
30
-
No, you can add or remove tables when the link connection is running. The tables which are removed will stop being replicated automatically. The newly added tables will start from initial load with full snapshot and then do incremental synchronization. The rest of the tables in the same link connection will not be impacted.
30
+
No, you can add or remove tables when the link connection is running. The tables that are removed will stop being replicated automatically. The newly added tables will start from initial load with full snapshot and then do incremental synchronization. The rest of the tables in the same link connection will not be impacted.
31
31
- question: |
32
-
My destination tables exist in the target Synapse dedicated SQL pool which causes my link connection to fail to start. What should I do?
32
+
My destination tables exist in the target dedicated SQL pool, which causes my link connection to fail to start. What should I do?
33
33
answer: |
34
34
You should remove the destination tables before starting a link connection. You can do that by either manually removing the tables from Synapse dedicated SQL pool or checking “Drop and recreate table on target” in the link connection to let it automatically drop existing tables on the Synapse dedicated SQL pool every time when starts.
35
-
:::image type="content" source="../media/sql-synapse-link-overview/drop-recreate-target-table.png" lightbox="../media/sql-synapse-link-overview/drop-recreate-target-table.png" alt-text="Shows a screenshot of the Drop and Recreate Target Table option for Synapse Link for SQL Server.":::
35
+
:::image type="content" source="../media/sql-synapse-link-overview/drop-recreate-target-table.png" lightbox="../media/sql-synapse-link-overview/drop-recreate-target-table.png" alt-text="Shows a screenshot of the Drop and Recreate Target Table option for Azure Synapse Link for SQL Server.":::
36
36
- question: |
37
37
What happens on my running link connection if the table columns have been added or dropped from our source stores?
38
38
answer: |
@@ -42,7 +42,7 @@ sections:
42
42
answer: |
43
43
Yes, you can.
44
44
- question: |
45
-
Can I select managed virtual network in Synapse workspace with Synapse managed private endpoints which allow the link connection to privately connect to the source database?
45
+
Can I select managed virtual network in Synapse workspace with Synapse managed private endpoints, which allow the link connection to privately connect to the source database?
46
46
answer: |
47
47
Yes, you can. Similar like all the workloads in Synapse. You can enable Synapse link for SQL in Azure Synapse-managed virtual network to replicate data from SQL to Synapse in a secure manner. You can protect against data exfiltration by allowing outbound connectivity from the managed virtual network only to approved targets using managed private endpoints.
48
48
- question: |
@@ -57,11 +57,15 @@ sections:
57
57
- question: |
58
58
How should I select the structure type of my destination table in the Synapse dedicated SQL pool?
59
59
answer: |
60
-
You can refer to [Indexing tables - Azure Synapse Analytics | Microsoft Docs](../sql-data-warehouse/sql-data-warehouse-tables-index.md) to understand the three options for table structure type. When clustered columnstore index is chosen, data type with max length (eg. VARCHAR(MAX)) is not supported.
60
+
You can refer to [Indexing tables - Azure Synapse Analytics | Microsoft Docs](../sql-data-warehouse/sql-data-warehouse-tables-index.md) to understand the three options for table structure type. When clustered columnstore index is chosen, data type with max length (for example, VARCHAR(MAX)) is not supported.
61
61
- question: |
62
62
Do I need to clean up data in the landing zone?
63
63
answer: |
64
64
No. There is a background thread that removes committed files after around 24 hours as long as the link is continuously running. When the link is stopped then the entire landing zone folder is removed.
65
+
- question: |
66
+
In which regions is Azure Synapse Link for SQL available?
67
+
answer: |
68
+
Azure Synapse Link for SQL is available in all regions where [Azure Synapse Workspace is currently available](https://azure.microsoft.com/explore/global-infrastructure/products-by-region/?products=synapse-analytics&rar=true®ions=all).
65
69
- question: |
66
70
Where is my landing zone located?
67
71
answer: |
@@ -93,7 +97,7 @@ sections:
93
97
- question: |
94
98
There is a documented limit of 7,500 bytes per row for Azure Synapse Link for SQL. What if I have larger data rows in my source database?
95
99
answer: |
96
-
This restriction is for on-page data only. For off-page data, the only thing that counts against the 7,500byte limit is the 24byte pointer to the off-page data.
100
+
This restriction is for on-page data only. For off-page data, the only thing that counts against the 7,500-byte limit is the 24-byte pointer to the off-page data.
97
101
- question: |
98
102
What data replication mechanism is used by Azure Synapse Link for SQL?
99
103
answer: |
@@ -105,7 +109,7 @@ sections:
105
109
- question: |
106
110
What is the impact when a user removes the Azure Synapse workspace that contains an Azure Synapse Link to Azure SQL DB?
107
111
answer: |
108
-
If the Azure Synapse workspace is removed, Azure SQL DB will stop data replication from landing zone into Azure Synapse. The system stored procedure [sp_change_feed_drop_table_group](/sql/relational-databases/system-stored-procedures/sp-change-feed-drop-table-group) will be called automatically, and the storage account for the landing zone is managed and will be cleaned up automatically.
112
+
If the Azure Synapse workspace is removed, Azure SQL DB will stop data replication from landing zone into Azure Synapse. The system stored procedure [sp_change_feed_drop_table_group](/sql/relational-databases/system-stored-procedures/sp-change-feed-drop-table-group) will be called automatically, and the storage account for the landing zone is managed and will be cleaned up automatically. If this fails, you may receive error 22739 from the SynapseGatewayClient in [sys.dm_change_feed_errors](/sql/relational-databases/system-dynamic-management-views/sys-dm-change-feed-errors). If this occurs, you can manually drop the changefeed table group with `sp_change_feed_drop_table_group`.
109
113
- question: |
110
114
What is the impact when a user removes the Azure Synapse workspace that contains an Azure Synapse Link to SQL Server?
@@ -30,7 +30,7 @@ This is the list of known limitations for Azure Synapse Link for SQL.
30
30
* Source table row size can't exceed 7,500 bytes. For tables where variable-length columns are stored off-row, a 24-byte pointer is stored in the main record.
31
31
* Tables enabled for Azure Synapse Link for SQL can have a maximum of 1,020 columns (not 1,024).
32
32
* While a database can have multiple links enabled, a given table can't belong to multiple links.
33
-
* When a database owner doesn't have a mapped log in, Azure Synapse link for SQL will run into an error when enabling a link connection. User can set database owner to a valid user with the `ALTER AUTHORIZATION` command to fix this issue.
33
+
* When a database owner doesn't have a mapped login, Azure Synapse Link for SQL will run into an error when enabling a link connection. User can set database owner to a valid user with the `ALTER AUTHORIZATION` command to fix this issue.
34
34
* If the source table contains computed columns or columns with data types that aren't supported by Azure Synapse Analytics dedicated SQL pools, these columns won't be replicated to Azure Synapse Analytics. Unsupported columns include:
35
35
* image
36
36
* text
@@ -41,7 +41,6 @@ This is the list of known limitations for Azure Synapse Link for SQL.
41
41
* geometry
42
42
* geography
43
43
* A maximum of 5,000 tables can be added to a single link connection.
44
-
* When a source column is of type datetime2(7) or time(7), the last digit will be truncated when data is replicated to Azure Synapse Analytics.
45
44
* The following table DDL operations aren't allowed on source tables when they are enabled for Azure Synapse Link for SQL. All other DDL operations are allowed, but they won't be replicated to Azure Synapse Analytics.
46
45
* Switch Partition
47
46
* Add/Drop/Alter Column
@@ -61,16 +60,25 @@ This is the list of known limitations for Azure Synapse Link for SQL.
61
60
* System tables can't be replicated.
62
61
* The security configuration from the source database will **NOT** be reflected in the target dedicated SQL pool.
63
62
* Enabling Azure Synapse Link for SQL will create a new schema called `changefeed`. Don't use this schema, as it is reserved for system use.
64
-
* Source tables with collations that are unsupported by Synapse SQL dedicated pool, such as UTF8 and certain Japanese collations, can’t be replicated. Here's the [supported collations in Synapse SQL Pool](../sql/reference-collation-types.md).
65
-
* Single row updates (including off-page storage) of > 370MB are not supported.
63
+
* Azure Synapse Link for SQL will **NOT** work and can't be enabled if your database contains a schema or user named `changefeed`.
64
+
* Source tables with collations that are unsupported by dedicated SQL pools, such as UTF8 and certain Japanese collations, can't be replicated. Here's the [supported collations in Synapse SQL Pool](../sql/reference-collation-types.md).
65
+
* Additionally, some Thai language collations are currently supported by Azure Synapse Link for SQL. These unsupported collations include:
* Single row updates (including off-page storage) of > 370 MB are not supported.
66
74
67
75
### Azure SQL DB only
68
76
* Azure Synapse Link for SQL isn't supported on Free, Basic or Standard tier with fewer than 100 DTUs.
69
77
* Azure Synapse Link for SQL isn't supported on SQL Managed Instances.
70
78
* Service principal isn't supported for authenticating to source Azure SQL DB, so when creating Azure SQL DB linked Service, choose SQL authentication, user-assigned managed identity (UAMI) or service assigned managed Identity (SAMI).
71
79
* If the Azure SQL Database logical server has both a SAMI and UAMI configured, Azure Synapse Link will use SAMI.
72
80
* Azure Synapse Link can't be enabled on the secondary database once a GeoDR failover has happened if the secondary database has a different name from the primary database.
73
-
* If you enabled Azure Synapse Link for SQL on your database as an Microsoft Azure Active Directory (Azure AD) user, Point-in-time restore (PITR) will fail. PITR will only work when you enable Azure Synapse Link for SQL on your database as a SQL user.
81
+
* If you enabled Azure Synapse Link for SQL on your database as a Microsoft Azure Active Directory (Azure AD) user, Point-in-time restore (PITR) will fail. PITR will only work when you enable Azure Synapse Link for SQL on your database as a SQL user.
74
82
* If you create a database as an Azure AD user and enable Azure Synapse Link for SQL, a SQL authentication user (for example, even sysadmin role) won't be able to disable/make changes to Azure Synapse Link for SQL artifacts. However, another Azure AD user will be able to enable/disable Azure Synapse Link for SQL on the same database. Similarly, if you create a database as an SQL authentication user, enabling/disabling Azure Synapse Link for SQL as an Azure AD user won't work.
75
83
* When enabling Azure Synapse Link for SQL on your Azure SQL Database, you should ensure that aggressive log truncation is disabled.
76
84
@@ -84,13 +92,15 @@ This is the list of known limitations for Azure Synapse Link for SQL.
84
92
> Azure Synapse Link for SQL is not supported on databases that are also using Azure SQL Managed Instance Link. Caution that in these scenarios, when the managed instance transitions to read-write mode, you may encounter transaction log full issues.
85
93
86
94
## Known issues
87
-
### Deleting an Azure Synapse Analytics workspace with a running link could cause log in source database to fill
88
-
* Applies To - Azure SQL Database and SQL Server 2022
89
-
* Issue - When you delete an Azure Synapse Analytics workspace it is possible that running links might not be stopped, which will cause the source database to think that the link is still operational and could lead to the log filling and not being truncated.
95
+
96
+
### Deleting an Azure Synapse Analytics workspace with a running link could cause the transaction log in the source database to fill
97
+
98
+
* Applies To - Azure Synapse Link for Azure SQL Database and SQL Server 2022
99
+
* Issue - When you delete an Azure Synapse Analytics workspace it is possible that running links might not be stopped, which will cause the source database to think that the link is still operational and could lead to the transaction log to not be truncated, and fill.
90
100
* Resolution - There are two possible resolutions to this situation:
91
101
1. Stop any running links prior to deleting the Azure Synapse Analytics workspace.
92
102
1. Manually clean up the link definition in the source database.
93
-
1. Find the table_group_id for the link(s) that need to be stopped using the following query:
103
+
1. Find the `table_group_id` for the link(s) that need to be stopped using the following query:
@@ -104,23 +114,20 @@ This is the list of known limitations for Azure Synapse Link for SQL.
104
114
```sql
105
115
EXEC sys.sp_change_feed_disable_db
106
116
107
-
### DateTime2(7) and Time(7) Could Cause Snapshot Hang
108
-
* Applies To - Azure SQL Database
109
-
* Issue - One of the preview limitations with the data types DateTime2(7) and Time(7) is the loss of precision (only 6 digits are supported). When certain database settings are turned on (`NUMERIC_ROUNDABORT`, `ANSI_WARNINGS`, and `ARITHABORT`), the snapthot process can hang, requiring a database failover to recover.
110
-
* Resolution - To resolve this situation, take the following steps:
111
-
1. Turn off all three database settings.
112
-
```sql
113
-
ALTERDATABASE<logical_database_name>SET NUMERIC_ROUNDABORT OFF
114
-
ALTERDATABASE<logical_database_name>SET ANSI_WARNINGS OFF
115
-
ALTERDATABASE<logical_database_name>SET ARITHABORT OFF
116
-
```
117
-
1. Run the following query to verify that the settings are in fact turned off.
1. Open an Azure support ticket requesting a database failover. Alternately, you could change the Service Level Objective (SLO) of your database instead of opening a ticket.
117
+
### Trying to re-enable change feed on a table for that was recently disabled table will show an error. This is an uncommon behavior.
118
+
119
+
* Applies To - Azure Synapse Link for Azure SQL Database and SQL Server 2022
120
+
* Issue - When you try to enable a table that has been recently disabled with its metadata not yet been cleaned up and state marked as DISABLED, an error will be thrown stating `A table can only be enabled once among all table groups`.
121
+
* Resolution - Wait for sometime for the disabled table system procedure to complete and then try to re-enable the table again.
122
+
123
+
### Attempt to enable Synapse Link on database imported using SSDT, SQLPackage for Import/Export and Extract/Deploy operations
124
+
125
+
* Applies To - Azure Synapse Link for Azure SQL Database and SQL Server 2022
126
+
* Issue - For SQL databases enabled with Azure Synapse Link, when you use SSDT Import/Export and Extract/Deploy operations to import/setup a new database, the `changefeed` schema and user do not get excluded in the new database. However, the tables for the changefeed *are* ignored by DaxFX because they are marked as `is_ms_shipped=1` in `sys.objects`, and those objects never included in SSDT Import/Export and Extract/Deploy operations. When enabling Synapse Link on the imported/deployed database, the system stored procedure `sys.sp_change_feed_enable_db` fails if the `changefeed` user and schema already exist. This issue will also be encountered if you have created a user or schema named `changefeed` that is not related to Synapse Link change feed capability.
127
+
* Resolution -
128
+
* Manually drop the empty `changefeed` schema and `changefeed` user. Then, Synapse Link can be enabled successfully on the imported/deployed database.
129
+
* If you have defined a custom schema or user named `changefeed` in your database that is not related to Azure Synapse Link, and you do not intend to use Azure Synapse Link for SQL, it is not necessary to drop your `changefeed` schema or user.
130
+
* If you have defined a customer schema or user named `changedfeed` in your database, currently, this database cannot participate in the Azure Synapse Link for SQL.
0 commit comments