Skip to content

Commit 0c2a9b2

Browse files
authored
Removed SQL Pool aspects
SQL Pool content will be re-added once they are ready (ETA: June/July 2020)
1 parent 76e488e commit 0c2a9b2

File tree

1 file changed

+6
-10
lines changed

1 file changed

+6
-10
lines changed

articles/synapse-analytics/metadata/overview.md

Lines changed: 6 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -6,19 +6,17 @@ author: MikeRys
66
ms.service: synapse-analytics
77
ms.topic: overview
88
ms.subservice:
9-
ms.date: 04/15/2020
9+
ms.date: 05/01/2020
1010
ms.author: mrys
1111
ms.reviewer: jrasnick
1212
---
1313

1414
# Azure Synapse Analytics shared metadata
1515

16-
Azure Synapse Analytics allows the different workspace computational engines to share databases and tables between its Spark pools (preview), SQL on-demand engine (preview), and SQL pools.
16+
Azure Synapse Analytics allows the different workspace computational engines to share databases and tables between its Spark pools (preview) and SQL on-demand engine (preview).
1717

1818
[!INCLUDE [preview](../includes/note-preview.md)]
1919

20-
21-
2220
The sharing supports the so-called modern data warehouse pattern and gives the workspace SQL engines access to databases and tables created with Spark. It also allows the SQL engines to create their own objects that aren't being shared with the other engines.
2321

2422
## Support the modern data warehouse
@@ -29,9 +27,7 @@ The shared metadata model supports the modern data warehouse pattern in the foll
2927

3028
2. The Spark created databases and all their tables become visible in any of the Azure Synapse workspace Spark pool instances and can be used from any of the Spark jobs. This capability is subject to the [permissions](#security-model-at-a-glance) since all Spark pools in a workspace share the same underlying catalog meta store.
3129

32-
3. The Spark created databases and their Parquet-backed tables become visible in the workspace SQL on-demand engine. [Databases](database.md) are created automatically in the SQL on-demand metadata, and both the [external and managed tables](table.md) created by a Spark job are made accessible as external tables in the SQL on-demand metadata in the `dbo` schema of the corresponding database. <!--For more details, see [ADD LINK].-->
33-
34-
4. If there are SQL pool instances in the workspace that have their metadata synchronization enabled <!--[ADD LINK]--> or if a new SQL pool instance is created with the metadata synchronization enabled, the Spark created databases and their Parquet-backed tables will be mapped automatically into the SQL pool database as described in [Azure Synapse Analytics shared database](database.md).
30+
3. The Spark created databases and their Parquet-backed tables become visible in the workspace SQL on-demand engine. [Databases](database.md) are created automatically in the SQL on-demand metadata, and both the [external and managed tables](table.md) created by a Spark job are made accessible as external tables in the SQL on-demand metadata in the `dbo` schema of the corresponding database.
3531

3632
<!--[INSERT PICTURE]-->
3733

@@ -41,17 +37,17 @@ Object synchronization occurs asynchronously. Objects will have a slight delay o
4137

4238
## Which metadata objects are shared
4339

44-
Spark allows you to create databases, external tables, managed tables, and views. Since Spark views require a Spark engine to process the defining Spark SQL statement, and cannot be processed by a SQL engine, only databases and their contained external and managed tables that use the Parquet storage format are shared with the workspace SQL engines. Spark views are only shared among the Spark pool instances.
40+
Spark allows you to create databases, external tables, managed tables, and views. Since Spark views require a Spark engine to process the defining Spark SQL statement, and cannot be processed by a SQL engine, only databases and their contained external and managed tables that use the Parquet storage format are shared with the workspace SQL engine. Spark views are only shared among the Spark pool instances.
4541

4642
## Security model at a glance
4743

48-
The Spark databases and tables, along with their synchronized representations in the SQL engines, are secured at the underlying storage level. When the table is queried by any of the engines that the query submitter has the right to use, the query submitter's security principal is being passed through to the underlying files. Permissions are checked at the file system level.
44+
The Spark databases and tables, along with their synchronized representations in the SQL engine, are secured at the underlying storage level. When the table is queried by any of the engines that the query submitter has the right to use, the query submitter's security principal is being passed through to the underlying files. Permissions are checked at the file system level.
4945

5046
For more information, see [Azure Synapse Analytics shared database](database.md).
5147

5248
## Change maintenance
5349

54-
If a metadata object is deleted or changed with Spark, the changes are picked up and propagated to the SQL on-demand engine and the SQL pools that have the objects synchronized. Synchronization is asynchronous and changes are reflected in the SQL engines after a short delay.
50+
If a metadata object is deleted or changed with Spark, the changes are picked up and propagated to the SQL on-demand engine. Synchronization is asynchronous and changes are reflected in the SQL engine after a short delay.
5551

5652
## Next steps
5753

0 commit comments

Comments
 (0)