Skip to content

Commit cff6fe2

Browse files
authored
Merge pull request #113602 from MikeRys/patch-3
Removed SQL Pool parts
2 parents ed8b677 + c4284ed commit cff6fe2

File tree

1 file changed

+6
-31
lines changed
  • articles/synapse-analytics/metadata

1 file changed

+6
-31
lines changed

articles/synapse-analytics/metadata/table.md

Lines changed: 6 additions & 31 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: MikeRys
66
ms.service: synapse-analytics
77
ms.topic: overview
88
ms.subservice:
9-
ms.date: 04/15/2020
9+
ms.date: 05/01/2020
1010
ms.author: mrys
1111
ms.reviewer: jrasnick
1212
---
@@ -15,24 +15,20 @@ ms.reviewer: jrasnick
1515

1616
[!INCLUDE [synapse-analytics-preview-terms](../../../includes/synapse-analytics-preview-terms.md)]
1717

18-
Azure Synapse Analytics allows the different workspace computational engines to share databases and Parquet-backed tables between its Apache Spark pools (preview), SQL on-demand (preview) engine, and SQL pools.
18+
Azure Synapse Analytics allows the different workspace computational engines to share databases and Parquet-backed tables between its Apache Spark pools (preview) and SQL on-demand (preview) engine.
1919

2020
Once a database has been created by a Spark job, you can create tables in it with Spark that use Parquet as the storage format. These tables will immediately become available for querying by any of the Azure Synapse workspace Spark pools. They can also be used from any of the Spark jobs subject to permissions.
2121

22-
The Spark created, managed, and external tables are also made available as external tables with the same name in the corresponding synchronized database in SQL on-demand and in the corresponding `$`-prefixed schemas in the SQL pools that have their metadata synchronization enabled. [Exposing a Spark table in SQL](#exposing-a-spark-table-in-sql) provides more detail on the table synchronization.
22+
The Spark created, managed, and external tables are also made available as external tables with the same name in the corresponding synchronized database in SQL on-demand. [Exposing a Spark table in SQL](#exposing-a-spark-table-in-sql) provides more detail on the table synchronization.
2323

24-
Since the tables are synchronized to SQL on-demand and the SQL pools asynchronously, there will be a delay until they appear.
25-
26-
Mapping of tables to external tables, data sources and file formats.
24+
Since the tables are synchronized to SQL on-demand asynchronously, there will be a delay until they appear.
2725

2826
## Manage a Spark created table
2927

3028
Use Spark to manage Spark created databases. For example, delete it through a Spark pool job, and create tables in it from Spark.
3129

3230
If you create objects in such a database from SQL on-demand or try to drop the database, the operation will succeed, but the original Spark database will not be changed.
3331

34-
If you try to drop the synchronized schema in a SQL pool, or try to create a table in it, Azure returns an error.
35-
3632
## Exposing a Spark table in SQL
3733

3834
### Which Spark tables are shared
@@ -51,7 +47,7 @@ Azure Synapse currently only shares managed and external Spark tables that store
5147

5248
### How are Spark tables shared
5349

54-
The shareable managed and external Spark tables exposed in the SQL engines as external tables with the following properties:
50+
The shareable managed and external Spark tables exposed in the SQL engine as external tables with the following properties:
5551

5652
- The SQL external table's data source is the data source representing the Spark table's location folder.
5753
- The SQL external table's file format is Parquet.
@@ -83,7 +79,7 @@ Spark tables provide different data types than the Synapse SQL engines. The foll
8379

8480
## Security model
8581

86-
The Spark databases and tables, as well as their synchronized representations in the SQL engines will be secured at the underlying storage level. Since they do not currently have permissions on the objects themselves, the objects can be seen in the object explorer.
82+
The Spark databases and tables, as well as their synchronized representations in the SQL engine will be secured at the underlying storage level. Since they do not currently have permissions on the objects themselves, the objects can be seen in the object explorer.
8783

8884
The security principal who creates a managed table is considered the owner of that table and has all the rights to the table as well as the underlying folders and files. In addition, the owner of the database will automatically become co-owner of the table.
8985

@@ -189,27 +185,6 @@ id | name | birthdate
189185
1 | Alice | 2010-01-01
190186
```
191187

192-
### Querying Spark tables in a SQL pool
193-
194-
With the tables created in the previous examples, now create a SQL pool in your workspace named `mysqlpool` that enables metadata synchronization (or use the already created pool from [Exposing a Spark database in a SQL pool](database.md#exposing-a-spark-database-in-a-sql-pool).
195-
196-
Run the following statement against the `mysqlpool` SQL pool:
197-
198-
```sql
199-
SELECT * FROM sys.tables;
200-
```
201-
202-
Verify that the tables `myParquetTable` and `myExternalParquetTable` are visible in the schema `$mytestdb`.
203-
204-
Now you can read the data from SQL on-demand as follows:
205-
206-
```sql
207-
SELECT * FROM [$mytestdb].myParquetTable WHERE name = 'Alice';
208-
SELECT * FROM [$mytestdb].myExternalParquetTable WHERE name = 'Alice';
209-
```
210-
211-
You should get the same results as with SQL on-demand above.
212-
213188
## Next steps
214189

215190
- [Learn more about Azure Synapse Analytics' shared metadata](overview.md)

0 commit comments

Comments
 (0)