Skip to content

Commit 3e8bce5

Browse files
authored
Merge pull request #111198 from julieMSFT/20200413_ria_SDK_samples
Updates to toc and SQL on-demand overview article
2 parents 39d2511 + 2f2d43f commit 3e8bce5

File tree

8 files changed

+32
-99
lines changed

8 files changed

+32
-99
lines changed

articles/synapse-analytics/overview-faq.md

Lines changed: 1 addition & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -97,14 +97,10 @@ A: Access to files and folders is currently managed through ADLSg2. For more inf
9797

9898
A: Yes, you can use your third-party business applications, like Tableau and Power BI, to connect to SQL pool and SQL on-demand. Spark supports IntelliJ.
9999

100-
### Q: Does Azure Synapse Analytics provide APIs
101-
102-
A: Yes, we provide an SDK to programmatically interact with Azure Synapse Analytics. More information is available [here] on which operations are supported by Synapse.
103-
104100
## Next steps
105101

106102
- [Create a workspace](quickstart-create-workspace.md)
107103
- [Use Synapse Studio](quickstart-synapse-studio.md)
108104
- [Create a SQL pool](quickstart-create-sql-pool.md)
109105
- [Use SQL on-demand](quickstart-sql-on-demand.md)
110-
- [Create an Apache Spark pool](quickstart-create-apache-spark-pool.md)
106+
- [Create an Apache Spark pool](quickstart-create-apache-spark-pool.md)

articles/synapse-analytics/quickstart-synapse-studio.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -59,7 +59,7 @@ You can create new folders and upload files using the links in toolbar to organi
5959

6060
## Next steps
6161

62-
- Enable AAD users to query files [by assigning **Storage Blob Data Reader** or **Storage Blob Data Contributor** RBAC permissions on Azure Storage](../storage/common/storage-auth-aad-rbac-portal.md?toc=/azure/synapse-analytics/toc.json&bc=/azure/synapse-analytics/breadcrumb/toc.json#assign-a-built-in-rbac-role)
63-
- [Query files on Azure Storage using SQL On-Demand](sql/on-demand.md)
62+
- Enable Azure AD users to query files [by assigning **Storage Blob Data Reader** or **Storage Blob Data Contributor** RBAC permissions on Azure Storage](../storage/common/storage-auth-aad-rbac-portal.md?toc=/azure/synapse-analytics/toc.json&bc=/azure/synapse-analytics/breadcrumb/toc.json#assign-a-built-in-rbac-role)
63+
- [Query files on Azure Storage using SQL On-Demand](sql/on-demand-workspace-overview.md)
6464
- [Create Apache Spark pool](spark/apache-spark-notebook-create-spark-use-sql.md)
6565
- [Create Power BI report on files stored on Azure Storage](sql/tutorial-connect-power-bi-desktop.md)

articles/synapse-analytics/sql/develop-storage-files-overview.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ For querying, the following T-SQL aspects are supported:
2020
- Full [SELECT](/sql/t-sql/queries/select-transact-sql?toc=/azure/synapse-analytics/toc.json&bc=/azure/synapse-analytics/breadcrumb/toc.json&view=azure-sqldw-latest) surface area, including majority of SQL functions, operators, and so on.
2121
- CREATE EXTERNAL TABLE AS SELECT ([CETAS](develop-tables-cetas.md)) creates an [external table](develop-tables-external-tables.md) and then exports, in parallel, the results of a Transact-SQL SELECT statement to Azure Storage.
2222

23-
For more information on what is vs. what isn't currently supported, read the [SQL on-demand overview](on-demand.md) article.
23+
For more information on what is vs. what isn't currently supported, read the [SQL on-demand overview](on-demand-workspace-overview.md) article.
2424

2525
When Azure AD users run queries, the default is for storage accounts to be accessed using the Azure AD pass-through authentication protocol. As such, users will be impersonated and permissions checked at the storage level. You can [control storage access](develop-storage-files-storage-access-control.md) to suit your needs.
2626

articles/synapse-analytics/sql/develop-tables-overview.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ ms.reviewer: jrasnick
1616

1717
This document includes key concepts for designing tables with SQL pool and SQL on-demand (preview).
1818

19-
[SQL on-demand (preview)](on-demand.md) is a query service over the data in your data lake. It doesn't have local storage for data ingestion. [SQL pool](best-practices-sql-pool.md) represents a collection of analytic resources that are being provisioned when using Synapse SQL. The size of SQL pool is determined by Data Warehousing Units (DWU).
19+
[SQL on-demand (preview)](on-demand-workspace-overview.md) is a query service over the data in your data lake. It doesn't have local storage for data ingestion. [SQL pool](best-practices-sql-pool.md) represents a collection of analytic resources that are being provisioned when using Synapse SQL. The size of SQL pool is determined by Data Warehousing Units (DWU).
2020

2121
The following table lists the topics that are relevant to SQL pool vs. SQL on-demand:
2222

articles/synapse-analytics/sql/develop-transactions.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -202,4 +202,4 @@ They are as follows:
202202

203203
## Next steps
204204

205-
To learn more about optimizing transactions, see [Transactions best practices](../sql-data-warehouse/sql-data-warehouse-develop-best-practices-transactions.md?toc=/azure/synapse-analytics/toc.json&bc=/azure/synapse-analytics/breadcrumb/toc.json). Additional best practices guides are also provided for [SQL pool](best-practices-sql-pool.md) and [SQL on-demand (preview)](on-demand.md).
205+
To learn more about optimizing transactions, see [Transactions best practices](../sql-data-warehouse/sql-data-warehouse-develop-best-practices-transactions.md?toc=/azure/synapse-analytics/toc.json&bc=/azure/synapse-analytics/breadcrumb/toc.json). Additional best practices guides are also provided for [SQL pool](best-practices-sql-pool.md) and [SQL on-demand (preview)](on-demand-workspace-overview.md).

articles/synapse-analytics/sql/on-demand-workspace-overview.md

Lines changed: 25 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -1,40 +1,43 @@
11
---
22
title: SQL on-demand (preview)
33
description: Learn about Synapse SQL on-demand in Azure Synapse Analytics.
4-
services: sql-datawarehouse
5-
author: vvasic-msft
4+
services: synapse analytics
5+
author: filippopovic
66
ms.service: synapse-analytics
77
ms.topic: overview
88
ms.date: 04/15/2020
9-
ms.author: vvasic
9+
ms.author: fipopovi
1010
ms.reviewer: jrasnick
1111
---
12-
# SQL on-demand (preview) in Azure Synapse Analytics
12+
# SQL on-demand (preview) in Azure Synapse Analytics
1313

1414
Every Azure Synapse Analytics workspace (preview) comes with SQL on-demand (preview) endpoints that you can use to query data in the lake.
1515

16-
SQL on-demand is a query service over the data in your data lake. It enables you to democratize access to all your data by providing a familiar T-SQL syntax to query data in place, without a need to copy or load data into a specialized store. In addition, the T-SQL interface enables seamless connectivity from the widest range of business intelligence and ad-hoc querying tools, as well as the most popular drivers.
16+
SQL on-demand is a query service over the data in your data lake. It enables you to access your data through the following functionalities:
17+
18+
- A familiar T-SQL syntax to query data in place without the need to copy or load data into a specialized store.
19+
- Integrated connectivity via the T-SQL interface that offers a wide range of business intelligence and ad-hoc querying tools, including the most popular drivers.
1720

18-
SQL on-demand is a distributed data processing system, built for large scale of data and compute, enabling you to analyze your Big Data in seconds to minutes, depending on the workload. Thanks to built-in query execution fault-tolerance, the system provides high reliability and success rates even for long-running queries involving vert large data sets.
21+
SQL on-demand is a distributed data processing system, built for large scale of data and compute. SQL on-demand enables you to analyze your Big Data in seconds to minutes, depending on the workload. Thanks to built-in query execution fault-tolerance, the system provides high reliability and success rates even for long-running queries involving large data sets.
1922

2023
SQL on-demand is serverless, hence there is no infrastructure to setup or clusters to maintain. A default endpoint for this service is provided within every Azure Synapse workspace, so you can start querying data as soon as the workspace is created. There is no charge for resources reserved, you are only being charged for the data scanned by queries you run, hence this model is a true pay-per-use model.
2124

22-
If you use Spark in your data pipeline, for data preparation, cleansing or enrichment, you can [query any Spark tables](develop-storage-files-spark-tables.md) you've created in the process, directly from SQL on-demand. Use Private Link to bring SQL on-demand endpoint into your private virtual network by mapping it to a private IP address. Keep your data secured using familiar SQL-based security mechanisms.
25+
If you use Spark in your data pipeline, for data preparation, cleansing or enrichment, you can [query any Spark tables](develop-storage-files-spark-tables.md) you've created in the process, directly from SQL on-demand. Use [Private Link](../security/how-to-connect-to-workspace-with-private-links.md) to bring your SQL on-demand endpoint into your [managed workspace VNet](../security/synapse-workspace-managed-vnet.md).
2326

2427
## Who is SQL on-demand for
2528

2629
If you need to explore data in the data lake, gain insights from it or optimize your existing data transformation pipeline, you can benefit from using SQL on-demand. It is suitable for the following scenarios:
2730

2831
- Basic discovery and exploration - Quickly reason about the data in various formats (Parquet, CSV, JSON) in your data lake, so you can plan how to extract insights from it.
2932
- Logical data warehouse – Provide a relational abstraction on top of raw or disparate data without relocating and transforming data, allowing always up-to-date view of your data.
30-
- Data transformation - Simple, scalable, and performant way to transform data in the lake using T-SQL, so it can fed to BI and other tools, or loaded into a relational data store (Synapse SQL databases, Azure SQL Database, etc.).
33+
- Data transformation - Simple, scalable, and performant way to transform data in the lake using T-SQL, so it can be fed to BI and other tools, or loaded into a relational data store (Synapse SQL databases, Azure SQL Database, etc.).
3134

3235
Different professional roles can benefit from SQL on-demand:
3336

34-
- Data Engineers can explore the lake, transform and prepare data using this service, and simplify their data transformation pipelines. For more information, check this tutorial
35-
- Data Scientists can quickly reason about the contents and structure of the data in the lake, thanks to features such as OPENROWSET and automatic schema inference
36-
- Data Analysts can [explore data and Spark tables](develop-storage-files-spark-tables.md) created by Data Scientists or Data Engineers using familiar T-SQL language or their favorite tools that can connect to SQL on-demand
37-
- BI Professionals can quickly [create Power BI reports on top of data in the lake](tutorial-connect-power-bi-desktop.md) and Spark tables
37+
- Data Engineers can explore the lake, transform and prepare data using this service, and simplify their data transformation pipelines. For more information, check this [tutorial](tutorial-data-analyst.md).
38+
- Data Scientists can quickly reason about the contents and structure of the data in the lake, thanks to features such as OPENROWSET and automatic schema inference.
39+
- Data Analysts can [explore data and Spark tables](develop-storage-files-spark-tables.md) created by Data Scientists or Data Engineers using familiar T-SQL language or their favorite tools, which can connect to SQL on-demand.
40+
- BI Professionals can quickly [create Power BI reports on top of data in the lake](tutorial-connect-power-bi-desktop.md) and Spark tables.
3841

3942
## What do I need to do to start using it?
4043

@@ -44,11 +47,9 @@ SQL on-demand endpoint is provided within every Azure Synapse workspace. You can
4447

4548
SQL on-demand enables existing SQL ad-hoc querying and business intelligence tools to tap into the data lake. As it provides familiar T-SQL syntax, any tool capable to establish TDS connection SQL offerings can [connect to and query Synapse SQL](connect-overview.md) on-demand. You can connect with Azure Data Studio and run ad-hoc queries or connect with Power BI to gain insights in a matter of minutes.
4649

47-
At this moment, latest version of Azure Data Studio is fully supported. Latest version of SSMS can be used to connect and query but is not supported yet. It will be fully supported until GA. Please make sure you use latest versions of tools.
48-
4950
## Is full T-SQL supported?
5051

51-
SQL on-demand offers T-SQL querying surface area, which is slightly enhanced/extended in some aspects to accommodate for experiences around querying semi-structured and unstructured data. Furthermore, some aspects of T-SQL language are not supported due to the design of SQL on-demand, as an example, DML functionality is currently not supported.
52+
SQL on-demand offers T-SQL querying surface area, which is slightly enhanced/extended in some aspects to accommodate for experiences around querying semi-structured and unstructured data. Furthermore, some aspects of the T-SQL language are not supported due to the design of SQL on-demand, as an example, DML functionality is currently not supported.
5253

5354
- Workload can be organized using familiar concepts:
5455
- Databases - SQL on-demand endpoint can have multiple databases.
@@ -65,16 +66,16 @@ Security can be enforced using:
6566

6667
Supported T-SQL:
6768

68-
- Full [SELECT](/sql/t-sql/queries/select-transact-sql?toc=/azure/synapse-analytics/toc.json&bc=/azure/synapse-analytics/breadcrumb/toc.json&view=azure-sqldw-latest) surface area is supported, including majority of SQL functions
69+
- Full [SELECT](/sql/t-sql/queries/select-transact-sql?toc=/azure/synapse-analytics/toc.json&bc=/azure/synapse-analytics/breadcrumb/toc.json&view=azure-sqldw-latest) surface area is supported, including a majority of SQL functions
6970
- CETAS - CREATE EXTERNAL TABLE AS SELECT
7071
- DDL statements related to views and security only
7172

72-
SQL on-demand has no local storage, only metadata objects are stored in databases. Therefore, T-SQL related to following concepts is not supported:
73+
SQL on-demand has no local storage, only metadata objects are stored in databases. Therefore, T-SQL related to the following concepts is not supported:
7374

7475
- Tables
7576
- Triggers
7677
- Materialized views
77-
- DDL statements other than those related to views and security
78+
- DDL statements other than ones related to views and security
7879
- DML statements
7980

8081
### Extensions
@@ -103,7 +104,7 @@ SQL on-demand offers mechanisms to secure access to your data.
103104

104105
### Azure Active Directory integration and multi-factor authentication
105106

106-
SQL on-demand enables you to centrally manage identities of database user and other Microsoft services with [Azure Active Directory integration](../../sql-database/sql-database-aad-authentication.md?toc=/azure/synapse-analytics/toc.json&bc=/azure/synapse-analytics/breadcrumb/toc.json). This capability simplifies permission management and enhances security. Azure Active Directory (AAD) supports [multi-factor authentication](../../sql-database/sql-database-ssms-mfa-authentication-configure.md?toc=/azure/synapse-analytics/toc.json&bc=/azure/synapse-analytics/breadcrumb/toc.json) (MFA) to increase data and application security while supporting a single sign-on process.
107+
SQL on-demand enables you to centrally manage identities of database user and other Microsoft services with [Azure Active Directory integration](../../sql-database/sql-database-Azure AD-authentication.md?toc=/azure/synapse-analytics/toc.json&bc=/azure/synapse-analytics/breadcrumb/toc.json). This capability simplifies permission management and enhances security. Azure Active Directory (Azure AD) supports [multi-factor authentication](../../sql-database/sql-database-ssms-mfa-authentication-configure.md?toc=/azure/synapse-analytics/toc.json&bc=/azure/synapse-analytics/breadcrumb/toc.json) (MFA) to increase data and application security while supporting a single sign-on process.
107108

108109
#### Authentication
109110

@@ -115,23 +116,23 @@ SQL on-demand authentication refers to how users prove their identity when conne
115116

116117
- **Azure Active Directory Authentication**:
117118

118-
This authentication method uses identities managed by Azure Active Directory. For AAD users, multi-factor authentication can be enabled. Use Active Directory authentication (integrated security) [whenever possible](/sql/relational-databases/security/choose-an-authentication-mode?toc=/azure/synapse-analytics/toc.json&bc=/azure/synapse-analytics/breadcrumb/toc.json&view=azure-sqldw-latest).
119+
This authentication method uses identities managed by Azure Active Directory. For Azure AD users, multi-factor authentication can be enabled. Use Active Directory authentication (integrated security) [whenever possible](/sql/relational-databases/security/choose-an-authentication-mode?toc=/azure/synapse-analytics/toc.json&bc=/azure/synapse-analytics/breadcrumb/toc.json&view=azure-sqldw-latest).
119120

120121
#### Authorization
121122

122123
Authorization refers to what a user can do within a SQL on-demand database, and is controlled by your user account's database role memberships and object-level permissions.
123124

124-
If SQL Authentication is used, SQL user exists only in SQL on-demand and permissions are scoped to the objects in SQL on-demand. Access to securable objects in other services (such as Azure Storage) can't be granted to SQL user directly since it only exists in scope of SQL on-demand. The SQL user needs to use one of the [supported authorization types](develop-storage-files-storage-access-control.md#supported-storage-authorization-types) to access the files.
125+
If SQL Authentication is used, the SQL user exists only in SQL on-demand and permissions are scoped to the objects in SQL on-demand. Access to securable objects in other services (such as Azure Storage) can't be granted to SQL user directly since it only exists in scope of SQL on-demand. The SQL user needs to use one of the [supported authorization types](develop-storage-files-storage-access-control.md#supported-storage-authorization-types) to access the files.
125126

126-
If AAD authentication is used, a user can log in into SQL on-demand and other services, like Azure Storage, can grant permissions to the AAD user.
127+
If Azure AD authentication is used, a user can sign in to SQL on-demand and other services, like Azure Storage, and can grant permissions to the Azure AD user.
127128

128129
### Access to storage accounts
129130

130-
A user that is logged into SQL on-demand service must be authorized to access and query the files in Azure Storage. SQL on-demand supports following authorization types:
131+
A user that is logged into the SQL on-demand service must be authorized to access and query the files in Azure Storage. SQL on-demand supports the following authorization types:
131132

132133
- **Shared access signature (SAS)** provides delegated access to resources in storage account. With a SAS, you can grant clients access to resources in storage account, without sharing account keys. A SAS gives you granular control over the type of access you grant to clients who have the SAS: validity interval, granted permissions, acceptable IP address range, acceptable protocol (https/http).
133134

134-
- **User Identity** (also known as "pass-through") is authorization type where the identity of the AAD user that logged into SQL on-demand is used to authorize the access to data. Before accessing the data, Azure Storage administrator must grant permissions to AAD user for accessing the data. This authorization type uses AAD user that logged into SQL on-demand, therefore it's not supported for SQL user type.
135+
- **User Identity** (also known as "pass-through") is an authorization type where the identity of the Azure AD user that logged into SQL on-demand is used to authorize access to the data. Before accessing the data, Azure Storage administrator must grant permissions to Azure AD user for accessing the data. This authorization type uses the Azure AD user that logged into SQL on-demand, therefore it's not supported for SQL user types.
135136

136137
## Next steps
137138
Additional information on endpoint connection and querying files can be found in the following articles:

0 commit comments

Comments
 (0)