Skip to content

Commit 432191e

Browse files
authored
Merge pull request #301286 from Lucky-Wang16/0613-Update_GBQ_v11
Update Google BigQuery version 1.1 and support multiple queries
2 parents 5c3ce29 + 611181a commit 432191e

File tree

2 files changed

+18
-11
lines changed

2 files changed

+18
-11
lines changed

articles/data-factory/connector-google-bigquery.md

Lines changed: 18 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ author: jianleishen
77
ms.subservice: data-movement
88
ms.topic: conceptual
99
ms.custom: synapse
10-
ms.date: 04/14/2025
10+
ms.date: 06/09/2025
1111
---
1212

1313
# Copy data from Google BigQuery V2 using Azure Data Factory or Synapse Analytics
@@ -74,6 +74,7 @@ The following properties are supported for the Google BigQuery linked service.
7474
| Property | Description | Required |
7575
|:--- |:--- |:--- |
7676
| type | The type property must be set to **GoogleBigQueryV2**. | Yes |
77+
| version |The version that you specify. Recommend upgrading to the latest version to take advantage of the newest enhancements. | Yes for version 1.1 |
7778
| projectId | The project ID of the default BigQuery project to query against. | Yes |
7879
| authenticationType | The OAuth 2.0 authentication mechanism used for authentication.</br>Allowed values are **UserAuthentication** and **ServiceAuthentication**. Refer to sections below this table on more properties and JSON samples for those authentication types respectively. | Yes |
7980

@@ -94,6 +95,7 @@ Set "authenticationType" property to **UserAuthentication**, and specify the fol
9495
"name": "GoogleBigQueryLinkedService",
9596
"properties": {
9697
"type": "GoogleBigQueryV2",
98+
"version": "1.1",
9799
"typeProperties": {
98100
"projectId" : "<project ID>",
99101
"authenticationType" : "UserAuthentication",
@@ -127,6 +129,7 @@ Set "authenticationType" property to **ServiceAuthentication**, and specify the
127129
"name": "GoogleBigQueryLinkedService",
128130
"properties": {
129131
"type": "GoogleBigQueryV2",
132+
"version": "1.1",
130133
"typeProperties": {
131134
"projectId": "<project ID>",
132135
"authenticationType": "ServiceAuthentication",
@@ -220,21 +223,25 @@ To copy data from Google BigQuery, set the source type in the copy activity to *
220223

221224
To learn details about the properties, check [Lookup activity](control-flow-lookup-activity.md).
222225

226+
## <a name="differences-between-google-bigquery-and-google-bigquery-legacy"></a> Google BigQuery connector lifecycle and upgrade
223227

224-
## <a name="upgrade-the-google-bigquery-linked-service"></a> Upgrade the Google BigQuery connector
228+
The following table shows the release stage and change logs for different versions of the Google BigQuery connector:
225229

226-
To upgrade the Google BigQuery connector, create a new Google BigQuery linked service and configure it by referring to [Linked service properties](#linked-service-properties).
230+
| Version | Release stage | Change log |
231+
| :----------- | :------- | :------- |
232+
| Google BigQuery V1 | End of support | / |
233+
| Google BigQuery V2 (version 1.0) | GA version available | • Service authentication is supported by the Azure integration runtime and the self-hosted integration runtime. <br>The properties `trustedCertPath`, `useSystemTrustStore`, `email` and `keyFilePath` are not supported as they are available on the self-hosted integration runtime only. <br><br> • `requestGoogleDriveScope` is not supported. You need additionally apply the permission in Google BigQuery service by referring to [Choose Google Drive API scopes](https://developers.google.com/drive/api/guides/api-specific-auth) and [Query Drive data](https://cloud.google.com/bigquery/docs/query-drive-data). <br><br> • `additionalProjects` is not supported. As an alternative, [query a public dataset with the Google Cloud console](https://cloud.google.com/bigquery/docs/quickstarts/query-public-dataset-console).<br><br> • NUMBER is read as Decimal data type. <br><br> • Timestamp and Datetime are read as DateTimeOffset data type.|
234+
| Google BigQuery V2 (version 1.1) | GA version available | • Fixed a bug: when executing multiple statements, the `query` now returns the results of the first statement after excluding the evaluation statements, rather than always returning the result of the first statement. |
227235

228-
## <a name="differences-between-google-bigquery-and-google-bigquery-legacy"></a> Differences between Google BigQuery V2 and V1
236+
### <a name="upgrade-the-google-bigquery-linked-service"></a> Upgrade the Google BigQuery connector
229237

230-
The Google BigQuery V2 connector offers new functionalities and is compatible with most features of Google BigQuery V1 connector. The table below shows the feature differences between Google BigQuery V2 and V1.
238+
To upgrade your Google BigQuery connector:
231239

232-
| Google BigQuery V2 | Google BigQuery V1 |
233-
| :----------- | :------- |
234-
| Service authentication is supported by the Azure integration runtime and the self-hosted integration runtime.<br>The properties trustedCertPath, useSystemTrustStore, email and keyFilePath are not supported as they are available on the self-hosted integration runtime only. | Service authentication is only supported by the self-hosted integration runtime. <br>Support trustedCertPath, useSystemTrustStore, email and keyFilePath properties. |
235-
| The following mappings are used from Google BigQuery data types to interim data types used by the service internally. <br><br>Numeric -> Decimal<br>Timestamp -> DateTimeOffset<br>Datetime -> DatetimeOffset | The following mappings are used from Google BigQuery data types to interim data types used by the service internally. <br><br>Numeric -> String<br>Timestamp -> DateTime<br>Datetime -> DateTime |
236-
| requestGoogleDriveScope is not supported. You need additionally apply the permission in Google BigQuery service by referring to [Choose Google Drive API scopes](https://developers.google.com/drive/api/guides/api-specific-auth) and [Query Drive data](https://cloud.google.com/bigquery/docs/query-drive-data). | Support requestGoogleDriveScope. |
237-
| additionalProjects is not supported. As an alternative, [query a public dataset with the Google Cloud console](https://cloud.google.com/bigquery/docs/quickstarts/query-public-dataset-console). | Support additionalProjects. |
240+
- **From V1 to V2:**
241+
Create a new Google BigQuery linked service and configure it by referring to [Linked service properties](#linked-service-properties).
242+
243+
- **From V2 version 1.0 to version 1.1:**
244+
In the **Edit linked service** page, select **1.1** for version. For more information, see [Linked service properties](#linked-service-properties).
238245

239246
## Related content
240247

-9.01 KB
Loading

0 commit comments

Comments
 (0)