You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/data-factory/connector-google-bigquery.md
+14-12Lines changed: 14 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,7 +7,7 @@ author: jianleishen
7
7
ms.subservice: data-movement
8
8
ms.topic: conceptual
9
9
ms.custom: synapse
10
-
ms.date: 04/14/2025
10
+
ms.date: 06/09/2025
11
11
---
12
12
13
13
# Copy data from Google BigQuery V2 using Azure Data Factory or Synapse Analytics
@@ -17,7 +17,7 @@ ms.date: 04/14/2025
17
17
This article outlines how to use Copy Activity in Azure Data Factory and Synapse Analytics pipelines to copy data from Google BigQuery. It builds on the [Copy Activity overview](copy-activity-overview.md) article that presents a general overview of the copy activity.
18
18
19
19
> [!IMPORTANT]
20
-
> The [Google BigQuery V2 connector](connector-google-bigquery.md) provides improved native Google BigQuery support. If you are using the [Google BigQuery V1 connector](connector-google-bigquery-legacy.md) in your solution, please [upgrade your Google BigQuery connector](#upgrade-the-google-bigquery-linked-service)as V1 is at [End of Support stage](connector-deprecation-plan.md). Your pipeline will fail after **September 30, 2025** if not upgraded. Refer to this [section](#differences-between-google-bigquery-and-google-bigquery-legacy) for details on the difference between V2 and V1.
20
+
> The [Google BigQuery V2 connector](connector-google-bigquery.md) provides improved native Google BigQuery support. If you are using the [Google BigQuery V1 connector](connector-google-bigquery-legacy.md) in your solution, you are recommended to [upgrade your Google BigQuery connector](#upgrade-the-google-bigquery-linked-service)before **September 30, 2025**. Refer to this [section](#google-bigquery-connector-lifecycle-and-upgrade) for details on the difference between V2 and V1.
21
21
22
22
## Supported capabilities
23
23
@@ -74,6 +74,7 @@ The following properties are supported for the Google BigQuery linked service.
74
74
| Property | Description | Required |
75
75
|:--- |:--- |:--- |
76
76
| type | The type property must be set to **GoogleBigQueryV2**. | Yes |
77
+
| version |The version that you specify. Recommend upgrading to the latest version to take advantage of the newest enhancements. | Yes for version 1.1 |
77
78
| projectId | The project ID of the default BigQuery project to query against. | Yes |
78
79
| authenticationType | The OAuth 2.0 authentication mechanism used for authentication.</br>Allowed values are **UserAuthentication** and **ServiceAuthentication**. Refer to sections below this table on more properties and JSON samples for those authentication types respectively. | Yes |
79
80
@@ -94,6 +95,7 @@ Set "authenticationType" property to **UserAuthentication**, and specify the fol
94
95
"name": "GoogleBigQueryLinkedService",
95
96
"properties": {
96
97
"type": "GoogleBigQueryV2",
98
+
"version": "1.1",
97
99
"typeProperties": {
98
100
"projectId" : "<project ID>",
99
101
"authenticationType" : "UserAuthentication",
@@ -127,6 +129,7 @@ Set "authenticationType" property to **ServiceAuthentication**, and specify the
127
129
"name": "GoogleBigQueryLinkedService",
128
130
"properties": {
129
131
"type": "GoogleBigQueryV2",
132
+
"version": "1.1",
130
133
"typeProperties": {
131
134
"projectId": "<project ID>",
132
135
"authenticationType": "ServiceAuthentication",
@@ -221,20 +224,19 @@ To copy data from Google BigQuery, set the source type in the copy activity to *
221
224
To learn details about the properties, check [Lookup activity](control-flow-lookup-activity.md).
222
225
223
226
224
-
## <aname="upgrade-the-google-bigquery-linked-service"></a> Upgrade the Google BigQuery connector
227
+
## Google BigQuery connector lifecycle and upgrade
225
228
226
-
To upgrade the Google BigQuery connector, create a new Google BigQuery linked service and configure it by referring to [Linked service properties](#linked-service-properties).
229
+
The following table shows the release stage and change logs for different versions of the Google BigQuery connector:
227
230
228
-
## <aname="differences-between-google-bigquery-and-google-bigquery-legacy"></a> Differences between Google BigQuery V2 and V1
231
+
| Version | Release stage | Change log |
232
+
| :----------- | :------- | :------- |
233
+
| Google BigQuery V1 | GA version available | / |
234
+
| Google BigQuery V2 (version 1.0) | GA version available | • Service authentication is supported by the Azure integration runtime. <br>The properties trustedCertPath, useSystemTrustStore, email and keyFilePath are not supported as they are available on the self-hosted integration runtime only. <br><br> • requestGoogleDriveScope is not supported. You need additionally apply the permission in Google BigQuery service by referring to [Choose Google Drive API scopes](https://developers.google.com/drive/api/guides/api-specific-auth) and [Query Drive data](https://cloud.google.com/bigquery/docs/query-drive-data). <br><br> • additionalProjects is not supported. As an alternative, [query a public dataset with the Google Cloud console](https://cloud.google.com/bigquery/docs/quickstarts/query-public-dataset-console).<br><br> • NUMBER is read as Decimal data type. <br><br> • Timestamp and Datetime are read as DateTimeOffset data type.|
235
+
| Google BigQuery V2 (version 1.1) | GA version available | • When executing multiple statements, the `query` returns the complete set of results instead of only the result of the first statement. |
229
236
230
-
The Google BigQuery V2 connector offers new functionalities and is compatible with most features of Google BigQuery V1 connector. The table below shows the feature differences between Google BigQuery V2 and V1.
237
+
### Upgrade the Google BigQuery V2 connector from version 1.0 to version 1.1 (Preview)
231
238
232
-
| Google BigQuery V2 | Google BigQuery V1 |
233
-
| :----------- | :------- |
234
-
| Service authentication is supported by the Azure integration runtime and the self-hosted integration runtime.<br>The properties trustedCertPath, useSystemTrustStore, email and keyFilePath are not supported as they are available on the self-hosted integration runtime only. | Service authentication is only supported by the self-hosted integration runtime. <br>Support trustedCertPath, useSystemTrustStore, email and keyFilePath properties. |
235
-
| The following mappings are used from Google BigQuery data types to interim data types used by the service internally. <br><br>Numeric -> Decimal<br>Timestamp -> DateTimeOffset<br>Datetime -> DatetimeOffset | The following mappings are used from Google BigQuery data types to interim data types used by the service internally. <br><br>Numeric -> String<br>Timestamp -> DateTime<br>Datetime -> DateTime |
236
-
| requestGoogleDriveScope is not supported. You need additionally apply the permission in Google BigQuery service by referring to [Choose Google Drive API scopes](https://developers.google.com/drive/api/guides/api-specific-auth) and [Query Drive data](https://cloud.google.com/bigquery/docs/query-drive-data). | Support requestGoogleDriveScope. |
237
-
| additionalProjects is not supported. As an alternative, [query a public dataset with the Google Cloud console](https://cloud.google.com/bigquery/docs/quickstarts/query-public-dataset-console). | Support additionalProjects. |
239
+
In **Edit linked service** page, select 1.1 for version. For more information, see [Linked service properties](#linked-service-properties).
0 commit comments