You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/data-factory/connector-google-bigquery-legacy.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,7 +7,7 @@ author: jianleishen
7
7
ms.subservice: data-movement
8
8
ms.topic: conceptual
9
9
ms.custom: synapse
10
-
ms.date: 06/13/2025
10
+
ms.date: 04/14/2025
11
11
---
12
12
13
13
# Copy data from Google BigQuery V1 using Azure Data Factory or Synapse Analytics
@@ -16,7 +16,7 @@ ms.date: 06/13/2025
16
16
This article outlines how to use Copy Activity in Azure Data Factory and Synapse Analytics pipelines to copy data from Google BigQuery. It builds on the [Copy Activity overview](copy-activity-overview.md) article that presents a general overview of the copy activity.
17
17
18
18
> [!IMPORTANT]
19
-
> The [Google BigQuery V2 connector](connector-google-bigquery.md) provides improved native Google BigQuery support. If you are using the [Google BigQuery V1 connector](connector-google-bigquery-legacy.md) in your solution, you are recommended to [upgrade your Google BigQuery connector](connector-google-bigquery.md#upgrade-the-google-bigquery-v2-connector-from-version-10-to-version-11) before **September 30, 2025**. Refer to this [section](connector-google-bigquery.md#differences-between-google-bigquery-and-google-bigquery-legacy) for details on the difference between V2 and V1.
19
+
> The [Google BigQuery V2 connector](connector-google-bigquery.md) provides improved native Google BigQuery support. If you are using the [Google BigQuery V1 connector](connector-google-bigquery-legacy.md) in your solution, please [upgrade your Google BigQuery connector](connector-google-bigquery.md#upgrade-the-google-bigquery-linked-service) as V1 is at [End of Support stage](connector-deprecation-plan.md). Your pipeline will fail after **September 30, 2025** if not upgraded. Refer to this [section](connector-google-bigquery.md#differences-between-google-bigquery-and-google-bigquery-legacy) for details on the difference between V2 and V1.
Copy file name to clipboardExpand all lines: articles/data-factory/connector-google-bigquery.md
+85-2Lines changed: 85 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -17,7 +17,7 @@ ms.date: 06/09/2025
17
17
This article outlines how to use Copy Activity in Azure Data Factory and Synapse Analytics pipelines to copy data from Google BigQuery. It builds on the [Copy Activity overview](copy-activity-overview.md) article that presents a general overview of the copy activity.
18
18
19
19
> [!IMPORTANT]
20
-
> The [Google BigQuery V2 connector](connector-google-bigquery.md) provides improved native Google BigQuery support. If you are using the [Google BigQuery V1 connector](connector-google-bigquery-legacy.md) in your solution, you are recommended to [upgrade your Google BigQuery connector](#upgrade-the-google-bigquery-v2-connector-from-version-10-to-version-11) before **September 30, 2025**. Refer to this [section](#differences-between-google-bigquery-and-google-bigquery-legacy) for details on the difference between V2 and V1.
20
+
> The [Google BigQuery V2 connector](connector-google-bigquery.md) provides improved native Google BigQuery support. If you are using the [Google BigQuery V1 connector](connector-google-bigquery-legacy.md) in your solution, please [upgrade your Google BigQuery connector](#upgrade-the-google-bigquery-linked-service) as V1 is at [End of Support stage](connector-deprecation-plan.md). Your pipeline will fail after **September 30, 2025** if not upgraded. Refer to this [section](#differences-between-google-bigquery-and-google-bigquery-legacy) for details on the difference between V2 and V1.
21
21
22
22
## Supported capabilities
23
23
@@ -223,7 +223,6 @@ To copy data from Google BigQuery, set the source type in the copy activity to *
223
223
224
224
To learn details about the properties, check [Lookup activity](control-flow-lookup-activity.md).
225
225
226
-
227
226
## <aname="differences-between-google-bigquery-and-google-bigquery-legacy"></a> Google BigQuery connector lifecycle and upgrade
228
227
229
228
The following table shows the release stage and change logs for different versions of the Google BigQuery connector:
@@ -234,6 +233,90 @@ The following table shows the release stage and change logs for different versio
234
233
| Google BigQuery V2 (version 1.0) | GA version available | • Service authentication is supported by the Azure integration runtime and the self-hosted integration runtime. <br>The properties `trustedCertPath`, `useSystemTrustStore`, `email` and `keyFilePath` are not supported as they are available on the self-hosted integration runtime only. <br><br> • `requestGoogleDriveScope` is not supported. You need additionally apply the permission in Google BigQuery service by referring to [Choose Google Drive API scopes](https://developers.google.com/drive/api/guides/api-specific-auth) and [Query Drive data](https://cloud.google.com/bigquery/docs/query-drive-data). <br><br> • `additionalProjects` is not supported. As an alternative, [query a public dataset with the Google Cloud console](https://cloud.google.com/bigquery/docs/quickstarts/query-public-dataset-console).<br><br> • NUMBER is read as Decimal data type. <br><br> • Timestamp and Datetime are read as DateTimeOffset data type.|
235
234
| Google BigQuery V2 (version 1.1) | GA version available | • When executing multiple statements, the `query` returns the complete set of results instead of only the result of the first statement. |
236
235
236
+
### <aname="upgrade-the-google-bigquery-linked-service"></a> Upgrade the Google BigQuery connector from V1 to V2
237
+
238
+
To upgrade the Google BigQuery connector from V1 to V2, you can do a side-by-side upgrade, or an in-place upgrade.
239
+
240
+
#### Side-by-side upgrade
241
+
242
+
To perform a side-by-side upgrade, complete the following steps:
243
+
244
+
1. Create a new Google BigQuery linked service and configure it by referring to the V2 linked service properties.
245
+
1. Create a dataset based on the newly created Google BigQuery linked service.
246
+
1. Replace the new linked service and dataset with the existing ones in the pipelines that targets the V1 objects.
247
+
248
+
#### In-place upgrade
249
+
250
+
To perform an in-place upgrade, you need to edit the existing linked service payload and update dataset to use the new linked service.
251
+
252
+
1. Update the type from **GoogleBigQuery** to **GoogleBigQueryV2**.
253
+
1. Modify the linked service payload from its V1 format to V2. You can either fill in each field from the user interface after changing the type mentioned above, or update the payload directly through the JSON Editor. Refer to the [Linked service properties](#linked-service-properties) section in this article for the supported connection properties. The following examples show the differences in payload for the V1 and V2 Google BigQuery linked services:
254
+
255
+
**Google BigQuery V1 linked service JSON payload:**
1. Update dataset to use the new linked service. You can either create a new dataset based on the newly created linked service, or update an existing dataset's type property from **GoogleBigQueryObject** to **GoogleBigQueryV2Object**.
316
+
317
+
>[!NOTE]
318
+
>When transitioning linked services, the override template parameter section might only display database properties. You can resolve this by manually editing the parameters. After that the **Override template parameters** section will show the connection strings.
319
+
237
320
### Upgrade the Google BigQuery V2 connector from version 1.0 to version 1.1
238
321
239
322
In **Edit linked service** page, select 1.1 for version. For more information, see [Linked service properties](#linked-service-properties).
0 commit comments