You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/data-factory/connector-amazon-redshift.md
+10-12Lines changed: 10 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,7 +7,7 @@ author: jianleishen
7
7
ms.subservice: data-movement
8
8
ms.custom: synapse
9
9
ms.topic: conceptual
10
-
ms.date: 06/12/2025
10
+
ms.date: 06/16/2025
11
11
---
12
12
13
13
# Copy data from Amazon Redshift using Azure Data Factory or Synapse Analytics
@@ -289,24 +289,22 @@ When you copy data from Amazon Redshift, the following mappings apply from Amazo
289
289
290
290
To learn details about the properties, check [Lookup activity](control-flow-lookup-activity.md).
291
291
292
-
## Upgrade the Amazon Redshift connector
292
+
## <aname="differences-between-amazon-redshift-connector-version-20-and-version-10"></a> Amazon Redshift connector lifecycle and upgrade
293
293
294
-
Here are steps that help you upgrade the Amazon Redshift connector:
294
+
The following table shows the release stage and change logs for different versions of the Impala connector:
295
+
296
+
| Version | Release stage | Change log |
297
+
| :----------- | :------- | :------- |
298
+
| Version 1.0 | GA version available | / |
299
+
| Version 2.0 (Preview) | Preview version available | • Only support the self-hosted integration runtime with version 5.54.0.0 or above. <br><br>• BOOLEAN is read as Boolean data type. |
300
+
301
+
### <aname="upgrade-the-amazon-redshift-connector"></a> Upgrade the Amazon Redshift connector from version 1.0 to version 2.0 (Preview)
295
302
296
303
1. In **Edit linked service** page, select version 2.0 (Preview) and configure the linked service by referring to [linked service properties](#linked-service-properties).
297
304
298
305
2. The data type mapping for the Amazon Redshift linked service version 2.0 (Preview) is different from that for the version 1.0. To learn the latest data type mapping, see [Data type mapping for Amazon Redshift](#data-type-mapping-for-amazon-redshift).
299
306
300
307
3. Apply a self-hosted integration runtime with version 5.54.0.0 or above. Azure integration runtime is not supported by version 2.0 (Preview).
301
308
302
-
## <aname="differences-between-amazon-redshift-connector-version-20-and-version-10"></a>Differences between Amazon Redshift connector version 2.0 (Preview) and version 1.0
303
-
304
-
The Amazon Redshift connector version 2.0 (Preview) offers new functionalities and is compatible with most features of version 1.0. The following table shows the feature differences between version 2.0 (Preview) and version 1.0.
305
-
306
-
| Version 2.0 (Preview) | Version 1.0 |
307
-
| :----------- | :------- |
308
-
| Only support the self-hosted integration runtime with version 5.54.0.0 or above. | Support the Azure integration runtime and self-hosted integration runtime. |
309
-
| The following mappings are used from Amazon Redshift data types to interim service data type.<br><br>BOOLEAN -> Boolean | The following mappings are used from Amazon Redshift data types to interim service data type.<br><br>BOOLEAN -> String |
310
-
311
309
## Related content
312
310
For a list of data stores supported as sources and sinks by the copy activity, see [supported data stores](copy-activity-overview.md#supported-data-stores-and-formats).
Copy file name to clipboardExpand all lines: articles/data-factory/connector-hive.md
+21-23Lines changed: 21 additions & 23 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ author: jianleishen
6
6
ms.subservice: data-movement
7
7
ms.custom: synapse
8
8
ms.topic: conceptual
9
-
ms.date: 05/27/2025
9
+
ms.date: 06/16/2025
10
10
ms.author: jianleishen
11
11
---
12
12
@@ -16,7 +16,7 @@ ms.author: jianleishen
16
16
This article outlines how to use the Copy Activity in an Azure Data Factory or Synapse Analytics pipeline to copy data from Hive. It builds on the [copy activity overview](copy-activity-overview.md) article that presents a general overview of copy activity.
17
17
18
18
> [!IMPORTANT]
19
-
> The Hive connector version 2.0 (Preview) provides improved native Hive support. If you are using the Hive connector version 1.0 in your solution, please [upgrade your Hive connector](#upgrade-the-hive-connector) before **September 30, 2025**. Refer to this [section](#differences-between-hive-version-20-and-version-10) for details on the difference between version 2.0 (Preview) and version 1.0.
19
+
> The Hive connector version 2.0 provides improved native Hive support. If you are using the Hive connector version 1.0 in your solution, please [upgrade your Hive connector](#upgrade-the-hive-connector) before **September 30, 2025**. Refer to this [section](#differences-between-hive-version-20-and-version-10) for details on the difference between version 2.0 and version 1.0.
20
20
21
21
## Supported capabilities
22
22
@@ -40,6 +40,9 @@ The connector supports the Windows versions in this [article](create-self-hosted
@@ -74,14 +77,13 @@ The following sections provide details about properties that are used to define
74
77
75
78
## Linked service properties
76
79
77
-
The Hive connector now supports version 2.0 (Preview). Refer to this [section](#upgrade-the-hive-connector) to upgrade your Hive connector version from version 1.0. For the property details, see the corresponding sections.
80
+
The Hive connector now supports version 2.0. Refer to this [section](#upgrade-the-hive-connector) to upgrade your Hive connector version from version 1.0. For the property details, see the corresponding sections.
78
81
79
-
-[Version 2.0 (Preview)](#version-20)
82
+
-[Version 2.0](#version-20)
80
83
-[Version 1.0](#version-10)
81
84
82
-
### <aname="version-20"></a> Version 2.0 (Preview)
83
-
84
-
The Hive linked service supports the following properties when apply version 2.0 (Preview):
85
+
### <aname="version-20"></a> Version 2.0
86
+
The Hive linked service supports the following properties when apply version 2.0:
85
87
86
88
| Property | Description | Required |
87
89
|:--- |:--- |:--- |
@@ -98,7 +100,7 @@ The Hive linked service supports the following properties when apply version 2.0
98
100
| enableSsl | Specifies whether the connections to the server are encrypted using TLS. The default value is true. | No |
99
101
| enableServerCertificateValidation | Specify whether to enable server SSL certificate validation when you connect. Always use System Trust Store. The default value is true. | No |
100
102
| storageReference | A reference to the linked service of the storage account used for staging data in mapping data flow. This is required only when using the Hive linked service in mapping data flow. | No |
101
-
| connectVia | The [Integration Runtime](concepts-integration-runtime.md) to be used to connect to the data store. Learn more from [Prerequisites](#prerequisites) section. If not specified, it uses the default Azure Integration Runtime. |No |
103
+
| connectVia | The [Integration Runtime](concepts-integration-runtime.md) to be used to connect to the data store. Learn more from [Prerequisites](#prerequisites) section. If not specified, it uses the default Azure Integration Runtime. You can use the self-hosted integration runtime and its version should be 5.54 or above. |No |
102
104
103
105
**Example:**
104
106
@@ -306,7 +308,7 @@ source(
306
308
307
309
When you copy data from and to Hive, the following interim data type mappings are used within the service. To learn about how the copy activity maps the source schema and data type to the sink, see [Schema and data type mappings](copy-activity-schema-and-type-mapping.md).
308
310
309
-
| Hive data type | Interim service data type (for version 2.0 (Preview)) | Interim service data type (for version 1.0) |
311
+
| Hive data type | Interim service data type (for version 2.0) | Interim service data type (for version 1.0) |
310
312
|:--- |:--- |:--- |
311
313
| TINYINT | Sbyte | Int16 |
312
314
| SMALLINT | Int16 | Int16 |
@@ -330,27 +332,23 @@ When you copy data from and to Hive, the following interim data type mappings ar
330
332
331
333
To learn details about the properties, check [Lookup activity](control-flow-lookup-activity.md).
332
334
333
-
## Upgrade the Hive connector
334
335
335
-
Here are steps that help you upgrade the Hive connector:
336
+
## <aname="differences-between-hive-version-20-and-version-10"></a> Hive connector lifecycle and upgrade
336
337
337
-
1. In **Edit linked service** page, select version 2.0 (Preview) and configure the linked service by referring to [Linked service properties version 2.0](#version-20).
338
+
The following table shows the release stage and change logs for different versions of the Hive connector:
338
339
339
-
2. The data type mapping for the Hive linked service version 2.0 (Preview) is different from that for the version 1.0. To learn the latest data type mapping, see [Data type mapping for Hive](#data-type-mapping-for-hive).
340
+
| Version | Release stage | Change log |
341
+
| :----------- | :------- | :------- |
342
+
| Version 1.0 | End of support announced | / |
343
+
| Version 2.0 | GA version available | • The self-hosted integration runtime version should be 5.54 or above. <br><br>• The default value of `enableSSL` is true. `enableServerCertificateValidation` is supported. <br>`trustedCertPath`, `useSystemTrustStore`, `allowHostNameCNMismatch` and `allowSelfSignedServerCert` are not supported. <br><br>• TINYINT is read as SByte data type. <br><br>• TIMESTAMP is read as DateTimeOffset data type. <br><br>• Using ';' to separate multiple hosts (only when serviceDiscoveryMode is enabled) is not supported. <br><br>• HiveServer1 and HiveThriftServer are not supported for `ServerType`. <br><br>• Username authentication type is not supported. SASL transport protocol only supports UsernameAndPassword authentication type. Binary transport protocol only supports Anonymous authentication type. <br><br>• `serviceDiscoveryMode`, `zooKeeperNameSpace` and `useNativeQuery` are not supported. |
340
344
341
-
## <aname="differences-between-hive-version-20-and-version-10"></a> Differences between Hive version 2.0 (Preview) and version 1.0
345
+
###<aname="upgrade-the-hive-connector"></a> Upgrade the Hive connector from version 1.0 to version 2.0
342
346
343
-
The Hive connector version 2.0 (Preview) offers new functionalities and is compatible with most features of version 1.0. The following table shows the feature differences between version 2.0 (Preview) and version 1.0.
347
+
1. In **Edit linked service** page, select version 2.0 and configure the linked service by referring to [Linked service properties version 2.0](#version-20).
344
348
345
-
| Version 2.0 (Preview) | Version 1.0 |
346
-
|:--- |:--- |
347
-
| Using ';' to separate multiple hosts (only when serviceDiscoveryMode is enabled) is not supported.| Using ';' to separate multiple hosts (only when serviceDiscoveryMode is enabled) is supported.|
348
-
| HiveServer1 and HiveThriftServer are not supported for `ServerType`. | Support HiveServer1 and HiveThriftServer for `ServerType`. |
349
-
| Username authentication type is not supported. <br><br>SASL transport protocol only supports UsernameAndPassword authentication type. Binary transport protocol only supports Anonymous authentication type. | Support Username authentication type. <br><br>SASL and Binary transport protocols support Anonymous, Username, UsernameAndPassword and WindowsAzureHDInsightService authentication types. |
350
-
|`serviceDiscoveryMode`, `zooKeeperNameSpace` and `useNativeQuery` are not supported. |`serviceDiscoveryMode`, `zooKeeperNameSpace`, `useNativeQuery` are supported. |
351
-
| The default value of `enableSSL` is true. `trustedCertPath`, `useSystemTrustStore`, `allowHostNameCNMismatch` and `allowSelfSignedServerCert` are not supported.<br><br>`enableServerCertificateValidation` is supported.| The default value of `enableSSL` is false. `trustedCertPath`, `useSystemTrustStore`, `allowHostNameCNMismatch` and `allowSelfSignedServerCert` are supported.<br><br>`enableServerCertificateValidation` is not supported. |
352
-
| The following mappings are used from Hive data types to interim service data type.<br><br>TINYINT -> SByte<br>TIMESTAMP -> DateTimeOffset | The following mappings are used from Hive data types to interim service data type.<br><br>TINYINT -> Int16 <br>TIMESTAMP -> DateTime |
349
+
2. The data type mapping for the Hive linked service version 2.0 is different from that for the version 1.0. To learn the latest data type mapping, see [Data type mapping for Hive](#data-type-mapping-for-hive).
353
350
351
+
3. Apply a self-hosted integration runtime with version 5.54 or above.
354
352
355
353
## Related content
356
354
For a list of data stores supported as sources and sinks by the copy activity, see [supported data stores](copy-activity-overview.md#supported-data-stores-and-formats).
0 commit comments