You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/data-factory/connector-hive.md
+9-6Lines changed: 9 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -15,6 +15,9 @@ ms.author: jianleishen
15
15
16
16
This article outlines how to use the Copy Activity in an Azure Data Factory or Synapse Analytics pipeline to copy data from Hive. It builds on the [copy activity overview](copy-activity-overview.md) article that presents a general overview of copy activity.
17
17
18
+
> [!IMPORTANT]
19
+
> The Hive connector version 2.0 (Preview) provides improved native Hive support. If you are using the Hive connector version 1.0 in your solution, please [upgrade your Hive connector](#upgrade-the-hive-connector) before **September 30, 2025**. Refer to this [section](#differences-between-hive-version-20-and-version-10) for details on the difference between version 2.0 (Preview) and version 1.0.
20
+
18
21
## Supported capabilities
19
22
20
23
This Hive connector is supported for the following capabilities:
@@ -87,7 +90,7 @@ The Hive linked service supports the following properties when apply version 2.0
87
90
| host | IP address or host name of the Hive server. | Yes |
88
91
| port | The TCP port that the Hive server uses to listen for client connections. If you connect to Azure HDInsight, specify port as 443. | Yes |
89
92
| serverType | The type of Hive server. <br/>Allowed value is: **HiveServer2**| No |
90
-
| thriftTransportProtocol | The transport protocol to use in the Thrift layer. <br/>Allowed value is: **HTTP**| No |
93
+
| thriftTransportProtocol | The transport protocol to use in the Thrift layer. <br/>Allowed value is: **Binary**, **SASL**, **HTTP**| No |
91
94
| authenticationType | The authentication method used to access the Hive server. <br/>Allowed values are: **Anonymous**, **UsernameAndPassword**, **WindowsAzureHDInsightService**. Kerberos authentication is not supported now. | Yes |
92
95
| username | The user name that you use to access Hive Server. | No |
93
96
| password | The password corresponding to the user. Mark this field as a SecureString to store it securely, or [reference a secret stored in Azure Key Vault](store-credentials-in-key-vault.md). | No |
@@ -335,17 +338,17 @@ Here are steps that help you upgrade the Hive connector:
335
338
336
339
2. The data type mapping for the Hive linked service version 2.0 (Preview) is different from that for the version 1.0. To learn the latest data type mapping, see [Data type mapping for Hive](#data-type-mapping-for-hive).
337
340
338
-
## Differences between Hive version 2.0 (Preview) and version 1.0
341
+
## <aname="differences-between-hive-version-20-and-version-10"></a> Differences between Hive version 2.0 (Preview) and version 1.0
339
342
340
343
The Hive connector version 2.0 (Preview) offers new functionalities and is compatible with most features of version 1.0. The following table shows the feature differences between version 2.0 (Preview) and version 1.0.
341
344
342
345
| Version 2.0 (Preview) | Version 1.0 |
343
346
|:--- |:--- |
344
347
| Using ';' to separate multiple hosts (only when serviceDiscoveryMode is enabled) is not supported.| Using ';' to separate multiple hosts (only when serviceDiscoveryMode is enabled) is supported.|
345
-
|`ServerType` does not support `HiveServer1` and `HiveThriftServer`. |`ServerType` supports `HiveServer1` and `HiveThriftServer`. |
346
-
|`authenticationType` does not support `Username`. |`authenticationType` supports `Username`. |
347
-
|The default value of `enableSSL` is true. <br><br>`enableServerCertificateValidation` is supported.<br><br>`serviceDiscoveryMode`, `zooKeeperNameSpace`, `useNativeQuery`, `trustedCertPath`, `useSystemTrustStore`, `allowHostNameCNMismatch`and `allowSelfSignedServerCert` are not supported.| The default value of `enableSSL` is false.<br><br>`enableServerCertificateValidation` is not supported.<br><br>`serviceDiscoveryMode`, `zooKeeperNameSpace`, `useNativeQuery`, `trustedCertPath`, `useSystemTrustStore`, `allowHostNameCNMismatch` and `allowSelfSignedServerCert` are supported. |
348
-
|`thriftTransportProtocol` does not support `Binary`and `SASL`.|`thriftTransportProtocol` supports `Binary`and `SASL`.|
348
+
|HiveServer1 and HiveThriftServer are not supported for `ServerType`. |Support HiveServer1 and HiveThriftServer for `ServerType`. |
349
+
|Username authentication type is not supported. <br><br> UsernameAndPassword authentication type is only supported for SASL transport protocol. Anonymous authentication type is only supported for Binary transport protocol. | Support Username authentication type. <br><br>UsernameAndPassword and Anonymous authentication types are supported for Binary, SASL and HTTP transport protocols. |
350
+
|`serviceDiscoveryMode`, `zooKeeperNameSpace`and `useNativeQuery` are not supported.|`serviceDiscoveryMode`, `zooKeeperNameSpace`, `useNativeQuery` are supported. |
351
+
|The default value of `enableSSL` is true. `trustedCertPath`, `useSystemTrustStore`, `allowHostNameCNMismatch`and `allowSelfSignedServerCert` are not supported.<br><br>`enableServerCertificateValidation` is supported.| The default value of `enableSSL` is false. `trustedCertPath`, `useSystemTrustStore`, `allowHostNameCNMismatch`and `allowSelfSignedServerCert` are supported.<br><br>`enableServerCertificateValidation` is not supported. |
349
352
| The following mappings are used from Hive data types to interim service data type.<br><br>TINYINT -> SByte<br>TIMESTAMP -> DateTimeOffset | The following mappings are used from Hive data types to interim service data type.<br><br>TINYINT -> Int16 <br>TIMESTAMP -> DateTime |
0 commit comments