Skip to content

Commit d44918c

Browse files
Merge branch 'main' of https://github.com/MicrosoftDocs/azure-docs-pr into devguide-sas
2 parents 0d59403 + 2a9fe50 commit d44918c

File tree

92 files changed

+388
-860
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

92 files changed

+388
-860
lines changed

articles/data-factory/connector-vertica.md

Lines changed: 99 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: jianleishen
66
ms.subservice: data-movement
77
ms.custom: synapse
88
ms.topic: conceptual
9-
ms.date: 10/20/2023
9+
ms.date: 08/12/2024
1010
ms.author: jianleishen
1111
---
1212
# Copy data from Vertica using Azure Data Factory or Synapse Analytics
@@ -20,18 +20,49 @@ This Vertica connector is supported for the following capabilities:
2020

2121
| Supported capabilities|IR |
2222
|---------| --------|
23-
|[Copy activity](copy-activity-overview.md) (source/-)|① ②|
24-
|[Lookup activity](control-flow-lookup-activity.md)|① ②|
23+
|[Copy activity](copy-activity-overview.md) (source/-)|① (only for version 1.0) ②|
24+
|[Lookup activity](control-flow-lookup-activity.md)|① (only for version 1.0) ②|
2525

2626
*① Azure integration runtime ② Self-hosted integration runtime*
2727

2828
For a list of data stores that are supported as sources/sinks by the copy activity, see the [Supported data stores](copy-activity-overview.md#supported-data-stores-and-formats) table.
2929

3030
The service provides a built-in driver to enable connectivity, therefore you don't need to manually install any driver using this connector.
3131

32+
For version 2.0 (Preview), you need to [install a Vertica ODBC driver](#install-vertica-odbc-driver-for-the-version-20-preview) manually. For version 1.0, the service provides a built-in driver to enable connectivity, therefore you don't need to manually install any driver.
33+
3234
## Prerequisites
3335

34-
[!INCLUDE [data-factory-v2-integration-runtime-requirements](includes/data-factory-v2-integration-runtime-requirements.md)]
36+
If your data store is located inside an on-premises network, an Azure virtual network, or Amazon Virtual Private Cloud, you need to configure a [self-hosted integration runtime](create-self-hosted-integration-runtime.md) to connect to it. If you use the version 2.0 (Preview), your self-hosted integration runtime version should be 5.44.8984.1 or above.
37+
38+
For more information about the network security mechanisms and options supported by Data Factory, see [Data access strategies](data-access-strategies.md).
39+
40+
### For version 1.0
41+
42+
If your data store is a managed cloud data service, you can use the Azure Integration Runtime. If the access is restricted to IPs that are approved in the firewall rules, you can add [Azure Integration Runtime IPs](azure-integration-runtime-ip-addresses.md) to the allowlist.
43+
44+
You can also use the [managed virtual network integration runtime](tutorial-managed-virtual-network-on-premise-sql-server.md) feature in Azure Data Factory to access the on-premises network without installing and configuring a self-hosted integration runtime.
45+
46+
47+
### Install Vertica ODBC driver for the version 2.0 (Preview)
48+
49+
To use Vertica connector with version 2.0 (Preview), install the Vertica ODBC driver on the machine running the self-hosted Integration runtime by following these steps:
50+
51+
1. Download the Vertica client setup for ODBC driver from [Client Drivers | OpenText™ Vertica™](https://www.vertica.com/download/vertica/client-drivers/). Take Windows system setup as an example:
52+
53+
:::image type="content" source="media/connector-vertica/download.png" alt-text="Screenshot of a Windows system setup example.":::
54+
55+
1. Open the downloaded .exe to begin the installation process. 
56+
57+
:::image type="content" source="media/connector-vertica/install.png" alt-text="Screenshot of the installation process.":::
58+
59+
1. Select **ODBC driver** under Vertica Component List, then select **Next** to start the installation.
60+
61+
:::image type="content" source="media/connector-vertica/select-odbc-driver.png" alt-text="Screenshot of selecting ODBC driver.":::
62+
63+
1. After the installation process is successfully completed, you can go to Start -> ODBC Data Source Administrator to confirm the successful installation.
64+
65+
:::image type="content" source="media/connector-vertica/confirm-the successful-installation.png" alt-text="Screenshot of confirming the successful installation.":::
3566

3667
## Getting started
3768

@@ -66,13 +97,18 @@ The following sections provide details about properties that are used to define
6697

6798
## Linked service properties
6899

69-
The following properties are supported for Vertica linked service:
100+
If you use version 2.0 (Preview), the following properties are supported for Vertica linked service:
70101

71102
| Property | Description | Required |
72103
|:--- |:--- |:--- |
73104
| type | The type property must be set to: **Vertica** | Yes |
74-
| connectionString | An ODBC connection string to connect to Vertica.<br/>You can also put password in Azure Key Vault and pull the `pwd` configuration out of the connection string. Refer to the following samples and [Store credentials in Azure Key Vault](store-credentials-in-key-vault.md) article with more details. | Yes |
75-
| connectVia | The [Integration Runtime](concepts-integration-runtime.md) to be used to connect to the data store. Learn more from [Prerequisites](#prerequisites) section. If not specified, it uses the default Azure Integration Runtime. |No |
105+
| server | The name or the IP address of the server to which you want to connect. | Yes |
106+
| port | The port number of the server listener. | No, default is 5433 |
107+
| database | Name of the Vertica database. | Yes |
108+
| uid | The user ID that is used to connect to the database. | Yes |
109+
| pwd | The password that the application uses to connect to the database. | Yes |
110+
| version | The version when you select version 2.0 (Preview). The value is `2.0`. | Yes |
111+
| connectVia | The [Integration Runtime](concepts-integration-runtime.md) to be used to connect to the data store. Learn more from [Prerequisites](#prerequisites) section. You can only use the self-hosted integration runtime and its version should be 5.44.8984.1 or above. |No |
76112

77113
**Example:**
78114

@@ -81,8 +117,16 @@ The following properties are supported for Vertica linked service:
81117
"name": "VerticaLinkedService",
82118
"properties": {
83119
"type": "Vertica",
120+
"version": "2.0",
84121
"typeProperties": {
85-
"connectionString": "Server=<server>;Port=<port>;Database=<database>;UID=<user name>;PWD=<password>"
122+
"server": "<server>",
123+
"port": 5433,
124+
"uid": "<username>",
125+
"database": "<database>",
126+
"pwd": {
127+
"type": "SecureString",
128+
"value": "<password>"
129+
}
86130
},
87131
"connectVia": {
88132
"referenceName": "<name of Integration Runtime>",
@@ -99,15 +143,19 @@ The following properties are supported for Vertica linked service:
99143
"name": "VerticaLinkedService",
100144
"properties": {
101145
"type": "Vertica",
146+
"version": "2.0",
102147
"typeProperties": {
103-
"connectionString": "Server=<server>;Port=<port>;Database=<database>;UID=<user name>;",
104-
"pwd": { 
105-
"type": "AzureKeyVaultSecret", 
106-
"store": { 
107-
"referenceName": "<Azure Key Vault linked service name>", 
108-
"type": "LinkedServiceReference" 
109-
}, 
110-
"secretName": "<secretName>" 
148+
"server": "<server>",
149+
"port": 5433,
150+
"uid": "<username>",
151+
"database": "<database>",
152+
"pwd": {
153+
"type": "AzureKeyVaultSecret",
154+
"store": {
155+
"referenceName": "<Azure Key Vault linked service name>",
156+
"type": "LinkedServiceReference"
157+
},
158+
"secretName": "<secretName>"
111159
}
112160
},
113161
"connectVia": {
@@ -118,6 +166,32 @@ The following properties are supported for Vertica linked service:
118166
}
119167
```
120168

169+
If you use version 1.0, the following properties are supported:
170+
171+
| Property | Description | Required |
172+
|:--- |:--- |:--- |
173+
| type | The type property must be set to: **Vertica** | Yes |
174+
| connectionString | An ODBC connection string to connect to Vertica.<br/>You can also put password in Azure Key Vault and pull the `pwd` configuration out of the connection string. Refer to the following samples and [Store credentials in Azure Key Vault](store-credentials-in-key-vault.md) article with more details. | Yes |
175+
| connectVia | The [Integration Runtime](concepts-integration-runtime.md) to be used to connect to the data store. Learn more from [Prerequisites](#prerequisites) section. If not specified, it uses the default Azure Integration Runtime. |No |
176+
177+
**Example:**
178+
179+
```json
180+
{
181+
"name": "VerticaLinkedService",
182+
"properties": {
183+
"type": "Vertica",
184+
"typeProperties": {
185+
"connectionString": "Server=<server>;Port=<port>;Database=<database>;UID=<user name>;PWD=<password>"
186+
},
187+
"connectVia": {
188+
"referenceName": "<name of Integration Runtime>",
189+
"type": "IntegrationRuntimeReference"
190+
}
191+
}
192+
}
193+
```
194+
121195
## Dataset properties
122196

123197
For a full list of sections and properties available for defining datasets, see the [datasets](concepts-datasets-linked-services.md) article. This section provides a list of properties supported by Vertica dataset.
@@ -129,7 +203,6 @@ To copy data from Vertica, set the type property of the dataset to **VerticaTabl
129203
| type | The type property of the dataset must be set to: **VerticaTable** | Yes |
130204
| schema | Name of the schema. |No (if "query" in activity source is specified) |
131205
| table | Name of the table. |No (if "query" in activity source is specified) |
132-
| tableName | Name of the table with schema. This property is supported for backward compatibility. Use `schema` and `table` for new workload. | No (if "query" in activity source is specified) |
133206

134207
**Example**
135208

@@ -159,7 +232,7 @@ To copy data from Vertica, set the source type in the copy activity to **Vertica
159232
| Property | Description | Required |
160233
|:--- |:--- |:--- |
161234
| type | The type property of the copy activity source must be set to: **VerticaSource** | Yes |
162-
| query | Use the custom SQL query to read data. For example: `"SELECT * FROM MyTable"`. | No (if "tableName" in dataset is specified) |
235+
| query | Use the custom SQL query to read data. For example: `"SELECT * FROM MyTable"`. | No (if "schema+table" in dataset is specified) |
163236

164237
**Example:**
165238

@@ -197,5 +270,13 @@ To copy data from Vertica, set the source type in the copy activity to **Vertica
197270

198271
To learn details about the properties, check [Lookup activity](control-flow-lookup-activity.md).
199272

273+
## Upgrade the Vertica version
274+
275+
Here are steps that help you upgrade your Vertica version:
276+
277+
1. Install a Vertica ODBC driver by following the steps in [Prerequisites](#install-vertica-odbc-driver-for-the-version-20-preview).
278+
1. In **Edit linked service page**, select **2.0 (Preview)** under **Version** and configure the linked service by referring to [Linked service properties](#linked-service-properties).
279+
1. Apply a self-hosted integration runtime with version 5.44.8984.1 or above. Azure integration runtime is not supported by version 2.0 (Preview).
280+
200281
## Related content
201282
For a list of data stores supported as sources and sinks by the copy activity, see [supported data stores](copy-activity-overview.md#supported-data-stores-and-formats).
-7 KB
Loading
443 KB
Loading
37.1 KB
Loading
106 KB
Loading
146 KB
Loading

0 commit comments

Comments
 (0)