Skip to content

Commit 2fc9b90

Browse files
ttorblettorble
authored
Merge pull request #292824 from Lucky-Wang16/0109-Update_Greenplum_v2
[New feature] Update Greenplum V2 connector doc in ADF
2 parents 26bb642 + 48fa0c4 commit 2fc9b90

File tree

2 files changed

+159
-2
lines changed

2 files changed

+159
-2
lines changed

‎articles/data-factory/connector-greenplum.md

Lines changed: 159 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: jianleishen
66
ms.subservice: data-movement
77
ms.custom: synapse
88
ms.topic: conceptual
9-
ms.date: 10/20/2023
9+
ms.date: 01/09/2025
1010
ms.author: jianleishen
1111
---
1212
# Copy data from Greenplum using Azure Data Factory or Synapse Analytics
@@ -66,7 +66,92 @@ The following sections provide details about properties that are used to define
6666

6767
## Linked service properties
6868

69-
The following properties are supported for Greenplum linked service:
69+
The Greenplum connector now supports version 2.0 (Preview). Refer to this [section](#upgrade-the-greenplum-connector) to upgrade your Greenplum connector version from version 1.0. For the property details, see the corresponding sections.
70+
71+
- [Version 2.0 (Preview)](#version-20-preview)
72+
- [Version 1.0](#version-10)
73+
74+
### Version 2.0 (Preview)
75+
76+
The Greenplum linked service supports the following properties when apply version 2.0 (Preview):
77+
78+
| Property | Description | Required |
79+
|:--- |:--- |:--- |
80+
| type | The type property must be set to: **Greenplum** | Yes |
81+
| version | The version that you specify. The value is `2.0`. | Yes |
82+
| host | Specifies the host name - and optionally port - on which database is running. | Yes |
83+
| port | The TCP port of the database server. The default value is `5432`.| No |
84+
| database | The database to connect to. | Yes |
85+
| username | The username to connect with. Not required if using IntegratedSecurity. |Yes |
86+
| password| The password to connect with. Not required if using IntegratedSecurity. Mark this field as **SecureString** to store it securely. Or, you can [reference a secret stored in Azure Key Vault](store-credentials-in-key-vault.md). | Yes |
87+
| sslMode | Controls whether SSL is used, depending on server support. <br/>- **Disable**: SSL is disabled. If the server requires SSL, the connection will fail. <br/>- **Allow**: Prefer non-SSL connections if the server allows them, but allow SSL connections. <br/>- **Prefer**: Prefer SSL connections if the server allows them, but allow connections without SSL. <br/>- **Require**: Fail the connection if the server doesn't support SSL. <br/>- **Verify-ca**: Fail the connection if the server doesn't support SSL. Also verifies server certificate. <br/>- **Verify-full**: Fail the connection if the server doesn't support SSL. Also verifies server certificate with host's name. <br/> Options: Disable (0) / Allow (1) / Prefer (2) / Require (3) **(Default)** / Verify-ca (4) / Verify-full (5) | Yes |
88+
| authenticationType | Authentication type for connecting to the database. Only supports **Basic**. | Yes |
89+
| connectVia | The [Integration Runtime](concepts-integration-runtime.md) to be used to connect to the data store. Learn more from [Prerequisites](#prerequisites) section. If not specified, it uses the default Azure Integration Runtime. |No |
90+
| ***Additional connection properties:*** | | |
91+
| connectionTimeout | The time to wait (in seconds) while trying to establish a connection before terminating the attempt and generating an error. The default value is `15`. | No |
92+
| commandTimeout | The time to wait (in seconds) while trying to execute a command before terminating the attempt and generating an error. Set to zero for infinity. The default value is `30`. | No |
93+
94+
**Example:**
95+
96+
```json
97+
{
98+
"name": "GreenplumLinkedService",
99+
"properties": {
100+
"type": "Greenplum",
101+
"version": "2.0",
102+
"typeProperties": {
103+
"host": "<host>",
104+
"port": 5432,
105+
"database": "<database>",
106+
"username": "<username>",
107+
"password": {
108+
"type": "SecureString",
109+
"value": "<password>"
110+
},
111+
"sslMode": <sslmode>,
112+
"authenticationType": "Basic"
113+
},
114+
"connectVia": {
115+
"referenceName": "<name of Integration Runtime>",
116+
"type": "IntegrationRuntimeReference"
117+
}
118+
}
119+
}
120+
```
121+
**Example: store password in Azure Key Vault**
122+
```json
123+
{
124+
"name": "GreenplumLinkedService",
125+
"properties": {
126+
"type": "Greenplum",
127+
"version": "2.0",
128+
"typeProperties": {
129+
"host": "<host>",
130+
"port": 5432,
131+
"database": "<database>",
132+
"username": "<username>",
133+
"password": {
134+
"type": "AzureKeyVaultSecret",
135+
"store": {
136+
"referenceName": "<Azure Key Vault linked service name>",
137+
"type": "LinkedServiceReference"
138+
},
139+
"secretName": "<secretName>"
140+
},
141+
"sslMode": <sslmode>,
142+
"authenticationType": "Basic"
143+
},
144+
"connectVia": {
145+
"referenceName": "<name of Integration Runtime>",
146+
"type": "IntegrationRuntimeReference"
147+
}
148+
}
149+
}
150+
```
151+
152+
### Version 1.0
153+
154+
The Greenplum linked service supports the following properties when apply version 1.0:
70155

71156
| Property | Description | Required |
72157
|:--- |:--- |:--- |
@@ -193,9 +278,81 @@ To copy data from Greenplum, set the source type in the copy activity to **Green
193278
]
194279
```
195280

281+
## Data type mapping for Greenplum
282+
283+
When you copy data from Greenplum, the following mappings apply from Greenplum's data types to the internal data types used by the service. To learn about how the copy activity maps the source schema and data type to the sink, see [Schema and data type mappings](copy-activity-schema-and-type-mapping.md).
284+
285+
|Greenplum data type | Interim service data type (for version 2.0 (Preview)) | Interim service data type (for version 1.0) |
286+
|:---|:---|:---|
287+
|SmallInt|Int16|Int16|
288+
|Integer|Int32|Int32|
289+
|BigInt|Int64|Int64|
290+
|Decimal (Precision <= 28)|Decimal|Decimal|
291+
|Decimal (Precision > 28)|Decimal |String|
292+
|Numeric|Decimal|Decimal|
293+
|Real|Single|Single|
294+
|Double|Double|Double|
295+
|SmallSerial|Int16|Int16|
296+
|Serial|Int32|Int32|
297+
|BigSerial|Int64|Int64|
298+
|Money|Decimal|String|
299+
|Char|String|String|
300+
|Varchar|String|String|
301+
|Text|String|String|
302+
|Bytea|Byte[]|Byte[]|
303+
|Timestamp|DateTime|DateTime|
304+
|Timestamp with time zone|DateTimeOffset|String|
305+
|Date|Date|DateTime|
306+
|Time|TimeSpan|TimeSpan|
307+
|Time with time zone|DateTimeOffset|String|
308+
|Interval|TimeSpan|String|
309+
|Boolean|Boolean|Boolean|
310+
|Point|String|String|
311+
|Line|String|String|
312+
|Iseg|String|String|
313+
|Box|String|String|
314+
|Path|String|String|
315+
|Polygon|String|String|
316+
|Circle|String|String|
317+
|Cidr|String|String|
318+
|Inet|String|String|
319+
|Macaddr|String|String|
320+
|Macaddr8|String|String|
321+
|Tsvector|String|String|
322+
|Tsquery|String|String|
323+
|UUID|Guid|Guid|
324+
|Json|String|String|
325+
|Jsonb|String|String|
326+
|Array|String|String|
327+
|Bit|Byte[]|Byte[]|
328+
|Bit varying|Byte[]|Byte[]|
329+
|XML|String|String|
330+
|IntArray|String|String|
331+
|TextArray|String|String|
332+
|NumericArray|String|String|
333+
|DateArray|String|String|
334+
|Range|String|String|
335+
|Bpchar|String|String|
336+
196337
## Lookup activity properties
197338

198339
To learn details about the properties, check [Lookup activity](control-flow-lookup-activity.md).
199340

341+
## Upgrade the Greenplum connector
342+
343+
Here are steps that help you upgrade your Greenplum connector:
344+
345+
1. In **Edit linked service** page, select version 2.0 (Preview) and configure the linked service by referring to [linked service version 2.0 (Preview) properties](#version-20-preview).
346+
347+
2. The data type mapping for the Greenplum linked service version 2.0 (Preview) is different from that for the version 1.0. To learn the latest data type mapping, see [Data type mapping for Greenplum](#data-type-mapping-for-greenplum).
348+
349+
## Differences between Greenplum version 2.0 (Preview) and version 1.0
350+
351+
The Greenplum connector version 2.0 (Preview) offers new functionalities and is compatible with most features of version 1.0. The table below shows the feature differences between version 2.0 (Preview) and version 1.0.
352+
353+
| Version 2.0 (Preview) | Version 1.0 |
354+
| --- | --- |
355+
| The following mappings are used from Greenplum data types to interim service data type. <br><br> Decimal (Precision > 28) -> Decimal <br> Money -> Decimal <br> Timestamp with time zone -> DateTimeOffset <br>Time with time zone -> DateTimeOffset <br>Interval -> TimeSpan | The following mappings are used from Greenplum data types to interim service data type. <br><br> Decimal (Precision > 28) -> String <br> Money -> String <br> Timestamp with time zone ->String <br>Time with time zone -> String <br>Interval -> String |
356+
200357
## Related content
201358
For a list of data stores supported as sources and sinks by the copy activity, see [supported data stores](copy-activity-overview.md#supported-data-stores-and-formats).

‎articles/data-factory/media/connector-greenplum/configure-greenplum-linked-service.png

-6.8 KB
Loading

0 commit comments

Comments
 (0)