You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/data-factory/connector-azure-database-for-postgresql.md
+33-31Lines changed: 33 additions & 31 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -16,47 +16,47 @@ ms.date: 09/16/2019
16
16
ms.author: jingwang
17
17
18
18
---
19
-
# Copy data to and from Azure Database for PostgreSQL using Azure Data Factory
19
+
# Copy data to and from Azure Database for PostgreSQL by using Azure Data Factory
20
20
21
-
This article outlines how to use the Copy Activity in Azure Data Factory to copy data from Azure Database for PostgreSQL. It builds on the [copy activity overview](copy-activity-overview.md) article that presents a general overview of copy activity.
21
+
This article describes how to use the copy activity feature in Azure Data Factory to copy data from Azure Database for PostgreSQL. It builds on the [Copy activity in Azure Data Factory](copy-activity-overview.md) article, which presents a general overview of copy activity.
22
22
23
-
This connector is specialized for [Azure Database for PostgreSQL service](../postgresql/overview.md). To copy data from generic PostgreSQL database located on-premises or in the cloud, use [PostgreSQL connector](connector-postgresql.md).
23
+
This connector is specialized for the [Azure Database for PostgreSQL service](../postgresql/overview.md). To copy data from a generic PostgreSQL database located on-premises or in the cloud, use the[PostgreSQL connector](connector-postgresql.md).
24
24
25
25
## Supported capabilities
26
26
27
27
This Azure Database for PostgreSQL connector is supported for the following activities:
28
28
29
-
-[Copy activity](copy-activity-overview.md) with [supported source/sink matrix](copy-activity-overview.md)
29
+
-[Copy activity](copy-activity-overview.md) with a [supported source/sink matrix](copy-activity-overview.md)
You can copy data from Azure Database for PostgreSQL to any supported sink data store. Or, you can copy data from any supported source data store to Azure Database for PostgreSQL. For a list of data stores that are supported as sources/sinks by the copy activity, see the [Supported data stores](copy-activity-overview.md#supported-data-stores-and-formats) table.
32
+
You can copy data from Azure Database for PostgreSQL to any supported sink data store. Or, you can copy data from any supported source data store to Azure Database for PostgreSQL. For a list of data stores that the copy activity supports as sources and sinks, see the [Supported data stores](copy-activity-overview.md#supported-data-stores-and-formats) table.
33
33
34
-
Azure Data Factory provides a built-in driver to enable connectivity, therefore you don't need to manually install any driver using this connector.
34
+
Azure Data Factory provides a built-in driver to enable connectivity. Therefore, you don't need to manually install any driver to use this connector.
The following sections provide details about properties that are used to define Data Factory entities specific to Azure Database for PostgreSQL connector.
40
+
The following sections offer details about properties that are used to define Data Factory entities specific to Azure Database for PostgreSQL connector.
41
41
42
42
## Linked service properties
43
43
44
-
The following properties are supported for Azure Database for PostgreSQL linked service:
44
+
The following properties are supported for the Azure Database for PostgreSQL linked service:
45
45
46
46
| Property | Description | Required |
47
47
|:--- |:--- |:--- |
48
-
| type | The type property must be set to: **AzurePostgreSql**| Yes |
49
-
| connectionString | An ODBC connection string to connect to Azure Database for PostgreSQL.<br/>Mark this field as a SecureString to store it securely in Data Factory. You can also put password in Azure Key Vault and pull the `password` configuration out of the connection string. Refer to the following samples and [Store credentials in Azure Key Vault](store-credentials-in-key-vault.md)article with more details. | Yes |
50
-
| connectVia |The [Integration Runtime](concepts-integration-runtime.md) to be used to connect to the data store. You can use Azure Integration Runtime or Self-hosted Integration Runtime (if your data store is located in private network). If not specified, it uses the default Azure Integration Runtime. |No |
48
+
| type | The type property must be set to: **AzurePostgreSql**.| Yes |
49
+
| connectionString | An ODBC connection string to connect to Azure Database for PostgreSQL.<br/>Mark this field as a SecureString to store it securely in Data Factory. You can also put a password in Azure Key Vault and pull the `password` configuration out of the connection string. See the following samples and [Store credentials in Azure Key Vault](store-credentials-in-key-vault.md)for more details. | Yes |
50
+
| connectVia |This property represents the [integration runtime](concepts-integration-runtime.md) to be used to connect to the data store. You can use Azure Integration Runtime or Self-hosted Integration Runtime (if your data store is located in private network). If not specified, it uses the default Azure Integration Runtime. |No |
51
51
52
-
A typical connection string is `Server=<server>.postgres.database.azure.com;Database=<database>;Port=<port>;UID=<username>;Password=<Password>`. More properties you can set per your case:
52
+
A typical connection string is `Server=<server>.postgres.database.azure.com;Database=<database>;Port=<port>;UID=<username>;Password=<Password>`. Here are more properties you can set per your case:
53
53
54
54
| Property | Description | Options | Required |
55
55
|:--- |:--- |:--- |:--- |
56
-
| EncryptionMethod (EM)| The method the driver uses to encrypt data sent between the driver and the database server. E.g., `EncryptionMethod=<0/1/6>;`| 0 (No Encryption) **(Default)** / 1 (SSL) / 6 (RequestSSL) | No |
57
-
| ValidateServerCertificate (VSC) | Determines whether the driver validates the certificate that is sent by the database server when SSL encryption is enabled (Encryption Method=1). E.g., `ValidateServerCertificate=<0/1>;`| 0 (Disabled) **(Default)** / 1 (Enabled) | No |
56
+
| EncryptionMethod (EM)| The method the driver uses to encrypt data sent between the driver and the database server. For example, `EncryptionMethod=<0/1/6>;`| 0 (No Encryption) **(Default)** / 1 (SSL) / 6 (RequestSSL) | No |
57
+
| ValidateServerCertificate (VSC) | Determines whether the driver validates the certificate that's sent by the database server when SSL encryption is enabled (Encryption Method=1). For example, `ValidateServerCertificate=<0/1>;`| 0 (Disabled) **(Default)** / 1 (Enabled) | No |
58
58
59
-
**Example:**
59
+
**Example**:
60
60
61
61
```json
62
62
{
@@ -73,7 +73,9 @@ A typical connection string is `Server=<server>.postgres.database.azure.com;Data
73
73
}
74
74
```
75
75
76
-
**Example: store password in Azure Key Vault**
76
+
**Example**:
77
+
78
+
***Store password in Azure Key Vault***
77
79
78
80
```json
79
81
{
@@ -100,16 +102,16 @@ A typical connection string is `Server=<server>.postgres.database.azure.com;Data
100
102
101
103
## Dataset properties
102
104
103
-
For a full list of sections and properties available for defining datasets, see the [datasets](concepts-datasets-linked-services.md) article. This section provides a list of properties supported by Azure Database for PostgreSQL dataset.
105
+
For a full list of sections and properties available for defining datasets, see [Datasets in Azure Data Factory](concepts-datasets-linked-services.md). This section provides a list of properties that Azure Database for PostgreSQL supports in datasets.
104
106
105
107
To copy data from Azure Database for PostgreSQL, set the type property of the dataset to **AzurePostgreSqlTable**. The following properties are supported:
106
108
107
109
| Property | Description | Required |
108
110
|:--- |:--- |:--- |
109
-
| type | The type property of the dataset must be set to:**AzurePostgreSqlTable**| Yes |
110
-
| tableName | Name of the table.| No (if "query" in activity source is specified) |
111
+
| type | The type property of the dataset must be set to **AzurePostgreSqlTable**| Yes |
112
+
| tableName | Name of the table | No (if "query" in activity source is specified) |
111
113
112
-
**Example**
114
+
**Example**:
113
115
114
116
```json
115
117
{
@@ -127,18 +129,18 @@ To copy data from Azure Database for PostgreSQL, set the type property of the da
127
129
128
130
## Copy activity properties
129
131
130
-
For a full list of sections and properties available for defining activities, see the [Pipelines](concepts-pipelines-activities.md) article. This section provides a list of properties supported by Azure Database for PostgreSQL source.
132
+
For a full list of sections and properties available for defining activities, see [Pipelines and activities in Azure Data Factory](concepts-pipelines-activities.md). This section provides a list of properties supported by an Azure Database for PostgreSQL source.
131
133
132
134
### Azure Database for PostgreSql as source
133
135
134
136
To copy data from Azure Database for PostgreSQL, set the source type in the copy activity to **AzurePostgreSqlSource**. The following properties are supported in the copy activity **source** section:
135
137
136
138
| Property | Description | Required |
137
139
|:--- |:--- |:--- |
138
-
| type | The type property of the copy activity source must be set to:**AzurePostgreSqlSource**| Yes |
139
-
| query | Use the custom SQL query to read data. For example: `"SELECT * FROM MyTable"`.| No (if "tableName" in dataset is specified) |
140
+
| type | The type property of the copy activity source must be set to **AzurePostgreSqlSource**| Yes |
141
+
| query | Use the custom SQL query to read data. For example: `"SELECT * FROM MyTable"`| No (if the tableName property in the dataset is specified) |
140
142
141
-
**Example:**
143
+
**Example**:
142
144
143
145
```json
144
146
"activities":[
@@ -176,12 +178,12 @@ To copy data to Azure Database for PostgreSQL, the following properties are supp
176
178
177
179
| Property | Description | Required |
178
180
|:--- |:--- |:--- |
179
-
| type | The type property of the copy activity sink must be set to:**AzurePostgreSQLSink**| Yes |
180
-
| preCopyScript | Specify a SQL query for the copy activity to execute before writing data into Azure Database for PostgreSQL in each run. You can use this property to clean up the preloaded data. | No |
181
-
| writeBatchSize | Inserts data into the Azure Database for PostgreSQL table when the buffer size reaches writeBatchSize.<br>Allowed value is integer representing number of rows. | No (default is 10,000) |
182
-
| writeBatchTimeout | Wait time for the batch insert operation to complete before it times out.<br>Allowed values are Timespan. An example is 00:30:00 (30 minutes). | No (default is 00:00:30) |
181
+
| type | The type property of the copy activity sink must be set to **AzurePostgreSQLSink**.| Yes |
182
+
| preCopyScript | Specify a SQL query for the copy activity to execute before you write data into Azure Database for PostgreSQL in each run. You can use this property to clean up the preloaded data. | No |
183
+
| writeBatchSize | Inserts data into the Azure Database for PostgreSQL table when the buffer size reaches writeBatchSize.<br>Allowed value is an integer that represents the number of rows. | No (default is 10,000) |
184
+
| writeBatchTimeout | Wait time for the batch insert operation to complete before it times out.<br>Allowed values are Timespan strings. An example is 00:30:00 (30 minutes). | No (default is 00:00:30) |
183
185
184
-
**Example:**
186
+
**Example**:
185
187
186
188
```json
187
189
"activities":[
@@ -216,7 +218,7 @@ To copy data to Azure Database for PostgreSQL, the following properties are supp
216
218
217
219
## Lookup activity properties
218
220
219
-
To learn details about the properties, check[Lookup activity](control-flow-lookup-activity.md).
221
+
For more information about the properties, see[Lookup activity in Azure Data Factory](control-flow-lookup-activity.md).
220
222
221
223
## Next steps
222
-
For a list of data stores supported as sources and sinks by the copy activity in Azure Data Factory, see [supported data stores](copy-activity-overview.md#supported-data-stores-and-formats).
224
+
For a list of data stores supported as sources and sinks by the copy activity in Azure Data Factory, see [Supported data stores](copy-activity-overview.md#supported-data-stores-and-formats).
0 commit comments