You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/cloud/integrations/security-and-connectivity/aws-privatelink-integration.mdx
+72-1Lines changed: 72 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -46,7 +46,7 @@ In order to set up a PrivateLink connection with Snowflake, please follow the st
46
46
3.**Provide Elementary with the configuration obtained in the previous step.**
47
47
1. Elementary will then setup the required infrastructure to connect to Snowflake via PrivateLink.
48
48
4.**Add a Snowflake environment in Elementary**
49
-
1. Follow the instructions [here](https://docs.elementary-data.com/cloud/onboarding/connect-data-warehouse) to set up a Snowflake environment in Elementary.
49
+
1. Follow the instructions [here](/cloud/integrations/dwh/snowflake) to set up a Snowflake environment in Elementary.
50
50
1. When supplying the account, use `<account_identifier>.privatelink` , where the account identifier is the result of the following query:
51
51
52
52
```sql
@@ -58,6 +58,77 @@ In order to set up a PrivateLink connection with Snowflake, please follow the st
58
58
* 10.0.2.x
59
59
* 10.0.3.x
60
60
61
+
### Databricks
62
+
63
+
Databricks has support for connecting to AWS-hosted Databricks workspaces via PrivateLink. This setup is entirely managed by Databricks, so Elementary connects with an endpoint service hosted on Databrick's AWS account for this purpose.
64
+
65
+
**Note**:
66
+
1. You must be a Databricks account admin to perform this setup.
67
+
2. Your databricks workspace must be deployed on a customer-managed VPC. PrivateLink is not supported with Databricks-managed VPCs.
68
+
69
+
In order to set up a PrivateLink connection with Databricks, please follow the steps below:
70
+
71
+
1.**Please provide Elementary with the following details:**
72
+
* Your databricks workspace URL.
73
+
* Your AWS account ID.
74
+
* Your AWS region.
75
+
76
+
Elementary will then provide you with a VPC Endpoint ID that will be used in the next step.
77
+
78
+
2.**Register your VPC endpoint**
79
+
80
+
In the account management portal (not your workspace), go to Security -> Networking -> VPC Endpoints,
81
+
then click on the "Register VPC Endpoint" button.
82
+
83
+
You should fill in:
84
+
1. A name for the VPC endpoint - e.g. "Elementary".
85
+
2. Your AWS region.
86
+
3. The VPC Endpoint ID provided to you by Elementary.
4.**Add the private access setting to your Databricks workspace**
114
+
115
+
__Note__: If you have already set up Privatelink with Databricks in the past, you can skip this step.
116
+
117
+
Under the Databricks account management portal, go to Workspaces, click on your workspace and then on "Update Workspace".
118
+
Then go to "Advanced Configurations", and under "Private Link", please attach the setting created in the previous step.
119
+
120
+
5.**Add a Databricks environment in Elementary**
121
+
122
+
After all the previous steps are completed, please reach out to the Elementary team to verify that your Databricks cluster is accessible via PrivateLink.
123
+
124
+
Once verified, please add a Databricks environment to Elementary by following [this guide](/cloud/integrations/dwh/databricks).
125
+
126
+
Under the *Add the Elementary IP to allowlist* section, please add the following private subnets *instead* of the IP mentioned there:
You will connect Elementary Cloud to Athena for syncing the Elementary schema (created by the [Elementary dbt package](/cloud/onboarding/quickstart-dbt-package)).
3
+
This guide contains the necessary steps to connect an Athena environment to your Elementary account.
You will connect Elementary Cloud to Bigquery for syncing the Elementary schema (created by the [Elementary dbt package](/cloud/onboarding/quickstart-dbt-package)).
5
+
This guide contains the necessary steps to connect a BigQuery environment to your Elementary account.
This guide contains the necessary steps to connect an Clickhouse environment to your Elementary account.
5
+
4
6
You will connect Elementary Cloud to Clickhouse for syncing the Elementary schema (created by the [Elementary dbt package](/cloud/onboarding/quickstart-dbt-package)).
You will connect Elementary Cloud to Databricks for syncing the Elementary schema (created by the [Elementary dbt package](/cloud/onboarding/quickstart-dbt-package)).
5
+
This guide contains the necessary steps to connect a Databricks environment to your Elementary account.
You will connect Elementary Cloud to Postgres for syncing the Elementary schema (created by the [Elementary dbt package](/cloud/onboarding/quickstart-dbt-package)).
4
+
This guide contains the necessary steps to connect a Postgres environment to your Elementary account.
You will connect Elementary Cloud to Redshift for syncing the Elementary schema (created by the [Elementary dbt package](/cloud/onboarding/quickstart-dbt-package)).
4
+
This guide contains the necessary steps to connect a Redshift environment to your Elementary account.
You will connect Elementary Cloud to Snowflake for syncing the Elementary schema (created by the [Elementary dbt package](/cloud/onboarding/quickstart-dbt-package)).
3
+
This guide contains the necessary steps to connect a Snowflake environment to your Elementary account.
0 commit comments