Skip to content

Commit dd5df4c

Browse files
committed
minor fix
1 parent 740876d commit dd5df4c

File tree

1 file changed

+5
-5
lines changed

1 file changed

+5
-5
lines changed

articles/synapse-analytics/spark/apache-spark-external-metastore.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ The feature works with Spark 3.3. The following table shows the supported Hive M
2929
## Set up linked service to Hive Metastore
3030

3131
> [!NOTE]
32-
> Only **Azure SQL Database** and **Azure Database for MySQL** are supported as an external Hive Metastore. SQL(User-Password) authentication is supported for both kinds of databases. Additionally, managed identity(including system-sssigned and user-assigned) authentication is supported only for Azure SQL Database and Spark 3.4. If the provided database is blank, please provision it via [Hive Schema Tool](https://cwiki.apache.org/confluence/display/Hive/Hive+Schema+Tool) to create database schema.
32+
> Only **Azure SQL Database** and **Azure Database for MySQL** are supported as an external Hive Metastore. SQL(username-password) authentication is supported for both kinds of databases. Additionally, managed identity(including system-sssigned and user-assigned) authentication is supported only for Azure SQL Database and Spark 3.4. If the provided database is blank, please provision it via [Hive Schema Tool](https://cwiki.apache.org/confluence/display/Hive/Hive+Schema+Tool) to create database schema.
3333
3434
Follow below steps to set up a linked service to the external Hive Metastore in Synapse workspace.
3535

@@ -121,7 +121,7 @@ Here are the configurations and descriptions:
121121
| `spark.sql.hive.metastore.version` | Supported versions: <ul><li>`2.3`</li><li>`3.1`</li></ul> Make sure you use the first 2 parts without the 3rd part |
122122
| `spark.sql.hive.metastore.jars` | <ul><li>Version 2.3: `/opt/hive-metastore/lib-2.3/*:/usr/hdp/current/hadoop-client/lib/*:/usr/hdp/current/hadoop-client/*` </li><li>Version 3.1: `/opt/hive-metastore/lib-3.1/*:/usr/hdp/current/hadoop-client/lib/*:/usr/hdp/current/hadoop-client/*`</li></ul> |
123123
| `spark.hadoop.hive.synapse.externalmetastore.linkedservice.name` | Name of your linked service |
124-
| `spark.sql.hive.metastore.sharedPrefixes` | `com.mysql.jdbc,com.microsoft.sqlserver,com.microsoft.vegas` |
124+
| `spark.sql.hive.metastore.sharedPrefixes` | `com.mysql.jdbc,com.microsoft.vegas` |
125125

126126

127127
### Configure at Spark pool level
@@ -135,7 +135,7 @@ Update metastore version and linked service name, and save below configs in a te
135135
spark.sql.hive.metastore.version <your hms version, Make sure you use the first 2 parts without the 3rd part>
136136
spark.hadoop.hive.synapse.externalmetastore.linkedservice.name <your linked service name>
137137
spark.sql.hive.metastore.jars /opt/hive-metastore/lib-<your hms version, 2 parts>/*:/usr/hdp/current/hadoop-client/lib/*
138-
spark.sql.hive.metastore.sharedPrefixes com.mysql.jdbc,com.microsoft.sqlserver,com.microsoft.vegas
138+
spark.sql.hive.metastore.sharedPrefixes com.mysql.jdbc,com.microsoft.vegas
139139
```
140140

141141
Here is an example for metastore version 2.3 with linked service named as HiveCatalog21:
@@ -144,7 +144,7 @@ Here is an example for metastore version 2.3 with linked service named as HiveCa
144144
spark.sql.hive.metastore.version 2.3
145145
spark.hadoop.hive.synapse.externalmetastore.linkedservice.name HiveCatalog21
146146
spark.sql.hive.metastore.jars /opt/hive-metastore/lib-2.3/*:/usr/hdp/current/hadoop-client/lib/*
147-
spark.sql.hive.metastore.sharedPrefixes com.mysql.jdbc,com.microsoft.sqlserver,com.microsoft.vegas
147+
spark.sql.hive.metastore.sharedPrefixes com.mysql.jdbc,com.microsoft.vegas
148148
```
149149

150150
### Configure at Spark session level
@@ -157,7 +157,7 @@ For notebook session, you can also configure the Spark session in notebook using
157157
"spark.sql.hive.metastore.version":"<your hms version, 2 parts>",
158158
"spark.hadoop.hive.synapse.externalmetastore.linkedservice.name":"<your linked service name>",
159159
"spark.sql.hive.metastore.jars":"/opt/hive-metastore/lib-<your hms version, 2 parts>/*:/usr/hdp/current/hadoop-client/lib/*",
160-
"spark.sql.hive.metastore.sharedPrefixes":"com.mysql.jdbc,com.microsoft.sqlserver,com.microsoft.vegas"
160+
"spark.sql.hive.metastore.sharedPrefixes":"com.mysql.jdbc,com.microsoft.vegas"
161161
}
162162
}
163163
```

0 commit comments

Comments
 (0)