Skip to content

Commit 4b357e1

Browse files
authored
Update hdinsight-use-external-metadata-stores.md
updated the sharing common metastore in HDInsight 4.0
1 parent 6423b66 commit 4b357e1

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

articles/hdinsight/hdinsight-use-external-metadata-stores.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ ms.reviewer: jasonh
77
ms.service: hdinsight
88
ms.topic: conceptual
99
ms.custom: hdinsightactive
10-
ms.date: 04/03/2020
10+
ms.date: 04/09/2020
1111
---
1212

1313
# Use external metadata stores in Azure HDInsight
@@ -90,6 +90,8 @@ You can point your cluster to a previously created Azure SQL Database at any tim
9090

9191
* In HDInsight 4.0, Spark and Hive use independent catalogs for accessing SparkSQL or Hive tables. A table created by Spark lives in the Spark catalog. A table created by Hive lives in the Hive catalog. This behavior is different than HDInsight 3.6 where Hive and Spark shared common catalog. Hive and Spark Integration in HDInsight 4.0 relies on Hive Warehouse Connector (HWC). HWC works as a bridge between Spark and Hive. [Learn about Hive Warehouse Connector](../hdinsight/interactive-query/apache-hive-warehouse-connector.md).
9292

93+
* In HDInsight 4.0 if you would like to Share the metastore between Hive and Spark, you can do so by changing the property metastore.catalog.default to hive in your Spark cluster. You can find this property in Ambari Advanced spark2-hive-site-override. It’s important to understand that sharing of metastore only works for external hive tables, this will not work if you have internal/managed hive tables or ACID tables.
94+
9395
## Apache Oozie metastore
9496

9597
Apache Oozie is a workflow coordination system that manages Hadoop jobs. Oozie supports Hadoop jobs for Apache MapReduce, Pig, Hive, and others. Oozie uses a metastore to store details about workflows. To increase performance when using Oozie, you can use Azure SQL Database as a custom metastore. The metastore provides access to Oozie job data after you delete your cluster.

0 commit comments

Comments
 (0)