You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@@ -47,15 +44,17 @@ This table lists certain HDInsight 4.0 cluster types that have retired or will b
47
44
48
45
> [!NOTE]
49
46
> * If you are using Azure User Interface to create a Spark Cluster for HDInsight, you will see from the dropdown list an additional version Spark 3.1.(HDI 5.0) along with the older versions. This version is a renamed version of Spark 3.1.(HDI 4.0) and it is backward compatible.
50
-
> * This is only an UI level change, which doesn’t impact anything for the existing users and users who are already using the ARM template to build their clusters. For backward compatibility, ARM supports creating spark 4.0 and 5.0 for 3.1 version which maps to same versions spark 3.1 (5.0)
47
+
> * This is only an UI level change, which doesn’t impact anything for the existing users and users who are already using the ARM template to build their clusters. > * For backward compatibility, ARM supports creating Spark 3.1 with HDI 4.0 and 5.0 versions which maps to same versions Sspark 3.1 (HDI 5.0)
48
+
> * Spark 3.1 (HDI 5.0) cluster comes with HWC 2.0 which works well together with Interactive Query (HDI 5.0) cluster.
51
49
52
50
## Interactive Query
53
51
54
52
:::image type="content" source="./media/hdinsight-release-notes/interactive-query-3-1-for-hdi-5-0.png" alt-text="Screenshot of interactive query 3.1 for HDI 5.0":::
55
53
56
54
> [!NOTE]
57
55
> * If you are creating an Interactive Query Cluster, you will see from the dropdown list an other version as Interactive Query 3.1 (HDI 5.0).
58
-
> * If you are going to use Spark 3.1 version along with Hive which require ACID support, you need to select this version Interactive Query 3.1 (HDI 5.0).
56
+
> * If you are going to use Spark 3.1 version along with Hive which require ACID support via Hive Warehouse Connector (HWC).
57
+
you need to select this version Interactive Query 3.1 (HDI 5.0).
59
58
60
59
## Kafka
61
60
@@ -65,6 +64,12 @@ This table lists certain HDInsight 4.0 cluster types that have retired or will b
65
64
66
65
We are working on this issue, and a fix will be rolled out shortly.
67
66
67
+
### Upcoming version upgrades.
68
+
HDInsight team is working on upgrading other open-source components.
0 commit comments