Skip to content

Commit 59e43a0

Browse files
authored
Corrected the Spark version.
Corrected the Spark version.
1 parent 4a8a312 commit 59e43a0

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

articles/hdinsight/hdinsight-release-notes.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -34,7 +34,7 @@ For workload specific versions, see [here.](/azure/hdinsight/hdinsight-40-compon
3434

3535
* **Log Analytics** - Customers can enable classic monitoring to get the latest OMS version 14.19. To remove old versions, disable and enable classic monitoring.
3636
* **Ambari** user auto UI logout due to inactivity. For more information, see [here](/azure/hdinsight/ambari-web-ui-auto-logout)
37-
* **Spark** - A new and optimized version of Spark 3.1 is included in this release, which is twice as fast as before. We compared Apache Spark 2.4, Apache Spark 3.1.2(previous image) and Apache Spark 3.1.2 (current version) using the TPC-DS benchmark. The test is carried out using e8 V3  SKUs to decide the optimal cluster configurations for Apache Spark on 1-TB workload. Apache Spark 3.1 Optimized outperformed Apache Spark 3.1.2 (previous image) by over 40% in total query runtime for TPC-DS queries using the same hardware specs. For more information, see [Speed up your data workloads with performance updates to Apache Spark 3.1.2 in Azure Synapse](https://techcommunity.microsoft.com/t5/azure-synapse-analytics-blog/speed-up-your-data-workloads-with-performance-updates-to-apache/ba-p/2769467)
37+
* **Spark** - A new and optimized version of Spark 3.1.3 is included in this releaseWe tested Apache Spark 3.1.2(previous version) and Apache Spark 3.1.3(current version) using the TPC-DS benchmark. The test was carried out using E8 V3  SKU, for Apache Spark on 1-TB workload. Apache Spark 3.1.3 (current version) outperformed Apache Spark 3.1.2 (previous version) by over 40% in total query runtime for TPC-DS queries using the same hardware specs. The Microsoft Spark team added optimizations available in Azure Synapse with Azure HDInsight. For more information, please refer to [ Speed up your data workloads with performance updates to Apache Spark 3.1.2 in Azure Synapse](https://techcommunity.microsoft.com/t5/azure-synapse-analytics-blog/speed-up-your-data-workloads-with-performance-updates-to-apache/ba-p/2769467)
3838

3939
![Icon showing new regions added with text.](media/hdinsight-release-notes/new-icon-for-new-regions-added.png)
4040

0 commit comments

Comments
 (0)