Skip to content

Commit 4f685a0

Browse files
committed
648870
1 parent 3a1c3ac commit 4f685a0

File tree

1 file changed

+8
-5
lines changed

1 file changed

+8
-5
lines changed

articles/hdinsight/spark/apache-spark-troubleshoot-sparkexception-kryo-serialization-failed.md

Lines changed: 8 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,12 @@
11
---
22
title: Issues with JDBC/ODBC & Apache Thrift framework - Azure HDInsight
33
description: Unable to download large data sets using JDBC/ODBC and Apache Thrift software framework in Azure HDInsight
4-
ms.service: hdinsight
5-
ms.topic: troubleshooting
64
author: hrasheed-msft
75
ms.author: hrasheed
86
ms.reviewer: jasonh
9-
ms.date: 07/29/2019
7+
ms.service: hdinsight
8+
ms.topic: troubleshooting
9+
ms.date: 05/14/2020
1010
---
1111

1212
# Unable to download large data sets using JDBC/ODBC and Apache Thrift software framework in HDInsight
@@ -28,7 +28,10 @@ This exception is caused by the serialization process trying to use more buffer
2828

2929
## Resolution
3030

31-
Increase the `Kryoserializer` buffer value. Add a key named `spark.kryoserializer.buffer.max` and set it to `2048` in spark2 config under `Custom spark2-thrift-sparkconf`.
31+
Increase the `Kryoserializer` buffer value. Add a key named `spark.kryoserializer.buffer.max` and set it to `2047` in spark2 config under `Custom spark2-thrift-sparkconf`. Restart all affected components.
32+
33+
> [!IMPORTANT]
34+
> The value for `spark.kryoserializer.buffer.max` must be less than 2048. Fractional values are not supported.
3235
3336
## Next steps
3437

@@ -38,4 +41,4 @@ If you didn't see your problem or are unable to solve your issue, visit one of t
3841

3942
* Connect with [@AzureSupport](https://twitter.com/azuresupport) - the official Microsoft Azure account for improving customer experience by connecting the Azure community to the right resources: answers, support, and experts.
4043

41-
* If you need more help, you can submit a support request from the [Azure portal](https://portal.azure.com/?#blade/Microsoft_Azure_Support/HelpAndSupportBlade/). Select **Support** from the menu bar or open the **Help + support** hub. For more detailed information, please review [How to create an Azure support request](https://docs.microsoft.com/azure/azure-portal/supportability/how-to-create-azure-support-request). Access to Subscription Management and billing support is included with your Microsoft Azure subscription, and Technical Support is provided through one of the [Azure Support Plans](https://azure.microsoft.com/support/plans/).
44+
* If you need more help, you can submit a support request from the [Azure portal](https://portal.azure.com/?#blade/Microsoft_Azure_Support/HelpAndSupportBlade/). Select **Support** from the menu bar or open the **Help + support** hub. For more detailed information, review [How to create an Azure support request](https://docs.microsoft.com/azure/azure-portal/supportability/how-to-create-azure-support-request). Access to Subscription Management and billing support is included with your Microsoft Azure subscription, and Technical Support is provided through one of the [Azure Support Plans](https://azure.microsoft.com/support/plans/).

0 commit comments

Comments
 (0)