Skip to content

Commit c622a25

Browse files
Merge pull request #251762 from v-akarnase/patch-15
Update apache-spark-troubleshoot-illegalargumentexception.md
2 parents 5cb7a52 + 53aeb35 commit c622a25

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

articles/hdinsight/spark/apache-spark-troubleshoot-illegalargumentexception.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@ title: IllegalArgumentException error for Apache Spark - Azure HDInsight
33
description: IllegalArgumentException for Apache Spark activity in Azure HDInsight for Azure Data Factory
44
ms.service: hdinsight
55
ms.topic: troubleshooting
6-
ms.date: 06/29/2022
6+
ms.date: 09/19/2023
77
---
88

99
# Scenario: IllegalArgumentException for Apache Spark activity in Azure HDInsight
@@ -21,15 +21,15 @@ Wrong FS: wasbs://[email protected]/spark-examples_2.11-2.1.0
2121

2222
## Cause
2323

24-
A Spark job will fail if the application jar file is not located in the Spark cluster’s default/primary storage.
24+
A Spark job fails if the application jar file is not located in the Spark cluster’s default/primary storage.
2525

2626
This is a known issue with the Spark open-source framework tracked in this bug: [Spark job fails if fs.defaultFS and application jar are different url](https://issues.apache.org/jira/browse/SPARK-22587).
2727

2828
This issue has been resolved in Spark 2.3.0.
2929

3030
## Resolution
3131

32-
Make sure the application jar is stored on the default/primary storage for the HDInsight cluster. In case of Azure Data Factory, make sure the ADF linked service is pointed to the HDInsight default container rather than a secondary container.
32+
Make sure the application jar is stored on the default/primary storage for the HDInsight cluster. In Azure Data Factory, make sure the ADF linked service is pointed to the HDInsight default container rather than a secondary container.
3333

3434
## Next steps
3535

0 commit comments

Comments
 (0)