Skip to content

Commit ee1ddc2

Browse files
committed
Learn Editor: Update apache-spark-version-support.md
1 parent b747dbb commit ee1ddc2

File tree

1 file changed

+25
-0
lines changed

1 file changed

+25
-0
lines changed

articles/synapse-analytics/spark/apache-spark-version-support.md

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -100,6 +100,31 @@ This guide provides a structured approach for users looking to upgrade their Azu
100100
1. Recreate Spark Pool 3.3 from the ground up.
101101
1. Downgrade the current Spark Pool 3.3 to 3.1, remove any packages attached, and then upgrade again to 3.3.
102102

103+
**Question:** Why can't I upgrade to 3.4 without recreating a new Spark pool?
104+
105+
**Answer:** This is not allowed from UX, customer can use Azure PowerShell to update Spark version. Please use "ForceApplySetting", so that any existing clusters (with old version) are decommissioned.
106+
107+
**Sample query:**
108+
109+
```azurepowershell
110+
$_target_work_space = @("workspace1", "workspace2")
111+
112+
Get-AzSynapseWorkspace |
113+
ForEach-Object {
114+
if ($_target_work_space -contains $_.Name) {
115+
$_workspace_name = $_.Name
116+
Write-Host "Updating workspace: $($_workspace_name)"
117+
Get-AzSynapseSparkPool -WorkspaceName $_workspace_name |
118+
ForEach-Object {
119+
Write-Host "Updating Spark pool: $($_.Name)"
120+
Write-Host "Current Spark version: $($_.SparkVersion)"
121+
122+
Update-AzSynapseSparkPool -WorkspaceName $_workspace_name -Name $_.Name -SparkVersion 3.4 -ForceApplySetting
123+
}
124+
}
125+
}
126+
```
127+
103128
## Related content
104129

105130
- [Manage libraries for Apache Spark in Azure Synapse Analytics](apache-spark-azure-portal-add-libraries.md)

0 commit comments

Comments
 (0)