Skip to content

Commit 78eeb7d

Browse files
authored
Lower pyspark version requirement to 3.5.0 (datacontract#1013)
to be able to use datacontract-cli within Databricks runtime 15.4 , the min pyspark version should match. Since Databricks runtime ships with pyspark 3.5.0, it would be great if datacontract-cli also supports this as lowest number.....if it doesn't break stuff elsewhere 🤞
1 parent e1dff41 commit 78eeb7d

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

pyproject.toml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -61,7 +61,7 @@ databricks = [
6161
"soda-core-spark[databricks]>=3.3.20,<3.6.0",
6262
"databricks-sql-connector>=3.7.0,<4.3.0",
6363
"databricks-sdk<0.74.0",
64-
"pyspark>=3.5.5,<5.0.0",
64+
"pyspark>=3.5.0,<5.0.0",
6565
]
6666

6767
iceberg = [
@@ -71,7 +71,7 @@ iceberg = [
7171
kafka = [
7272
"datacontract-cli[avro]",
7373
"soda-core-spark-df>=3.3.20,<3.6.0",
74-
"pyspark>=3.5.5,<5.0.0",
74+
"pyspark>=3.5.0,<5.0.0",
7575
]
7676

7777
postgres = [

0 commit comments

Comments
 (0)