Commit 1f6bd7a
authored
[LIVY-863] Missing JVM class imports for Spark3
## What changes were proposed in this pull request?
Description of the problem: https://issues.apache.org/jira/browse/LIVY-863
The proposed fix consists of adding the missing imports that upstream Spark has when it's initiating the Java Gateway.
See the imports of Spark here: https://github.com/apache/spark/blob/87bf6b0ea4ca0618c8604895d05037edce8b7cb0/python/pyspark/java_gateway.py#L153
As far as I am aware, the java_import() does not fail or fails silently if the imported class does not exist.
But I might need to add some code to account for different Spark versions, looking for some guidance on this.
## How was this patch tested?
Tested with both valid and "bogus" imports by reviewers.1 parent 6097af1 commit 1f6bd7a
1 file changed
+3
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
589 | 589 | | |
590 | 590 | | |
591 | 591 | | |
| 592 | + | |
592 | 593 | | |
| 594 | + | |
593 | 595 | | |
| 596 | + | |
594 | 597 | | |
595 | 598 | | |
596 | 599 | | |
| |||
0 commit comments