Pyspark support #1017
raghuvarranvh
started this conversation in
Development
Pyspark support
#1017
Replies: 1 comment
-
You can try to follow the general instruction with Py4J https://stackoverflow.com/questions/33544105/running-custom-java-class-in-pyspark. DJL itself is a Java package, it can work perfectly well with Spark Scala. If you plan to use DJL in PySpark, you could try to build a Scala SPARK UDF with DJL and then expose that in your PySpark application to call. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Does DJL support development in pyspark? Any tutorials for this?
Beta Was this translation helpful? Give feedback.
All reactions