PySpark Package Management

[javierherrer]

Hello,

I want to use Hatch for building my PySpark project and passing the environment file when triggering a job.

ref: https://spark.apache.org/docs/latest/api/python/tutorial/python_packaging.html