In addition to custom images and app volumes, users should be able to easily deploy applications from remote Git repositories similarly to the Airflow operator. For Spark, no Git syncing is necessary.
Things to consider:
- Authentication
- Dependency handling
- Integration with Spark Connect