I am guessing that there is a hardcoded Maxpoint-ism in this code base with respect to the run_pyspark_yarn_cluster function. The env_dir parameter is unused in that function and there seems to be a hardcoded CONDA variable in there. I'm guessing this is unpacked by one of our internal tools.