I had some ephys upload jobs fail recently due to missing metadata files, after they'd spent over an hour in the compress_data step (~1 TB raw data).
Could we have that check before launching into heavy processing jobs, in order for users to get quicker feedback on issues they can resolve? It would also avoid unnecessary processing on the HPC..