I had some ephys upload jobs fail recently due to missing metadata files, after they'd spent over an hour in the compress_data step (~1 TB raw data).
Could we have that check before launching into heavy processing jobs, in order for users to get quicker feedback on issues they can resolve? It would also avoid unnecessary processing on the HPC..
I had some ephys upload jobs fail recently due to missing metadata files, after they'd spent over an hour in the
compress_datastep (~1 TB raw data).Could we have that check before launching into heavy processing jobs, in order for users to get quicker feedback on issues they can resolve? It would also avoid unnecessary processing on the HPC..