Describe the bug
The job params page is broken due to an unhandled validator for modality in job parameter names.
There was a breaking change in aind-data-schema-models which renamed slap to slap2: AllenNeuralDynamics/aind-data-schema-models#260. Because of this, the existing /aind/dev/airflow/variables/job_types/v2/default/tasks/modality_transformation_settings/slap parameter is failing validation.
To Reproduce
Steps to reproduce the behavior:
- Go to http://aind-data-transfer-service-dev/job_params
- Observe that the page cannot load.
- Go to the data transfer grafana dashboard (dev): https://grafana-sipe.corp.alleninstitute.org/d/d8816444-071e-4caf-bb68-76e7ca34f19e/aind-data-transfer-service-logs?orgId=1&from=now-5m&to=now&timezone=browser&var-environment=aind-dev
- See error:
Value error, Invalid modality: modality must be one of ['BARseq', 'behavior', 'behavior-videos', 'brightfield', 'confocal', 'EMG', 'EM', 'ecephys', 'fib', 'fMOST', 'icephys', 'ISI', 'MRI', 'MAPseq', 'merfish', 'pophys', 'slap2', 'SPIM', 'STPT', 'scRNAseq'] [type=value_error, input_value='slap', input_type=str]
Expected behavior
The job params page should not crash due to invalid modalities. Instead, either remove the validator when reading existing parameters, or log a warning and continue.
Describe the bug
The job params page is broken due to an unhandled validator for modality in job parameter names.
There was a breaking change in aind-data-schema-models which renamed
slaptoslap2: AllenNeuralDynamics/aind-data-schema-models#260. Because of this, the existing/aind/dev/airflow/variables/job_types/v2/default/tasks/modality_transformation_settings/slapparameter is failing validation.To Reproduce
Steps to reproduce the behavior:
Value error, Invalid modality: modality must be one of ['BARseq', 'behavior', 'behavior-videos', 'brightfield', 'confocal', 'EMG', 'EM', 'ecephys', 'fib', 'fMOST', 'icephys', 'ISI', 'MRI', 'MAPseq', 'merfish', 'pophys', 'slap2', 'SPIM', 'STPT', 'scRNAseq'] [type=value_error, input_value='slap', input_type=str]Expected behavior
The job params page should not crash due to invalid modalities. Instead, either remove the validator when reading existing parameters, or log a warning and continue.