Airflow's latest update to v3.2.2 is surfacing the following warning on the most of our dags:
This Dag uses runtime-variable values in Dag construction.
It causes the Dag version to increase as values change on every Dag parse.
Line 47, Col 1
Code: dag(dag_id=TEST_MIGRATIONS_DAG_NAME, default_args=default_args, schedule=None, catchup=False, is_paused_upon_creation=False, doc_md=DAG_DOC, tags=['bciers'])
Issue: Don't use runtime-varying value as argument in Dag constructor
️Don't use the variables as arguments in Dag/Task constructors:
Line 11: 'TWO_DAYS_AGO' related 'datetime.now()'
Line 31: 'default_args' related 'datetime.now()'
There might be a way to "roll back" versions to clean up the Dag metadata to clean up the system. Look into things like using the Airflow CLI with airflow db clean --clean-before-timestamp --tables dag_version.
Description of the Tech Debt
Airflow's latest update to v3.2.2 is surfacing the following warning on the most of our dags:
We should update the Dag configuration in order to resolve the warning. See bcgov/cas-registration#5004 for the fix for cas-registration
Development Checklist:
Repos with Dags to fix:
Cleanup of existing Dags
There might be a way to "roll back" versions to clean up the Dag metadata to clean up the system. Look into things like using the Airflow CLI with
airflow db clean --clean-before-timestamp --tables dag_version.