Skip to content

Airflow warning runtime-variable values in Dag construction for Airflow dags #232

Description

@joshgamache

Description of the Tech Debt

Airflow's latest update to v3.2.2 is surfacing the following warning on the most of our dags:

This Dag uses runtime-variable values in Dag construction.
It causes the Dag version to increase as values change on every Dag parse.

Line 47, Col 1
Code: dag(dag_id=TEST_MIGRATIONS_DAG_NAME, default_args=default_args, schedule=None, catchup=False, is_paused_upon_creation=False, doc_md=DAG_DOC, tags=['bciers'])
Issue: Don't use runtime-varying value as argument in Dag constructor

️Don't use the variables as arguments in Dag/Task constructors:
  Line 11: 'TWO_DAYS_AGO' related 'datetime.now()'
  Line 31: 'default_args' related 'datetime.now()'

We should update the Dag configuration in order to resolve the warning. See bcgov/cas-registration#5004 for the fix for cas-registration

Development Checklist:

Repos with Dags to fix:

Cleanup of existing Dags

There might be a way to "roll back" versions to clean up the Dag metadata to clean up the system. Look into things like using the Airflow CLI with airflow db clean --clean-before-timestamp --tables dag_version.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions