Skip to content

refactor: airflow context and utils#27

Merged
helen-m-lin merged 6 commits into
mainfrom
refactor-airflow-context-utils
Mar 27, 2026
Merged

refactor: airflow context and utils#27
helen-m-lin merged 6 commits into
mainfrom
refactor-airflow-context-utils

Conversation

@helen-m-lin

Copy link
Copy Markdown
Contributor

closes #21

This PR doesn't fully remove airflow dependencies yet - I have some WIP to refactor the slurm hook to use paramiko directly, but this can be added separately. The image does not install airflow, and the check_connections DAG should now be able to run using KubernetesPodOperators.

  • Adds a pydantic settings model to read Airflow context (from env vars)
  • Adds a base DagTasks class to remove duplicate code for CLI run_task behavior
  • Removes airflow email utils

@helen-m-lin helen-m-lin requested a review from jtyoung84 March 27, 2026 19:12
@helen-m-lin helen-m-lin merged commit 4a38292 into main Mar 27, 2026
3 checks passed
@helen-m-lin helen-m-lin deleted the refactor-airflow-context-utils branch March 27, 2026 20:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Remove airflow dependencies from handlers

2 participants