hailctl emr: AWS EMR support (CHANGELOG) - #15612

Draft

hmkim wants to merge 18 commits into

hail-is:mainfrom

hmkim:hailctl-emr-pr

Commits on Jul 30, 2026

[fs] route HAIL_CLOUD=aws to HadoopFS-only RouterFS for EMR
Hyunmin Kim
committed
[config] add emr/region and emr/remote_tmpdir config variables
Hyunmin Kim
committed
[emr] add boto3 client factory and region resolution
Hyunmin Kim
committed
[emr] add EMR bootstrap script and package it in the wheel
Hyunmin Kim
committed
[emr] add run_job_flow request builder and Spark compatibility table
Hyunmin Kim
committed
[emr] add submit: upload script to S3, add step, wait for completion
Hyunmin Kim
committed
[emr] add emr Typer app with start/stop/list/submit
Hyunmin Kim
committed
[emr] register emr command group in hailctl
Hyunmin Kim
committed
[docs] document hailctl emr for AWS EMR
Hyunmin Kim
committed
[emr] add manual EMR integration smoke test script
Hyunmin Kim
committed
[emr] keep hailctl lazy-import convention; lint with pinned ruff
Hyunmin Kim
committed
[emr] fix driver HAIL_CLOUD env, guard step-failure reporting, validate JSON overlay
Hyunmin Kim
committed
[emr] deliver HAIL_CLOUD to client-mode drivers via spark-env classification
Hyunmin Kim
committed
[emr] install Hail into Python 3.11 and point PySpark at it (EMR system python3 is 3.9)
Hyunmin Kim
committed
[emr] preflight-check default IAM roles with a clear message
Hyunmin Kim
committed
[docs] CHANGELOG: add hailctl emr (AWS EMR support)
Hyunmin Kim
committed
[emr] document why the bootstrap targets Python 3.11
Hyunmin Kim
committed

Commits on Aug 2, 2026

[emr] target Python 3.12 for the EMR bootstrap
Brandon
committed