You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
* feat(app): add app-layer env framework (env.app) + vllm flashinfer gate
Configs gain an env.app.{app} dimension keyed by app name, so per-app
per-backend env vars (e.g. VLLM_USE_FLASHINFER_SAMPLER=0 for NVIDIA
vLLM 0.24.0) have a home and a delivery channel without leaking into
other app images.
- configs.yaml: env.app.vllm.VLLM_USE_FLASHINFER_SAMPLER=0 for
nvidia-cuda12.8/13.3 (vLLM 0.24.0 imports flashinfer unconditionally;
runtime doesn't ship it, so the sampler is gated off at the app layer)
- app/{vllm,megatron}/Containerfile: APP_ENV build arg baked into
/etc/profile.d/app_env.sh (same pattern as runtime_env; sourced via
BASH_ENV plumbing)
- scripts/generate_matrix.py: --app <name> mode = runtime matrix + app_env
serialized as KEY=value\n...; --runtime output unchanged (regression
byte-identical)
- app/vllm/Containerfile: default VLLM_VERSION 0.20.2 -> 0.24.0 and pin
vllm=={version}+flagos — a bare =={version} resolves the official wheel
on the fallback index and pulls a newer torch over the runtime's pinned
matrix (torch-pull trap, seen live on h20)
- megatron-app-image.yml: matrix via --app megatron, pass APP_ENV
- docs/gen_data.py: carry env.app into docs/data/images.yaml
Verified on node: vllm 0.24.0+flagos installs inert (torch stays
2.10.0+cu128), VLLM_USE_FLASHINFER_SAMPLER=0 reachable in container shell.
* docs(vllm): address PR #409 review comments
- configs.yaml: translate env.app.vllm comments to English
- generate_matrix.py: clarify "--app: all" docstring as "all backends"
- report-vllm-0.24.0.md: SDK -> MACA in TL;DR; drop the §6 container and
log-file detail; delete the metax monkey-patch comparison (irrelevant
to NVIDIA); document the long-term plugin-wheel resolution for the
§6.1(2) toolchain gap and the appendix install block
- vllm-verification-matrix.md: reword "均 Qwen3-4B E2E" to natural Chinese
0 commit comments