Skip to content

Commit 53f7449

Browse files
committed
chore: rebase off of main + resolve conflicts + regenrate
Signed-off-by: anubhutiv <anubhutiv@nvidia.com>
1 parent 3cc279e commit 53f7449

4 files changed

Lines changed: 5136 additions & 1769 deletions

File tree

docker/rl/Dockerfile.nmp-rl-base

Lines changed: 0 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -243,13 +243,6 @@ RUN uv pip install --python /opt/nemo_rl_venv/bin/python --no-deps -e /opt/nemo-
243243
#
244244
# NOT prefetched: automodel, mcore, sglang, trtllm, modelopt-quant
245245
# and the async-GRPO bookkeeping actors; those build on the node if a config selects them.
246-
#
247-
# automodel is on the GRPO + LoRA path: LoRA is implemented only in DTensorPolicyWorkerV2, the
248-
# compiler selects it via policy.dtensor_cfg._v2, and the registry maps that actor to
249-
# PY_EXECUTABLES.AUTOMODEL. Because it is not prefetched, a LoRA run builds that venv on the node
250-
# at job start - slow at best, and a hard failure on a deny-egress cluster. Add
251-
# dtensor_policy_worker_v2.DTensorPolicyWorkerV2 to the filters and the verification loop below to
252-
# fix that. Full-weight GRPO stays on V1 -> fsdp, which is prefetched.
253246
RUN <<"EOF" bash -exu
254247
export UV_LINK_MODE=symlink
255248
uv run nemo_rl/utils/prefetch_venvs.py \

0 commit comments

Comments
 (0)