Commit 5816eb7
committed
chore: update NeMo submodule to TianyeGGBond/RL:nemo (0775e9cc)
- URL: zhenyulincs/RL.git -> TianyeGGBond/RL.git, branch: nemo
- Was missing F2/F3: sleep_partial, wake_up_partial, mark_dp_ranks_inactive,
activate_dp_ranks (partial overlap dataplane primitives)
- Now includes F2/F3/F4/F5/F6 + all fixes merged into nemo branch1 parent 51285c3 commit 5816eb7
2 files changed
Lines changed: 3 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
7 | | - | |
| 7 | + | |
| 8 | + | |
- .github/workflows/claude-code-review.yml+44
- .github/workflows/claude.yml+50
- docs/vastai-setup.md+201
- nemo_rl/algorithms/async_utils.py+43
- nemo_rl/algorithms/grpo.py+116-35
- nemo_rl/algorithms/rlix_hooks.py+114
- nemo_rl/models/generation/vllm/config.py+1
- nemo_rl/models/generation/vllm/vllm_backend.py+33-16
- nemo_rl/models/generation/vllm/vllm_generation.py+376-83
- nemo_rl/models/generation/vllm/vllm_worker.py+11-2
- nemo_rl/models/generation/vllm/vllm_worker_async.py+15-2
- nemo_rl/models/megatron/nccl_offload.py+528
- nemo_rl/models/policy/lm_policy.py+5-1
- nemo_rl/models/policy/utils.py+43-7
- nemo_rl/models/policy/workers/dtensor_policy_worker.py+2
- nemo_rl/models/policy/workers/dtensor_policy_worker_v2.py+2
- nemo_rl/models/policy/workers/megatron_policy_worker.py+5-1
- tests/unit/models/generation/test_vllm_generation.py+528-1
- tests/unit/models/megatron/_nccl_offload_gpu_worker.py+229
- tests/unit/models/megatron/test_nccl_offload.py+766
- tests/unit/models/megatron/test_nccl_offload_gpu.py+326
- tests/unit/models/policy/test_utils.py+65-10
0 commit comments