Skip to content

Commit 1973aa7

Browse files
jingyushenPanAndy
authored andcommitted
(docs): Update README.md and fix typo in GRPO
1 parent 09555e9 commit 1973aa7

3 files changed

Lines changed: 5 additions & 6 deletions

File tree

README.md

Lines changed: 3 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -84,10 +84,9 @@ Leveraging a multi-role distributed architecture with Ray for flexible resource
8484
[RAFT++](https://alibaba.github.io/ROLL/docs/English/UserGuide/algorithms/RAFT_Plus_Plus)
8585
[StarPO](https://alibaba.github.io/ROLL/docs/English/UserGuide/algorithms/agentic_StarPO)
8686

87-
#### Beckend
87+
#### Backend
8888
[DeepSeed](https://alibaba.github.io/ROLL/docs/English/UserGuide/backend/deepspeed)
89-
[Megatron](https://alibaba.github.io/ROLL/docs/English/UserGuide/backend/megatron)
90-
[LoRA](https://alibaba.github.io/ROLL/docs/English/UserGuide/backend/lora)
89+
[Megatron](https://alibaba.github.io/ROLL/docs/English/UserGuide/backend/megatron)
9190
[vLLM](https://alibaba.github.io/ROLL/docs/English/UserGuide/backend/vllm)
9291
[SGLang](https://alibaba.github.io/ROLL/docs/English/UserGuide/backend/sglang)
9392

@@ -119,7 +118,7 @@ Leveraging a multi-role distributed architecture with Ray for flexible resource
119118
* Inference/Generation supports vLLM, SGLang.
120119
* Training supports DeepSpeed (ZeRO), Megatron-LM 5D parallelism (mcore-adapter, dp/tp/pp/cp/ep), FSDP under implementation.
121120
* Extreme offload/reload capabilities.
122-
* Supports LoRA training.
121+
* Supports [LoRA](https://alibaba.github.io/ROLL/docs/English/UserGuide/backend/lora) training.
123122
* Supports FP8 rollout (FP8 inference for LLM as judge, FP8 rollout with BF16 training under development).
124123
* **AutoDeviceMapping:** Supports custom device mapping for different roles, flexibly managing colocated and disaggregated deployments.
125124
* **Observability:** Integrated with SwanLab / WandB / TensorBoard, tracking of performance for each domain and reward type.

docs_roll/docs/English/UserGuide/algorithms/GRPO.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ adv_estimator: "grpo"
2626
ppo_epochs: 1
2727
use_kl_loss: true
2828
kl_loss_coef: 0.001
29-
loss_agg_mode: "seq-mean-token-sum"
29+
loss_agg_mode: "seq-mean-token-mean"
3030

3131
# ppo related
3232
# advantage

docs_roll/docs/简体中文/使用指南/algorithms/GRPO.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ adv_estimator: "grpo"
2626
ppo_epochs: 1
2727
use_kl_loss: true
2828
kl_loss_coef: 0.001
29-
loss_agg_mode: "seq-mean-token-sum"
29+
loss_agg_mode: "seq-mean-token-mean"
3030

3131
# ppo related
3232
# advantage

0 commit comments

Comments
 (0)