ViperEkura 754624acf0 feat: add online rollout framework for RL strategies ...

- RolloutRunner: generate + score responses with cached re-rollout trigger
- BaseStrategy.__call__ switches online/offline via runner injection
- GRPO/DPO implement prepare_from_rollout; aliases online_grpo/online_dpo
- TrainConfig + train.py add rollout params and CLI flags
- Tests cover generate_responses, RolloutRunner cache, shared __call__

2026-07-20 03:49:56 +08:00

..

__init__.py

chore : 升级 torch 2.11.0+cu128，移除自定义 Muon，修复 gloo device_id

2026-06-27 16:10:37 +08:00

metric_util.py

refactor : grad_norm 指标简化，clip_grad_norm 移至 executor

2026-06-30 14:59:43 +08:00

rollout.py

feat: add online rollout framework for RL strategies

2026-07-20 03:49:56 +08:00

schedule.py

fix: scheduler division-by-zero, loss_mask bool

2026-07-03 22:04:55 +08:00

strategy.py

feat: add online rollout framework for RL strategies

2026-07-20 03:49:56 +08:00

train_callback.py

fix: init last_ckpt_step and last_log_flush_step from context.optimizer_step

2026-07-15 22:15:55 +08:00

train_context.py

feat: add online rollout framework for RL strategies

2026-07-20 03:49:56 +08:00

trainer.py

feat: add --resume flag to decouple weight loading from training resumption

2026-07-16 14:23:23 +08:00