ViperEkura 2c7a71a9c0 refactor: separate old policy and ref model in GRPO strategy ... - Split single ref_model into old_model (importance sampling ratio) and ref_model (frozen KL regularizer) - Move ref_model/old_model creation from strategy __init__ to TrainContextBuilder, pass as explicit parameters - Remove periodic sync_ref_model + sync_interval; add sync_old_model for external rollout loop to call - DPOStrategy also receives ref_model from builder - Fix std to use unbiased=False (population std per GRPO paper) - Remove redundant tests (test_grpo_kl_zero_at_init, test_grpo_no_sync_interval_param) - Remove --grpo_sync_interval CLI arg		2026-07-14 20:03:45 +08:00
..
data	refactor: split mask builder by single/multi output	2026-07-08 21:18:34 +08:00
inference	perf: replace paged KV cache with contiguous ContiguousCache, decode all groups	2026-07-05 11:34:36 +08:00
module	refactor : 压缩测试代码，消除重复	2026-06-19 14:54:39 +08:00
parallel	feat: 增加server, 并且修改测试单元	2026-04-02 15:05:07 +08:00
trainer	refactor: separate old policy and ref model in GRPO strategy	2026-07-14 20:03:45 +08:00
conftest.py	refactor : replace iteration with consumed_samples	2026-06-30 18:42:42 +08:00