ViperEkura e0f102c4d9 feat: support SFT directly from JSONL without dataset_config.json ...

- JsonlStore falls back to built-in messages config when no config file found and tokenizer_path is provided
- DatasetFactory.load forwards tokenizer_path to store for SFT/SEQ+jsonl
- assistant turns train, other roles masked, position_ids doc_reset

2026-07-20 17:25:09 +08:00

..

conftest.py

refactor: split mask builder by single/multi output

2026-07-08 21:18:34 +08:00

test_checkpoint.py

refactor : replace iteration with consumed_samples

2026-06-30 18:42:42 +08:00

test_dataset.py

feat: support SFT directly from JSONL without dataset_config.json

2026-07-20 17:25:09 +08:00

test_preprocess_builder.py

fix: rewrite GRPO data pipeline for offline record-level access

2026-07-17 14:34:41 +08:00

test_preprocess_config.py

refactor : 清理工厂和配置系统中的死代码与冗余抽象

2026-06-07 11:39:50 +08:00

test_preprocess_pipeline.py

feat: implement bfd_split packing strategy

2026-07-17 12:38:56 +08:00

test_sampler.py

feat: add record-mode to Store for DPO/GRPO

2026-07-18 21:02:29 +08:00