ViperEkura 2b3bf442e9 feat: add SFT process_batch for parallel tokenization + short QA filter script

2026-07-29 22:01:09 +08:00

..

__init__.py

refactor: 重构流水线架构，添加Pipeline抽象并拆分IOHandler

2026-04-23 19:45:57 +08:00

base.py

feat: 并行 batch tokenization + cache_jsonl 批处理支持

2026-07-25 12:19:45 +08:00

dpo.py

refactor: 重构流水线架构，添加Pipeline抽象并拆分IOHandler

2026-04-23 19:45:57 +08:00

factory.py

refactor: 重构流水线架构，添加Pipeline抽象并拆分IOHandler

2026-04-23 19:45:57 +08:00

pretrain.py

feat: 并行 batch tokenization + cache_jsonl 批处理支持

2026-07-25 12:19:45 +08:00

sft.py

feat: add SFT process_batch for parallel tokenization + short QA filter script

2026-07-29 22:01:09 +08:00