ViperEkura 995a015c23 fix: cache_h5 移除重复 --batch-size 参数，默认输出格式改为 bin

2026-08-19 18:01:06 +08:00

..

pre_train

fix: cache_h5 移除重复 --batch-size 参数，默认输出格式改为 bin

2026-08-19 18:01:06 +08:00

reforce_learning

reafactor: 重构项目

2026-03-30 20:58:51 +08:00

supervised_finetuning

feat: add Alpaca-GPT4-ZH SFT export script

2026-07-29 21:23:20 +08:00

cache_h5.py

fix: cache_h5 移除重复 --batch-size 参数，默认输出格式改为 bin

2026-08-19 18:01:06 +08:00

dedup_pretrain.py

feat: MinHash+LSH 去重 + Strategy/Factory 存储后端

2026-07-04 14:47:38 +08:00

filter_short.py

feat: add SFT process_batch for parallel tokenization + short QA filter script

2026-07-29 22:01:09 +08:00