This website requires JavaScript.
Explore
Help
Register
Sign In
ViperEkura
/
DataPipeline
Watch
1
Star
0
Fork
0
Code
Issues
Pull Requests
Packages
Projects
Releases
Wiki
Activity
Files
900cd91798e1898360209943dba691722c178ade
DataPipeline
/
scripts
T
History
ViperEkura
900cd91798
feat: MinHash+LSH 去重 + Strategy/Factory 存储后端
2026-07-04 14:47:38 +08:00
..
pre_train
feat: add sft scripts for Magicoder-Evol-Instruct-110K and alpaca-gpt4-data
2026-06-01 15:50:13 +08:00
reforce_learning
reafactor: 重构项目
2026-03-30 20:58:51 +08:00
supervised_finetuning
refactor: SFT 统一 messages 格式 + ChatML 纯 jinja 渲染
2026-07-04 14:32:35 +08:00
cache_h5.py
feat: MinHash+LSH 去重 + Strategy/Factory 存储后端
2026-07-04 14:47:38 +08:00
dedup_pretrain.py
feat: MinHash+LSH 去重 + Strategy/Factory 存储后端
2026-07-04 14:47:38 +08:00