ViperEkura/DataPipeline
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
116 Commits 1 Branch 0 Tags
d67f686f10ebdf9f8245bce303beea2ac274d6b4
Commit Graph
2 Commits
Author SHA1 Message Date
ViperEkura e999629098 移除缓存脚本中的 data_files 和 max_chunks 限制参数 2026-07-26 10:57:30 +08:00
ViperEkura fec37545e2 Add max_chunks=18 to dolma-30b export, remove max_chunks=5 from english-wiki, rename project to datapipline 2026-07-06 08:53:18 +08:00