ViperEkura/DataPipeline
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
117 Commits 1 Branch 0 Tags
995a015c234a78eec30cb2cb57716d46ec9d1d23
Commit Graph
2 Commits
Author SHA1 Message Date
ViperEkura e999629098 移除缓存脚本中的 data_files 和 max_chunks 限制参数 2026-07-26 10:57:30 +08:00
ViperEkura fec37545e2 Add max_chunks=18 to dolma-30b export, remove max_chunks=5 from english-wiki, rename project to datapipline 2026-07-06 08:53:18 +08:00