This website requires JavaScript.
Explore
Help
Register
Sign In
ViperEkura
/
DataPipeline
Watch
1
Star
0
Fork
0
Code
Issues
Pull Requests
Packages
Projects
Releases
Wiki
Activity
Files
2b3bf442e907b88d630db4694c50d0f462ff2ae7
DataPipeline
/
scripts
/
pre_train
T
History
ViperEkura
e999629098
移除缓存脚本中的 data_files 和 max_chunks 限制参数
2026-07-26 10:57:30 +08:00
..
chinese-cosmopedia.py
移除缓存脚本中的 data_files 和 max_chunks 限制参数
2026-07-26 10:57:30 +08:00
english-dolma.py
移除缓存脚本中的 data_files 和 max_chunks 限制参数
2026-07-26 10:57:30 +08:00
english-wiki.py
Add max_chunks=18 to dolma-30b export, remove max_chunks=5 from english-wiki, rename project to datapipline
2026-07-06 08:53:18 +08:00