Logo
Explore Help
Register Sign In
ViperEkura/DataPipeline
Watch 1
Star 0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
Files
e9996290989ae6f4a3453323ea691ad7cc69e34a
DataPipeline/scripts/pre_train
T
History
ViperEkura e999629098 移除缓存脚本中的 data_files 和 max_chunks 限制参数
2026-07-26 10:57:30 +08:00
..
chinese-cosmopedia.py
移除缓存脚本中的 data_files 和 max_chunks 限制参数
2026-07-26 10:57:30 +08:00
english-dolma.py
移除缓存脚本中的 data_files 和 max_chunks 限制参数
2026-07-26 10:57:30 +08:00
english-wiki.py
Add max_chunks=18 to dolma-30b export, remove max_chunks=5 from english-wiki, rename project to datapipline
2026-07-06 08:53:18 +08:00
Powered by Gitea Version: 1.27.2 Page: 16ms Template: 2ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API