ViperEkura fec37545e2 Add max_chunks=18 to dolma-30b export, remove max_chunks=5 from english-wiki, rename project to datapipline

2026-07-06 08:53:18 +08:00

..

chinese-cosmopedia.py

fix: 修复特殊token 问题

2026-04-02 16:16:02 +08:00

english-dolma.py

Add max_chunks=18 to dolma-30b export, remove max_chunks=5 from english-wiki, rename project to datapipline

2026-07-06 08:53:18 +08:00

english-wiki.py

Add max_chunks=18 to dolma-30b export, remove max_chunks=5 from english-wiki, rename project to datapipline

2026-07-06 08:53:18 +08:00