Logo
Explore Help
Register Sign In
ViperEkura/DataPipeline
Watch 1
Star 0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
50 Commits 1 Branch 0 Tags
092921f4015753eb621c5425d8f99d285929f057
Commit Graph
6 Commits
Author SHA1 Message Date
ViperEkura 092921f401 refactor(project): 将 utils 和 tokenizer 模块移至 modules 目录 2025-08-01 20:59:17 +08:00
ViperEkura 8725a9ebd1 feat(dump_sft_file): 更新数据集处理逻辑 2025-08-01 16:59:47 +08:00
ViperEkura 64222aeab1 refactor(dump_sft_file.py, utils.py): 优化内存占用 2025-07-22 13:30:53 +08:00
ViperEkura 5ea1c6355d refactor(data): 重构数据处理流程以适应新需求 2025-07-22 10:03:06 +08:00
ViperEkura 9bdbfd0889 feat(chinese-instruct): 重新处理数据集并生成 SFT 训练文件 2025-07-21 21:09:27 +08:00
ViperEkura f9ce67e03c refactor: 重命名pretrain 和 sft 脚本 2025-07-21 19:58:15 +08:00
Powered by Gitea Version: 1.27.2 Page: 143ms Template: 9ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API