5 Commits

Include renames

Author	SHA1	Message	Date
ViperEkura	faf9f81e7c	refactor(utils): 将 pre_tarin_process 和 sft_process 函数合并为 process_dataset	2025-07-16 12:17:58 +08:00
ViperEkura	b69ba2c5ff	refactor(dataset): 重构数据集处理流程并添加新功能	2025-07-16 09:56:31 +08:00
ViperEkura	e77fb56c45	refactor(utils): 重构数据处理脚本	2025-07-15 13:10:38 +08:00
ViperEkura	1c132826c0	feat(chinese-wiki., english-wiki.): 添加 max_chunk_size 参数	2025-07-14 13:35:06 +08:00
ViperEkura	d8643d11dd	refactor(dataset processing): 重构数据集处理流程并添加新功能	2025-07-14 10:57:23 +08:00