7 Commits

Include renames

Author	SHA1	Message	Date
ViperEkura	0b0693a0a2	fix: make ChatTemplate picklable for spawn multiprocessing ... - Add __getstate__/__setstate__ to drop cached _compiled Jinja2 template - Jinja2 Template.root_render_func is a dynamic closure unpicklable by reference - cached_property rebuilds the template lazily on first render after unpickle	2026-07-29 13:24:13 +08:00
ViperEkura	17127f8b3c	fix: make tokenizer picklable for spawn multiprocessing ... - ChatTemplate: defer Jinja2 compilation to cached_property, exclude compiled template from __getstate__ (its dynamic root function has __module__=None and falls back to __main__, breaking pickle) - AutoTokenizer: bypass __getattr__ for underscore-prefixed attrs to prevent infinite recursion during unpickle when __dict__ is empty	2026-07-19 11:59:55 +08:00
ViperEkura	01ce1fb9e3	refactor : Pipeline 去除去重，ids 重命名为 sequence，泛型透传 ... - 移除 Pipeline 内置去重逻辑及 dedup_signature 工具函数 - 删除 ProcessingConfig.deduplicate 字段 - builder 返回 'sequence' 替代 'ids'，与 dataset 层统一 - pipeline 纯透传，泛型处理任意 key 补齐默认值	2026-05-31 15:14:27 +08:00
ViperEkura	14f83cbdac	perf : 预编译 Jinja2 Template，避免每次 render 重新构建	2026-05-31 14:50:16 +08:00
ViperEkura	39766aa1dc	chore: 修改类名，优化导入顺序	2026-04-05 22:27:57 +08:00
ViperEkura	fc278d17ab	feat: 实现模型动态注册机制	2026-04-05 19:38:12 +08:00
ViperEkura	c94a246c71	chore: 重命名目录	2026-04-04 17:03:22 +08:00