ViperEkura 17127f8b3c fix: make tokenizer picklable for spawn multiprocessing ...

- ChatTemplate: defer Jinja2 compilation to cached_property, exclude compiled template from __getstate__ (its dynamic root function has __module__=None and falls back to __main__, breaking pickle)
- AutoTokenizer: bypass __getattr__ for underscore-prefixed attrs to prevent infinite recursion during unpickle when __dict__ is empty

2026-07-19 11:59:55 +08:00

..

__init__.py

chore: 优化未使用的模块

2026-04-06 09:54:17 +08:00

chat_template.py

fix: make tokenizer picklable for spawn multiprocessing

2026-07-19 11:59:55 +08:00

tokenizer.py

fix: make tokenizer picklable for spawn multiprocessing

2026-07-19 11:59:55 +08:00