ViperEkura 849e1e00a3 refactor: clean up inference design patterns ... 1. KVCache base: add default task_cached/task_record_hashes, remove getattr from scheduler 2. Remove page_size param from scheduler constructor (ContiguousCache-only) 3. InferenceEngine expose cache param for KVCache injection 4. Rename page_cache -> kv_cache in Executor 5. Move stream_callback from Task to TaskManager._callbacks dict 6. TaskManager.clear_queues clears callbacks		2026-07-05 11:41:54 +08:00
..
api	refactor : 清理工厂和配置系统中的死代码与冗余抽象	2026-06-07 11:39:50 +08:00
core	refactor: clean up inference design patterns	2026-07-05 11:41:54 +08:00
__init__.py	perf: replace paged KV cache with contiguous ContiguousCache, decode all groups	2026-07-05 11:34:36 +08:00
engine.py	refactor: clean up inference design patterns	2026-07-05 11:41:54 +08:00
sample.py	fix : 修复策略相关文件的类型注解与抽象方法体	2026-06-14 16:20:10 +08:00