ViperEkura
/
AstrAI
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
AstrAI/astrai/inference
History
ViperEkura 38e18fdfd3 refactor: PagedCache Facade 模式，提取 PagePool/PrefixCache/TaskTable 
- cache.py: 提取 PagePool (位图+LRU)、PrefixCache (前缀哈希)、TaskTable (任务页表)
  PagedCache 降为 Facade 组合三者 + 张量存储，公开 API 不变
- executor.py: 移除 allocate_pages_for_activation/free_task_pages/get_cached_tokens
  三冗余委托方法，去掉 page_size 构造参数(改用 page_cache.page_size)
- scheduler.py: 直接调用 self._page_cache.* 代替已移除的 Executor 委托
- 移除 CacheView.__slots__、PagePool.ref_count、PagedCache.alloc/pages_needed/inc_ref
  PrefixCache.evict 等死/冗余方法
 		2026-05-11 15:22:21 +08:00
..
__init__.py refactor: TaskManager 剥离页管理，STOP 移至 task.py 2026-05-11 14:04:31 +08:00
cache.py refactor: PagedCache Facade 模式，提取 PagePool/PrefixCache/TaskTable 2026-05-11 15:22:21 +08:00
engine.py refactor: TaskManager 剥离页管理，STOP 移至 task.py 2026-05-11 14:04:31 +08:00
executor.py refactor: PagedCache Facade 模式，提取 PagePool/PrefixCache/TaskTable 2026-05-11 15:22:21 +08:00
sample.py refactor: TaskManager 剥离页管理，STOP 移至 task.py 2026-05-11 14:04:31 +08:00
scheduler.py refactor: PagedCache Facade 模式，提取 PagePool/PrefixCache/TaskTable 2026-05-11 15:22:21 +08:00
server.py feat: GRPO CLI 接入 + on-policy，OpenAI API top_k 参数化，补充训练参数表 2026-05-09 12:22:33 +08:00
task.py refactor: 页状态移入 PagedCache，Task 纯化为域对象 2026-05-11 14:42:39 +08:00