ViperEkura b2230fefd8 feat : add radix prefix cache ...

- replace hash-only lookup with page-granular radix matching
- keep partial pages private and cache only materialized KV prefixes
- integrate completed-request caching and add radix behavior tests

2026-08-06 11:45:52 +08:00

..

api

refactor: migrate config system to Pydantic dataclasses

2026-07-30 08:25:32 +08:00

core

feat : add radix prefix cache

2026-08-06 11:45:52 +08:00

__init__.py

feat : add radix prefix cache

2026-08-06 11:45:52 +08:00

engine.py

refactor: rebuild KV cache with three-layer separation architecture

2026-07-30 17:19:06 +08:00

sample.py

perf: preallocate inference decode buffers

2026-08-03 00:55:26 +08:00