ViperEkura 6e5088cc7d refactor: remove prefill from CUDA graph warmup ...

- decode capture works without pre-filled KV values
- reduces init time and eliminates unused prefill forward

2026-08-08 12:49:07 +08:00

..

api

refactor: migrate config system to Pydantic dataclasses

2026-07-30 08:25:32 +08:00

core

refactor: remove prefill from CUDA graph warmup

2026-08-08 12:49:07 +08:00

__init__.py

refactor: simplify inference engine and backend dispatch

2026-08-07 22:28:48 +08:00

engine.py

refactor: simplify inference engine and backend dispatch

2026-08-07 22:28:48 +08:00

sample.py

refactor: unify greedy check with _is_greedy helper

2026-08-07 14:14:15 +08:00