ViperEkura 6e5088cc7d refactor: remove prefill from CUDA graph warmup ...

- decode capture works without pre-filled KV values
- reduces init time and eliminates unused prefill forward

2026-08-08 12:49:07 +08:00

..

__init__.py

feat: add per-task throughput and latency metrics

2026-08-08 12:10:06 +08:00

cache.py

refactor: extract shared steady-state increment detection

2026-08-07 23:00:25 +08:00

executor.py

refactor: remove prefill from CUDA graph warmup

2026-08-08 12:49:07 +08:00

graph.py

fix: add out_buf to attn_paged_decode for CUDA graph capture compatibility

2026-08-07 19:45:59 +08:00

metrics.py

feat: add per-task throughput and latency metrics

2026-08-08 12:10:06 +08:00

scheduler.py

feat: add per-task throughput and latency metrics

2026-08-08 12:10:06 +08:00

task.py

feat: add per-task throughput and latency metrics

2026-08-08 12:10:06 +08:00

workspace.py

fix: add out_buf to attn_paged_decode for CUDA graph capture compatibility

2026-08-07 19:45:59 +08:00