ViperEkura cb60713a72 feat: add per-task throughput and latency metrics ...

- extract TaskTiming + MetricsCollector out of Task/TaskManager
- unify prefill/decode timing into single record() context manager
- expose avg_ttft_ms, avg_decode_tps, avg_e2e_latency_ms via /stats

2026-08-08 12:10:06 +08:00

..

__init__.py

feat: add per-task throughput and latency metrics

2026-08-08 12:10:06 +08:00

cache.py

refactor: extract shared steady-state increment detection

2026-08-07 23:00:25 +08:00

executor.py

refactor: extract shared steady-state increment detection

2026-08-07 23:00:25 +08:00

graph.py

fix: add out_buf to attn_paged_decode for CUDA graph capture compatibility

2026-08-07 19:45:59 +08:00

metrics.py

feat: add per-task throughput and latency metrics

2026-08-08 12:10:06 +08:00

scheduler.py

feat: add per-task throughput and latency metrics

2026-08-08 12:10:06 +08:00

task.py

feat: add per-task throughput and latency metrics

2026-08-08 12:10:06 +08:00

workspace.py

fix: add out_buf to attn_paged_decode for CUDA graph capture compatibility

2026-08-07 19:45:59 +08:00