ViperEkura d7ac66fb73 refactor: simplify attention mask handling

2026-07-20 20:36:16 +08:00

..

__init__.py

perf: replace paged KV cache with contiguous ContiguousCache, decode all groups

2026-07-05 11:34:36 +08:00

cache.py

perf: merge decode batch for 10x throughput

2026-07-18 08:50:46 +08:00

executor.py

refactor: simplify attention mask handling

2026-07-20 20:36:16 +08:00

scheduler.py

refactor: map instruction/input/output to chat roles

2026-07-20 13:55:25 +08:00

task.py

refactor: unify rollout onto inference engine KV-cache path

2026-07-20 12:52:20 +08:00