ViperEkura 91acaf4b0b refactor: unify attention mask to single attn_mask tensor ...

- CudaBackend.fwd_decode passes attn_mask directly instead of kv_cache.decode_mask
- TorchNativeBackend derives pos_mask from attn_mask[:,0,0] on decode
- Drop decode_mask and page_table fields from KVCache and bind_tasks

2026-08-01 15:49:26 +08:00

..

api

refactor: migrate config system to Pydantic dataclasses

2026-07-30 08:25:32 +08:00

core

refactor: unify attention mask to single attn_mask tensor

2026-08-01 15:49:26 +08:00

__init__.py

refactor: rebuild KV cache with three-layer separation architecture

2026-07-30 17:19:06 +08:00

engine.py

refactor: rebuild KV cache with three-layer separation architecture

2026-07-30 17:19:06 +08:00

sample.py

perf: reduce decode overhead in scheduler and executor

2026-07-31 14:50:16 +08:00