AstrAI/csrc
ViperEkura 2c3cef1c87 feat: wire up paged decode CUDA kernel to Python extension
- Add attn_paged_decode wrapper in ops.py with gather fallback
- Register kernel in loader.py and export from __init__.py
- Extract test_utils.cuh shared by all attention unit tests
- Rename attn_paged_vs_contiguous.cu to attn_paged_decode_test.cu
- Refactor decode/prefill tests to use common bf16 helpers and cpu ref
- Fix k_cache dim check in attn_paged_decode.cu
2026-07-11 18:40:49 +08:00
..
kernels feat: wire up paged decode CUDA kernel to Python extension 2026-07-11 18:40:49 +08:00
tests feat: wire up paged decode CUDA kernel to Python extension 2026-07-11 18:40:49 +08:00
__init__.py feat: add optional CUDA kernel system (csrc/) + fused GQA decode attention 2026-07-06 12:09:58 +08:00
build.py feat: paged decode attention with split-KV (scalar + MMA) 2026-07-11 18:14:51 +08:00