ViperEkura
/
AstrAI
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
AstrAI/csrc/kernels
History
ViperEkura 2c3cef1c87 feat: wire up paged decode CUDA kernel to Python extension 
- Add attn_paged_decode wrapper in ops.py with gather fallback
- Register kernel in loader.py and export from __init__.py
- Extract test_utils.cuh shared by all attention unit tests
- Rename attn_paged_vs_contiguous.cu to attn_paged_decode_test.cu
- Refactor decode/prefill tests to use common bf16 helpers and cpu ref
- Fix k_cache dim check in attn_paged_decode.cu
 		2026-07-11 18:40:49 +08:00
..
attn_common.h feat: paged decode attention with split-KV (scalar + MMA) 2026-07-11 18:14:51 +08:00
attn_decode.cu perf: enable MMA decode path for G=1 full attention 2026-07-11 11:45:13 +08:00
attn_decode_split_kv.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_decode_split_kv_mma.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_entry_utils.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_mma_utils.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_paged_decode.cu feat: wire up paged decode CUDA kernel to Python extension 2026-07-11 18:40:49 +08:00
attn_paged_decode_split_kv.cuh feat: paged decode attention with split-KV (scalar + MMA) 2026-07-11 18:14:51 +08:00
attn_paged_decode_split_kv_mma.cuh feat: paged decode attention with split-KV (scalar + MMA) 2026-07-11 18:14:51 +08:00
attn_prefill.cu refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_prefill_split_q.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_prefill_split_q_mma.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00