ViperEkura
/
AstrAI
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
AstrAI/csrc/kernels
History
ViperEkura 89ece26c25 feat: paged decode attention with split-KV (scalar + MMA) 
- PagedAttentionParams merged into attn_common.h
- Scalar variant: warp-per-query-head split-KV, resolves page table per-position for the K/V shared-memory tile load
- MMA variant (sm_80+): tensor-core head-packing with cp.async, single page-table lookup per tile (BC=32 fits within page_size>=32)
- Standalone test: 14 cases across head_dim 32/64/128/256, GQA, multi-batch, both paths verified against CPU reference
 		2026-07-11 18:14:51 +08:00
..
attn_common.h feat: paged decode attention with split-KV (scalar + MMA) 2026-07-11 18:14:51 +08:00
attn_decode.cu perf: enable MMA decode path for G=1 full attention 2026-07-11 11:45:13 +08:00
attn_decode_split_kv.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_decode_split_kv_mma.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_entry_utils.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_mma_utils.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_paged_decode.cu feat: paged decode attention with split-KV (scalar + MMA) 2026-07-11 18:14:51 +08:00
attn_paged_decode_split_kv.cuh feat: paged decode attention with split-KV (scalar + MMA) 2026-07-11 18:14:51 +08:00
attn_paged_decode_split_kv_mma.cuh feat: paged decode attention with split-KV (scalar + MMA) 2026-07-11 18:14:51 +08:00
attn_prefill.cu refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_prefill_split_q.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_prefill_split_q_mma.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00