AstrAI/csrc/kernels
ViperEkura 9e63cb9ed0 feat: MMA head-packing decode kernel with scalar fallback dispatch
- Add gqa_decode_attn_mma.cuh for tensor-core decode path
- Add dispatch_decode<> selecting MMA vs scalar based on G and mask
- Add TORCH_CHECK for unsupported head_dim instead of silent scalar launch
2026-07-07 22:56:02 +08:00
..
gqa_common.cuh fix: correct prefill mask index, unify GQA kernel interface 2026-07-06 17:21:23 +08:00
gqa_decode_attn.cu feat: MMA head-packing decode kernel with scalar fallback dispatch 2026-07-07 22:56:02 +08:00
gqa_decode_attn.cuh fix: correct prefill mask index, unify GQA kernel interface 2026-07-06 17:21:23 +08:00
gqa_decode_attn_mma.cuh feat: MMA head-packing decode kernel with scalar fallback dispatch 2026-07-07 22:56:02 +08:00
gqa_prefill_attn.cu feat: ldmatrix + smem padding for mma prefill kernel 2026-07-06 20:55:22 +08:00
gqa_prefill_attn.cuh feat: tensor-core mma prefill with build-time dispatch 2026-07-06 20:33:24 +08:00
gqa_prefill_attn_mma.cuh feat: ldmatrix + smem padding for mma prefill kernel 2026-07-06 20:55:22 +08:00