ViperEkura
/
AstrAI
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
AstrAI/csrc/kernels
History
ViperEkura ddc4bd1cf6 feat: tensor-core mma prefill with build-time dispatch 
- add register-resident flash-attention kernel using mma.sync.m16n8k16
- dispatch mma vs scalar at build time: pre-sm_80 defines
  -DASTRAI_NO_MMA, else defaults to mma
- scalar path vectorized with float4 smem loads (ld8)
 		2026-07-06 20:33:24 +08:00
..
gqa_common.cuh fix: correct prefill mask index, unify GQA kernel interface 2026-07-06 17:21:23 +08:00
gqa_decode_attn.cu fix: correct prefill mask index, unify GQA kernel interface 2026-07-06 17:21:23 +08:00
gqa_decode_attn.cuh fix: correct prefill mask index, unify GQA kernel interface 2026-07-06 17:21:23 +08:00
gqa_prefill_attn.cu feat: tensor-core mma prefill with build-time dispatch 2026-07-06 20:33:24 +08:00
gqa_prefill_attn.cuh feat: tensor-core mma prefill with build-time dispatch 2026-07-06 20:33:24 +08:00
gqa_prefill_attn_mma.cuh feat: tensor-core mma prefill with build-time dispatch 2026-07-06 20:33:24 +08:00