- add register-resident flash-attention kernel using mma.sync.m16n8k16 - dispatch mma vs scalar at build time: pre-sm_80 defines -DASTRAI_NO_MMA, else defaults to mma - scalar path vectorized with float4 smem loads (ld8) |
||
|---|---|---|
| .. | ||
| gqa_decode_test.cu | ||
| gqa_prefill_test.cu | ||