- replace scalar fragment loads with ldmatrix.sync.x4/x2 - add smem row-stride padding (LD = HEAD_DIM + 8) to eliminate 8-way bank conflicts from HEAD_DIM being a 32-bank multiple - switch build flag from positive to negative: -DASTRAI_NO_MMA for pre-sm_80 only; mma is the default path - vectorize scalar path smem loads with float4 ld8 - fix pure-C test configs for ld8 alignment |
||
|---|---|---|
| .. | ||
| gqa_common.cuh | ||
| gqa_decode_attn.cu | ||
| gqa_decode_attn.cuh | ||
| gqa_prefill_attn.cu | ||
| gqa_prefill_attn.cuh | ||
| gqa_prefill_attn_mma.cuh | ||