- Add gqa_decode_attn_mma.cuh for tensor-core decode path - Add dispatch_decode<> selecting MMA vs scalar based on G and mask - Add TORCH_CHECK for unsupported head_dim instead of silent scalar launch |
||
|---|---|---|
| .. | ||
| gqa_common.cuh | ||
| gqa_decode_attn.cu | ||
| gqa_decode_attn.cuh | ||
| gqa_decode_attn_mma.cuh | ||
| gqa_prefill_attn.cu | ||
| gqa_prefill_attn.cuh | ||
| gqa_prefill_attn_mma.cuh | ||