- Add gqa_decode_attn_mma.cuh for tensor-core decode path - Add dispatch_decode<> selecting MMA vs scalar based on G and mask - Add TORCH_CHECK for unsupported head_dim instead of silent scalar launch |
||
|---|---|---|
| .. | ||
| kernels | ||
| tests | ||
| __init__.py | ||
| build.py | ||
- Add gqa_decode_attn_mma.cuh for tensor-core decode path - Add dispatch_decode<> selecting MMA vs scalar based on G and mask - Add TORCH_CHECK for unsupported head_dim instead of silent scalar launch |
||
|---|---|---|
| .. | ||
| kernels | ||
| tests | ||
| __init__.py | ||
| build.py | ||