- inline decode_use_mma() into dispatch_decode() - drop G>1 guard, MMA works correctly for G>=1 - decode is memory-bound, tensor cores + cp.async still win at G=1 |
||
|---|---|---|
| .. | ||
| attn_common.h | ||
| attn_decode.cu | ||
| attn_decode_split_kv.cuh | ||
| attn_decode_split_kv_mma.cuh | ||
| attn_entry_utils.cuh | ||
| attn_mma_utils.cuh | ||
| attn_prefill.cu | ||
| attn_prefill_split_q.cuh | ||
| attn_prefill_split_q_mma.cuh | ||