- Replace 3-scan loops (mstar, lstar, acc) with 1-pass online rescale - Halves __expf calls (num_splits vs 2*num_splits) and ml_part re-reads - Mathematically equivalent, no change to o_part traffic or output |
||
|---|---|---|
| .. | ||
| attn_common.cuh | ||
| attn_decode.cu | ||
| attn_decode_split_kv.cuh | ||
| attn_decode_split_kv_mma.cuh | ||
| attn_entry_utils.cuh | ||
| attn_mma_utils.cuh | ||
| attn_prefill.cu | ||
| attn_prefill_split_q.cuh | ||
| attn_prefill_split_q_mma.cuh | ||