- Remove tiles_total/8 min-work cap that limited splits for small workloads - Simplify decode_num_splits to only use base_blocks and tiles_total - Short sequences now generate more blocks, improving SM utilization |
||
|---|---|---|
| .. | ||
| attn_decode_test.cu | ||
| attn_prefill_test.cu | ||