ViperEkura a4ae7d17fb perf: increase decode split-K parallelism for short sequences ...

- Remove tiles_total/8 min-work cap that limited splits for small workloads
- Simplify decode_num_splits to only use base_blocks and tiles_total
- Short sequences now generate more blocks, improving SM utilization

2026-07-11 11:26:42 +08:00

..

attn_common.h

refactor: template AttentionParams, rename .cuh to .h

2026-07-11 11:03:14 +08:00

attn_decode_split_kv_mma.cuh

refactor: template AttentionParams, rename .cuh to .h

2026-07-11 11:03:14 +08:00

attn_decode_split_kv.cuh

refactor: template AttentionParams, rename .cuh to .h

2026-07-11 11:03:14 +08:00

attn_decode.cu

perf: increase decode split-K parallelism for short sequences

2026-07-11 11:26:42 +08:00

attn_entry_utils.cuh

refactor: template AttentionParams, rename .cuh to .h

2026-07-11 11:03:14 +08:00

attn_mma_utils.cuh

refactor: template AttentionParams, rename .cuh to .h

2026-07-11 11:03:14 +08:00

attn_prefill_split_q_mma.cuh

refactor: template AttentionParams, rename .cuh to .h

2026-07-11 11:03:14 +08:00

attn_prefill_split_q.cuh

refactor: template AttentionParams, rename .cuh to .h

2026-07-11 11:03:14 +08:00

attn_prefill.cu

refactor: template AttentionParams, rename .cuh to .h

2026-07-11 11:03:14 +08:00