ViperEkura
/
AstrAI
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
AstrAI/csrc/kernels
History
ViperEkura a4ae7d17fb perf: increase decode split-K parallelism for short sequences 
- Remove tiles_total/8 min-work cap that limited splits for small workloads
- Simplify decode_num_splits to only use base_blocks and tiles_total
- Short sequences now generate more blocks, improving SM utilization
 		2026-07-11 11:26:42 +08:00
..
attn_common.h refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_decode.cu perf: increase decode split-K parallelism for short sequences 2026-07-11 11:26:42 +08:00
attn_decode_split_kv.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_decode_split_kv_mma.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_entry_utils.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_mma_utils.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_prefill.cu refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_prefill_split_q.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00
attn_prefill_split_q_mma.cuh refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00