AstrAI/csrc/tests
ViperEkura a4ae7d17fb perf: increase decode split-K parallelism for short sequences
- Remove tiles_total/8 min-work cap that limited splits for small workloads
- Simplify decode_num_splits to only use base_blocks and tiles_total
- Short sequences now generate more blocks, improving SM utilization
2026-07-11 11:26:42 +08:00
..
attn_decode_test.cu perf: increase decode split-K parallelism for short sequences 2026-07-11 11:26:42 +08:00
attn_prefill_test.cu refactor: template AttentionParams, rename .cuh to .h 2026-07-11 11:03:14 +08:00