AstrAI/csrc
ViperEkura a4ae7d17fb perf: increase decode split-K parallelism for short sequences
- Remove tiles_total/8 min-work cap that limited splits for small workloads
- Simplify decode_num_splits to only use base_blocks and tiles_total
- Short sequences now generate more blocks, improving SM utilization
2026-07-11 11:26:42 +08:00
..
kernels perf: increase decode split-K parallelism for short sequences 2026-07-11 11:26:42 +08:00
tests perf: increase decode split-K parallelism for short sequences 2026-07-11 11:26:42 +08:00
__init__.py feat: add optional CUDA kernel system (csrc/) + fused GQA decode attention 2026-07-06 12:09:58 +08:00
build.py perf: increase decode split-K parallelism for short sequences 2026-07-11 11:26:42 +08:00