AstrAI/csrc
ViperEkura b8b439b713 perf: fuse decode combine kernel to single-pass online-rescale reduction
- Replace 3-scan loops (mstar, lstar, acc) with 1-pass online rescale
- Halves __expf calls (num_splits vs 2*num_splits) and ml_part re-reads
- Mathematically equivalent, no change to o_part traffic or output
2026-07-11 00:24:09 +08:00
..
kernels perf: fuse decode combine kernel to single-pass online-rescale reduction 2026-07-11 00:24:09 +08:00
tests refactor: rename gqa_* to attn_*, split-KV for all decode paths 2026-07-10 23:35:14 +08:00
__init__.py feat: add optional CUDA kernel system (csrc/) + fused GQA decode attention 2026-07-06 12:09:58 +08:00
build.py refactor: rename gqa_* to attn_*, split-KV for all decode paths 2026-07-10 23:35:14 +08:00