ViperEkura b8b439b713 perf: fuse decode combine kernel to single-pass online-rescale reduction ...

- Replace 3-scan loops (mstar, lstar, acc) with 1-pass online rescale
- Halves __expf calls (num_splits vs 2*num_splits) and ml_part re-reads
- Mathematically equivalent, no change to o_part traffic or output

2026-07-11 00:24:09 +08:00

..

kernels

perf: fuse decode combine kernel to single-pass online-rescale reduction

2026-07-11 00:24:09 +08:00

tests

refactor: rename gqa_* to attn_*, split-KV for all decode paths

2026-07-10 23:35:14 +08:00

__init__.py

feat: add optional CUDA kernel system (csrc/) + fused GQA decode attention

2026-07-06 12:09:58 +08:00

build.py

refactor: rename gqa_* to attn_*, split-KV for all decode paths

2026-07-10 23:35:14 +08:00