AstrAI

Commit Graph

Author	SHA1	Message	Date
ViperEkura	b8b439b713	perf: fuse decode combine kernel to single-pass online-rescale reduction - Replace 3-scan loops (mstar, lstar, acc) with 1-pass online rescale - Halves __expf calls (num_splits vs 2*num_splits) and ml_part re-reads - Mathematically equivalent, no change to o_part traffic or output	2026-07-11 00:24:09 +08:00
ViperEkura	d923ebe38d	refactor: rename gqa_* to attn_, split-KV for all decode paths - Rename all csrc/kernels/gqa_.cuh/cu to attn_*, with _split_q / _split_kv strategy suffix and optional _mma compute suffix - Remove non-split MMA decode kernel, keep only split-KV path - Convert scalar decode fallback to split-KV (o_part/ml_part + combine) - Move combine kernel to attn_decode_split_kv.cuh (shared by both paths) - Rename GQAParams to AttentionParams - Update all C++ #include, PYBIND11, and Python extension references	2026-07-10 23:35:14 +08:00

Author

SHA1

Message

Date

ViperEkura

b8b439b713

perf: fuse decode combine kernel to single-pass online-rescale reduction

- Replace 3-scan loops (mstar, lstar, acc) with 1-pass online rescale
- Halves __expf calls (num_splits vs 2*num_splits) and ml_part re-reads
- Mathematically equivalent, no change to o_part traffic or output

2026-07-11 00:24:09 +08:00

ViperEkura

d923ebe38d

refactor: rename gqa_* to attn_*, split-KV for all decode paths

- Rename all csrc/kernels/gqa_*.cuh/cu to attn_*, with _split_q / _split_kv
  strategy suffix and optional _mma compute suffix
- Remove non-split MMA decode kernel, keep only split-KV path
- Convert scalar decode fallback to split-KV (o_part/ml_part + combine)
- Move combine kernel to attn_decode_split_kv.cuh (shared by both paths)
- Rename GQAParams to AttentionParams
- Update all C++ #include, PYBIND11, and Python extension references

2026-07-10 23:35:14 +08:00

2 Commits