Logo
Explore Help
Register Sign In
ViperEkura/AstrAI
Watch 1
Star 0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
Files
b8b439b7130e9956fc165a533eb816ae003eb4d3
AstrAI/csrc/kernels
T
History
ViperEkura b8b439b713 perf: fuse decode combine kernel to single-pass online-rescale reduction
- Replace 3-scan loops (mstar, lstar, acc) with 1-pass online rescale
- Halves __expf calls (num_splits vs 2*num_splits) and ml_part re-reads
- Mathematically equivalent, no change to o_part traffic or output
2026-07-11 00:24:09 +08:00
..
attn_common.cuh
refactor: rename gqa_* to attn_*, split-KV for all decode paths
2026-07-10 23:35:14 +08:00
attn_decode_split_kv_mma.cuh
perf: post-multiply attention scale in float instead of pre-scaling Q in bf16
2026-07-11 00:13:32 +08:00
attn_decode_split_kv.cuh
perf: fuse decode combine kernel to single-pass online-rescale reduction
2026-07-11 00:24:09 +08:00
attn_decode.cu
refactor: rename gqa_* to attn_*, split-KV for all decode paths
2026-07-10 23:35:14 +08:00
attn_entry_utils.cuh
refactor: rename gqa_* to attn_*, split-KV for all decode paths
2026-07-10 23:35:14 +08:00
attn_mma_utils.cuh
refactor: rename gqa_* to attn_*, split-KV for all decode paths
2026-07-10 23:35:14 +08:00
attn_prefill_split_q_mma.cuh
perf: post-multiply attention scale in float instead of pre-scaling Q in bf16
2026-07-11 00:13:32 +08:00
attn_prefill_split_q.cuh
refactor: rename gqa_* to attn_*, split-KV for all decode paths
2026-07-10 23:35:14 +08:00
attn_prefill.cu
refactor: rename gqa_* to attn_*, split-KV for all decode paths
2026-07-10 23:35:14 +08:00
Powered by Gitea Version: 1.27.2 Page: 21ms Template: 4ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API