AstrAI/csrc/kernels
ViperEkura dea59f7e1d fix: restore resident Qa to fix sQ overwrite bug
Moving Qa ldmatrix into the tile loop caused warps 0-2 to read
warp 3's Q data from sQ (only the last warp's data survives the
serialized load loop). Reverted to loading Qa during the init phase
and keeping it resident; __launch_bounds__ still forces 128 regs
(33% occupancy) with spill to local memory.
2026-07-10 00:49:58 +08:00
..
gqa_common.cuh fix: correct prefill mask index, unify GQA kernel interface 2026-07-06 17:21:23 +08:00
gqa_decode_attn.cu perf: apply cp.async, XOR swizzle, pre-scaled Q to decode MMA kernel 2026-07-08 16:15:14 +08:00
gqa_decode_attn.cuh fix: correct prefill mask index, unify GQA kernel interface 2026-07-06 17:21:23 +08:00
gqa_decode_attn_mma.cuh perf: apply cp.async, XOR swizzle, pre-scaled Q to decode MMA kernel 2026-07-08 16:15:14 +08:00
gqa_mma_utils.cuh feat: support HEAD_DIM=32 and split extension into loader/ops 2026-07-08 14:14:11 +08:00
gqa_prefill_attn.cu perf: reduce MMA kernel registers, switch to static smem 2026-07-10 00:39:47 +08:00
gqa_prefill_attn.cuh perf: reduce MMA kernel registers, switch to static smem 2026-07-10 00:39:47 +08:00
gqa_prefill_attn_mma.cuh fix: restore resident Qa to fix sQ overwrite bug 2026-07-10 00:49:58 +08:00