AstrAI/csrc
ViperEkura 11fa807cfc fix: correct prefill mask index, unify GQA kernel interface
- Fix mask indexing: batch*q_len*kv_len -> batch*kv_len
- Add csrc/kernels/gqa_common.cuh with shared GQAParams struct
- Unify decode/prefill Python API: both accept (q,k,v,mask=None,...)
- Decode now supports optional mask, is_causal, causal_offset, scale
- Rename struct fields: B->batch, Hq->q_head, Hk->kv_head, D->head_dim
- Use py::arg() for correct None/defaults handling in pybind11
- Update pure C tests and build instructions (-arch=sm_89)
2026-07-06 17:21:23 +08:00
..
kernels fix: correct prefill mask index, unify GQA kernel interface 2026-07-06 17:21:23 +08:00
tests fix: correct prefill mask index, unify GQA kernel interface 2026-07-06 17:21:23 +08:00
__init__.py feat: add optional CUDA kernel system (csrc/) + fused GQA decode attention 2026-07-06 12:09:58 +08:00
build.py fix: correct gqa_decode_attn reduction + add gqa_prefill_attn 2026-07-06 13:45:18 +08:00