5 Commits

Author	SHA1	Message	Date
ViperEkura	9e63cb9ed0	feat: MMA head-packing decode kernel with scalar fallback dispatch ... - Add gqa_decode_attn_mma.cuh for tensor-core decode path - Add dispatch_decode<> selecting MMA vs scalar based on G and mask - Add TORCH_CHECK for unsupported head_dim instead of silent scalar launch	2026-07-07 22:56:02 +08:00
ViperEkura	11fa807cfc	fix: correct prefill mask index, unify GQA kernel interface ... - Fix mask indexing: batch*q_len*kv_len -> batch*kv_len - Add csrc/kernels/gqa_common.cuh with shared GQAParams struct - Unify decode/prefill Python API: both accept (q,k,v,mask=None,...) - Decode now supports optional mask, is_causal, causal_offset, scale - Rename struct fields: B->batch, Hq->q_head, Hk->kv_head, D->head_dim - Use py::arg() for correct None/defaults handling in pybind11 - Update pure C tests and build instructions (-arch=sm_89)	2026-07-06 17:21:23 +08:00
ViperEkura	bcdd93e0eb	feat: split kernel defs from bindings, add prefill tiled kernel and pure C tests ... - Split .cuh/.cu for gqa_decode_attn and gqa_prefill_attn - gqa_prefill_attn: tiled shared-memory K/V, fused load, compute-opt, mask support - Add pure C tests under csrc/tests/ for fast nvcc-only iteration - Update .gitignore for build artifacts	2026-07-06 16:14:55 +08:00
ViperEkura	579b8c3129	fix: correct gqa_decode_attn reduction + add gqa_prefill_attn ... - gqa_decode_attn: rewrite to per-KV-head, K in smem - gqa_prefill_attn: new kernel for Q_len > 1 with GQA	2026-07-06 13:45:18 +08:00
ViperEkura	e8e228d035	feat: add optional CUDA kernel system (csrc/) + fused GQA decode attention ... Structure: csrc/ -- .cu sources + build.py registry astrai/extension/ -- compiled .so + __init__.py (import dispatcher) setup.py -- CUDAExtension from csrc/build.py REGISTRY Control: CSRC_KERNELS=true|false env var at install time. Fallback: astrai.extension.available dict for runtime detection.	2026-07-06 12:09:58 +08:00