AstrAI/csrc
ViperEkura 9e63cb9ed0 feat: MMA head-packing decode kernel with scalar fallback dispatch
- Add gqa_decode_attn_mma.cuh for tensor-core decode path
- Add dispatch_decode<> selecting MMA vs scalar based on G and mask
- Add TORCH_CHECK for unsupported head_dim instead of silent scalar launch
2026-07-07 22:56:02 +08:00
..
kernels feat: MMA head-packing decode kernel with scalar fallback dispatch 2026-07-07 22:56:02 +08:00
tests perf: add fast-math and vectorization nvcc/cxx build flags 2026-07-07 22:28:32 +08:00
__init__.py feat: add optional CUDA kernel system (csrc/) + fused GQA decode attention 2026-07-06 12:09:58 +08:00
build.py perf: add fast-math and vectorization nvcc/cxx build flags 2026-07-07 22:28:32 +08:00