ViperEkura fd65b9bc23 feat: support HEAD_DIM=32 and split extension into loader/ops ... - add case 32 to decode/prefill dispatch switch - fix swiz_col out-of-bounds for HEAD_DIM=32: XOR mask now limited to chunk count (3 for 32, 7 for >=64) instead of always 7, which produced column offsets >= LD=32 and corrupted shared memory - restructure decode dispatch to #ifndef/#else/#endif matching prefill - split astrai/extension/__init__.py into loader.py (kernel .so discovery) and ops.py (wrapper functions + torch SDPA fallback); __init__.py now re-exports the public API		2026-07-08 14:14:11 +08:00
..
kernels	feat: support HEAD_DIM=32 and split extension into loader/ops	2026-07-08 14:14:11 +08:00
tests	perf: add fast-math and vectorization nvcc/cxx build flags	2026-07-07 22:28:32 +08:00
__init__.py	feat: add optional CUDA kernel system (csrc/) + fused GQA decode attention	2026-07-06 12:09:58 +08:00
build.py	perf: add fast-math and vectorization nvcc/cxx build flags	2026-07-07 22:28:32 +08:00