 ViperEkura
|
e8e228d035
|
feat: add optional CUDA kernel system (csrc/) + fused GQA decode attention
Structure:
csrc/ -- .cu sources + build.py registry
astrai/extension/ -- compiled .so + __init__.py (import dispatcher)
setup.py -- CUDAExtension from csrc/build.py REGISTRY
Control: CSRC_KERNELS=true|false env var at install time.
Fallback: astrai.extension.available dict for runtime detection.
|
2026-07-06 12:09:58 +08:00 |