ViperEkura
8a8550184f
refactor: template AttentionParams, rename .cuh to .h
...
- Convert AttentionParams to a template struct supporting arbitrary types
- Rename attn_common.cuh -> attn_common.h (no CUDA-specific code remains)
- Include standard headers explicitly in each .cuh instead of via attn_common.cuh
- Allow .h files in csrc/ via .gitignore
2026-07-11 11:03:14 +08:00
ViperEkura
bcdd93e0eb
feat: split kernel defs from bindings, add prefill tiled kernel and pure C tests
...
- Split .cuh/.cu for gqa_decode_attn and gqa_prefill_attn
- gqa_prefill_attn: tiled shared-memory K/V, fused load, compute-opt, mask support
- Add pure C tests under csrc/tests/ for fast nvcc-only iteration
- Update .gitignore for build artifacts
2026-07-06 16:14:55 +08:00
ViperEkura
e8e228d035
feat: add optional CUDA kernel system (csrc/) + fused GQA decode attention
...
Structure:
csrc/ -- .cu sources + build.py registry
astrai/extension/ -- compiled .so + __init__.py (import dispatcher)
setup.py -- CUDAExtension from csrc/build.py REGISTRY
Control: CSRC_KERNELS=true|false env var at install time.
Fallback: astrai.extension.available dict for runtime detection.
2026-07-06 12:09:58 +08:00
ViperEkura
1adca39cd8
fix: handle long sequences and optimize IFD computation
2026-07-04 08:35:45 +08:00
ViperEkura
34a511e36e
feat: 新增 Docker Compose 一键部署，支持 GPU/CPU 双模式
2026-05-09 11:57:46 +08:00
ViperEkura
7861af12e4
chore: 增加docker 配置
2026-04-04 10:59:32 +08:00
ViperEkura
7f0552013a
chore: 增加提交检测脚本
2026-04-04 10:43:24 +08:00
ViperEkura
94c6a015c8
chore: 更新ignore
2026-04-03 14:31:05 +08:00
ViperEkura
912d7c7f54
chore: 更新脚本并且修改gitignore
2026-04-02 15:40:31 +08:00
ViperEkura
e7721eafc6
docs: 更新说明内容
2026-03-31 15:18:49 +08:00
ViperEkura
426af2d75f
style: 使用ruff 工具优化代码风格
2026-03-30 23:32:28 +08:00
ViperEkura
80e17418b4
fix: 修复一些运行时问题
2026-03-01 15:47:07 +08:00
ViperEkura
eab7a51bb6
feat(parallel): 改进设备策略注册表与并行设置功能
2025-12-19 15:25:31 +08:00
ViperEkura
2dc7b5bda8
build(.gitignore): 更新 gitignore 文件忽略规则
2025-09-28 15:39:13 +08:00
ViperEkura
a4443765ee
Initial commit
2025-09-27 12:02:22 +08:00
ViperEkura