 ViperEkura
|
e8e228d035
|
feat: add optional CUDA kernel system (csrc/) + fused GQA decode attention
Structure:
csrc/ -- .cu sources + build.py registry
astrai/extension/ -- compiled .so + __init__.py (import dispatcher)
setup.py -- CUDAExtension from csrc/build.py REGISTRY
Control: CSRC_KERNELS=true|false env var at install time.
Fallback: astrai.extension.available dict for runtime detection.
|
2026-07-06 12:09:58 +08:00 |
|
ViperEkura
|
1adca39cd8
|
fix: handle long sequences and optimize IFD computation
|
2026-07-04 08:35:45 +08:00 |
|
ViperEkura
|
34a511e36e
|
feat: 新增 Docker Compose 一键部署，支持 GPU/CPU 双模式
|
2026-05-09 11:57:46 +08:00 |
|
ViperEkura
|
7861af12e4
|
chore: 增加docker 配置
|
2026-04-04 10:59:32 +08:00 |
|
ViperEkura
|
7f0552013a
|
chore: 增加提交检测脚本
|
2026-04-04 10:43:24 +08:00 |
|
ViperEkura
|
94c6a015c8
|
chore: 更新ignore
|
2026-04-03 14:31:05 +08:00 |
|
ViperEkura
|
912d7c7f54
|
chore: 更新脚本并且修改gitignore
|
2026-04-02 15:40:31 +08:00 |
|
ViperEkura
|
e7721eafc6
|
docs: 更新说明内容
|
2026-03-31 15:18:49 +08:00 |
|
ViperEkura
|
426af2d75f
|
style: 使用ruff 工具优化代码风格
|
2026-03-30 23:32:28 +08:00 |
|
ViperEkura
|
80e17418b4
|
fix: 修复一些运行时问题
|
2026-03-01 15:47:07 +08:00 |
|
ViperEkura
|
eab7a51bb6
|
feat(parallel): 改进设备策略注册表与并行设置功能
|
2025-12-19 15:25:31 +08:00 |
|
ViperEkura
|
2dc7b5bda8
|
build(.gitignore): 更新 gitignore 文件忽略规则
|
2025-09-28 15:39:13 +08:00 |
|
ViperEkura
|
a4443765ee
|
Initial commit
|
2025-09-27 12:02:22 +08:00 |