ViperEkura/AstrAI
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

docs: update for attention backend and extension API

Browse Source 
- Remove stale 'not yet wired' references
- Add AttentionBackend/CudaBackend sections to cuda_kernels.md, internals.md, inference.md
- Add astrai.extension to architecture.md module table and design patterns
- Update get-started.md: CUDA kernels activatable via attn_backend()
This commit is contained in:
ViperEkura
2026-07-30 18:50:16 +08:00
parent 32fd03a025
commit 97114b95a4
5 changed files with 80 additions and 17 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/get-started.md
+1 -1
View File
@@ -24,7 +24,7 @@ pip install -e .
# pip install -e ".[dev]"
```
> **CUDA kernels** are opt-in. They are not built by default and are not yet wired into the model or inference path. You can skip them for normal usage.
> **CUDA kernels** are opt-in. They are not built by default. When built, they can be activated via `with attn_backend(ATTN_BACKEND.CUDA):` for accelerated decode/prefill. You can skip them for normal usage.
## 2. Download Model Weights