AstrAI

Files

T

ViperEkura 8c052c99ee feat: add optional FlashAttention (FA2/FA3) backend

- add FlashAttnBackend (ATTN_BACKEND.FLASH) using flash_attn_func with KV-cache gather + GQA, mirroring TorchNativeBackend
- add flash_attn_available() probe gated on compute capability plus a real-kernel smoke test, cached at first use
- lazy-import flash-attn via importlib so it stays an optional dependency, raising clear errors when unusable
- add 'flash' optional extra (flash-attn>=2.6) and export the new backend

2026-08-05 15:27:26 +08:00

lib

refactor: move compiled kernel .so files into extension/lib

2026-07-31 15:36:32 +08:00

__init__.py

feat: add optional FlashAttention (FA2/FA3) backend

2026-08-05 15:27:26 +08:00

attention_backend.py

feat: add optional FlashAttention (FA2/FA3) backend

2026-08-05 15:27:26 +08:00

attention_ops.py

feat: SGLang-style paged attention kernels replace page-table path