ViperEkura
5b67d5865a
feat: add AttentionBackend ABC with context manager
- AttentionBackend ABC with forward_decode/forward_extend dispatch
- TorchNativeBackend: SDPA with indirect KV cache gather
- attn_backend() context manager + ATTN_BACKEND enum (mirrors sdpa_kernel)
- ContextVar-based thread-safe backend switching
- get_backend() falls back to default TorchNativeBackend singleton
2026-07-30 18:20:27 +08:00
..
2026-07-30 08:41:14 +08:00
2026-07-29 12:50:27 +08:00
2026-07-30 18:20:27 +08:00
2026-07-30 17:47:04 +08:00
2026-07-30 17:47:04 +08:00
2026-07-30 07:54:54 +08:00
2026-07-29 12:50:27 +08:00
2026-07-29 12:50:27 +08:00
2026-07-30 09:38:20 +08:00
2026-07-30 09:38:20 +08:00
2026-07-29 12:50:27 +08:00
2026-07-30 09:38:20 +08:00
2026-05-24 20:35:44 +08:00
2026-07-28 10:36:17 +08:00