AstrAI

Commit Graph

Author	SHA1	Message	Date
ViperEkura	fd6d25ad86	refactor: extract bench_kernel and dispatch_by_head_dim into test_utils	2026-07-12 00:05:04 +08:00
ViperEkura	2c3cef1c87	feat: wire up paged decode CUDA kernel to Python extension - Add attn_paged_decode wrapper in ops.py with gather fallback - Register kernel in loader.py and export from __init__.py - Extract test_utils.cuh shared by all attention unit tests - Rename attn_paged_vs_contiguous.cu to attn_paged_decode_test.cu - Refactor decode/prefill tests to use common bf16 helpers and cpu ref - Fix k_cache dim check in attn_paged_decode.cu	2026-07-11 18:40:49 +08:00

Author

SHA1

Message

Date

ViperEkura

fd6d25ad86

refactor: extract bench_kernel and dispatch_by_head_dim into test_utils

2026-07-12 00:05:04 +08:00

ViperEkura

2c3cef1c87

feat: wire up paged decode CUDA kernel to Python extension

- Add attn_paged_decode wrapper in ops.py with gather fallback
- Register kernel in loader.py and export from __init__.py
- Extract test_utils.cuh shared by all attention unit tests
- Rename attn_paged_vs_contiguous.cu to attn_paged_decode_test.cu
- Refactor decode/prefill tests to use common bf16 helpers and cpu ref
- Fix k_cache dim check in attn_paged_decode.cu

2026-07-11 18:40:49 +08:00

2 Commits