3 Commits

Include renames

Author	SHA1	Message	Date
ViperEkura	d28552f878	refactor: use C++17 struct dispatch in csrc tests, tighten paged tolerances to 0.01 ... - Replace C++20 explicit lambda template parameters with file-scope structs (DecodeDispatch/PrefillDispatch etc.) - Remove unused gs variable in run_decode_test - Tighten paged test atol/rtol from 0.02 to 0.01 to match contiguous tests	2026-08-09 10:23:12 +08:00
ViperEkura	49a9c6b3d2	build: migrate CUDA kernel build to CMake ... Replace torch CUDAExtension/ParallelBuildExtension with a CMake-based build. Each kernel compiles as an independent pybind11 module in parallel via cmake --build -j, outputting to astrai/extension/lib. - Add csrc/CMakeLists.txt (5 kernel targets, torch/pybind11 linking) - setup.py: _CMakeBuildExt invokes cmake; auto-detect CUDA arch via torch - Remove csrc/build.py (REGISTRY/build flags now in CMakeLists) - Fix rel-err eps in attn_test.cu (1e-8 -> 1e-4, bf16 scale) - Update docs/developer/cuda_kernels.md build section - .gitignore: allow csrc/CMakeLists.txt	2026-08-04 21:27:22 +08:00
ViperEkura	3439e3104e	perf: launch CUDA kernels on torch's current stream ... - Thread a cudaStream_t through attn dispatchers onto torch's current stream - Scope the device guard to the entry function so kernels run on tensor device - DISPATCH_HEAD_DIM now forwards varargs so stream reaches each dispatch - Parallelize CPU reference kernels with OpenMP (paged test 31s -> 7s) - Merge decode/prefill standalone tests into attn_test.cu with correctness tables - Drop bench error column (CPU ref too slow at large sizes) - Update cuda_kernels.md for the merged test layout	2026-08-02 13:20:14 +08:00