ViperEkura 5104638447 perf: use fp8 tensor-core gemm in linear backward ...

- dX/dW run as fp8 cublasLt gemms via fused transpose-cast
- shared (m,k,n) algo cache for fwd/bwd, mutex-protected
- bias add in-place on bf16 output, drop output copy

2026-08-14 10:43:03 +08:00

..

kernels

perf: use fp8 tensor-core gemm in linear backward

2026-08-14 10:43:03 +08:00

tests

perf: flatten paged prefill tile dispatch

2026-08-09 23:12:53 +08:00

__init__.py

feat: add optional CUDA kernel system (csrc/) + fused GQA decode attention

2026-07-06 12:09:58 +08:00

CMakeLists.txt

feat: add fp8 training via cublasLt dispatch

2026-08-14 00:39:49 +08:00