feat: add fp8 training via cublasLt dispatch

- fp8_mm kernel (csrc): cublasLt fp8 e4m3 gemm, TN layout mapped zero-copy
- custom::fp8_mm custom op: meta/cuda/cpu kernels + scale-corrected bf16 autograd
- aten::linear and linear_backward dispatch on CUDA key, zero model changes
- per-tensor scale or raw cast; single-GPU smoke loss matches bf16
This commit is contained in:
2026-08-14 00:39:49 +08:00
parent da6d94492d
commit a5b238dd86
5 changed files with 268 additions and 1 deletions
+1
View File
@@ -17,6 +17,7 @@ KERNEL_NAMES = [
"attn_paged_decode",
"attn_paged_prefill",
"rotary_emb",
"fp8_mm",
]
_available: dict[str, bool] = {}