ViperEkura 5244f1a8fc feat: add te-style scaled fp8 training via fp8_autocast ...

- per-tensor scales applied inside cublasLt via A_SCALE/B_SCALE
- delayed scaling: weight amax history ring, refresh every 16 steps
- quantize kernels emit atomic amax, device-side scale updates
- fp8_autocast context toggles aten::linear dispatch like torch.autocast
- fallback to bf16 when M/N not 16-aligned (fp8 gemm constraint)
- x/g scales delayed one step, reuse free atomic amax (no abs/max reduce)

2026-08-14 12:14:04 +08:00

..

attn_common.h

perf: flatten paged prefill tile dispatch

2026-08-09 23:12:53 +08:00

attn_decode_split_kv_mma.cuh

refactor: unify attention param field names

2026-08-09 20:23:58 +08:00

attn_decode_split_kv.cuh

refactor: tidy attention params and launcher interfaces

2026-08-09 20:52:06 +08:00

attn_decode.cu

refactor: tidy attention params and launcher interfaces

2026-08-09 20:52:06 +08:00

attn_dispatchers.cuh

perf: flatten paged prefill tile dispatch

2026-08-09 23:12:53 +08:00

attn_entry_utils.cuh

perf: flatten paged prefill tile dispatch

2026-08-09 23:12:53 +08:00

attn_kv_source.cuh

refactor: streamline Q block mapping

2026-08-10 08:40:18 +08:00

attn_mma_utils.cuh

refactor: unify attention param field names

2026-08-09 20:23:58 +08:00

attn_paged_decode.cu

refactor: tidy attention params and launcher interfaces

2026-08-09 20:52:06 +08:00

attn_paged_prefill.cu

perf: flatten paged prefill tile dispatch

2026-08-09 23:12:53 +08:00

attn_prefill_split_q_mma.cuh

refactor: streamline Q block mapping

2026-08-10 08:40:18 +08:00

attn_prefill_split_q.cuh

refactor: streamline Q block mapping

2026-08-10 08:40:18 +08:00

attn_prefill.cu

refactor: tidy attention params and launcher interfaces

2026-08-09 20:52:06 +08:00

attn_warp_utils.cuh

perf: extend MMA decode to arbitrary GQA ratio, add launch bounds, vectorize combine

2026-07-27 00:35:34 +08:00

fp8_mm.cu

feat: add te-style scaled fp8 training via fp8_autocast

2026-08-14 12:14:04 +08:00

rotary_emb.cu

perf: launch CUDA kernels on torch's current stream

2026-08-02 13:20:14 +08:00