ViperEkura 69f35c46e0 fix: quantize amax from raw values, not scaled fp8 values ...

- amax for delayed scale was the quantized max (always ~448), so scale collapsed to 1
- this made fp8 gradients diverge (cosine 0.05) and training stall
- stop w/x transpose-quantize amax from polluting the grad scale

2026-08-14 14:26:16 +08:00

..

lib

refactor: move compiled kernel .so files into extension/lib

2026-07-31 15:36:32 +08:00

__init__.py

refactor : use factory for attention backends

2026-08-05 15:37:22 +08:00

attention_backend.py

perf: flatten paged prefill tile dispatch

2026-08-09 23:12:53 +08:00

attention_ops.py

perf: flatten paged prefill tile dispatch

2026-08-09 23:12:53 +08:00

fp8_ops.py

refactor: split fp8 into fp8_ops adapter and fp8 policy module

2026-08-14 12:25:29 +08:00

fp8.py

fix: quantize amax from raw values, not scaled fp8 values

2026-08-14 14:26:16 +08:00

loader.py

feat: add fp8 training via cublasLt dispatch

2026-08-14 00:39:49 +08:00

rotary_backend.py

refactor: unify rotary embedding interface and update docs

2026-07-31 16:52:25 +08:00

rotary_ops.py

refactor: unify rotary embedding interface and update docs

2026-07-31 16:52:25 +08:00