4 Commits

Include renames

Author	SHA1	Message	Date
ViperEkura	75304d084d	refactor: unify CUDA skip guards in tests ... - add skip_no_fp8 (CUDA + fp8_mm kernel + cc 8.9+) to tests/conftest.py - use skip_no_cuda / skip_no_kernel / skip_no_fp8 directly in test modules - drop _GPU alias and tests.extension.conftest re-exports - remove unused imports (Union in hf_adapter, make_grpo_config in data conftest)	2026-08-22 21:08:06 +08:00
ViperEkura	16a55bb474	refactor: reorganize CUDA kernels into per-family directories ... - move attention kernels to csrc/kernels/attention/ and rotary to rotary/ - add shared common/mma.cuh (mma_sync, ldmatrix) and device.cuh (sm checks) - split fp8_mm into three-layer fp8/common.h, gemm.cuh, mm.cu - fix fused FP8 GEMM ldmatrix lane indexing to fix OOB shared reads - update extension ops, loader, and kernel tests	2026-08-22 20:40:31 +08:00
ViperEkura	7580d80d45	perf: accelerate FP8 backward with fused fast kernel ... - route dX/dW through the fused 128x64 fast kernel via contiguous transposes - drop the legacy 64x64 kernel, cutting dX 1.55->0.38 ms and dW 1.28->0.26 ms - sync all threads after cp.async.wait_group to fix sporadic NaN in large GEMMs - add fp8_mm_prequant_fp8 custom op for FP8-in/FP8-out GEMM	2026-08-18 23:46:43 +08:00
ViperEkura	cb51a3587b	perf: optimize fused FP8 GEMM kernel	2026-08-18 19:56:15 +08:00