4 Commits

Include renames

Author	SHA1	Message	Date
ViperEkura	16a55bb474	refactor: reorganize CUDA kernels into per-family directories ... - move attention kernels to csrc/kernels/attention/ and rotary to rotary/ - add shared common/mma.cuh (mma_sync, ldmatrix) and device.cuh (sm checks) - split fp8_mm into three-layer fp8/common.h, gemm.cuh, mm.cu - fix fused FP8 GEMM ldmatrix lane indexing to fix OOB shared reads - update extension ops, loader, and kernel tests	2026-08-22 20:40:31 +08:00
ViperEkura	7580d80d45	perf: accelerate FP8 backward with fused fast kernel ... - route dX/dW through the fused 128x64 fast kernel via contiguous transposes - drop the legacy 64x64 kernel, cutting dX 1.55->0.38 ms and dW 1.28->0.26 ms - sync all threads after cp.async.wait_group to fix sporadic NaN in large GEMMs - add fp8_mm_prequant_fp8 custom op for FP8-in/FP8-out GEMM	2026-08-18 23:46:43 +08:00
ViperEkura	cb51a3587b	perf: optimize fused FP8 GEMM kernel	2026-08-18 19:56:15 +08:00
ViperEkura	6ac3b51496	refactor: separate extension ops and backends	2026-08-16 21:15:52 +08:00