3 Commits

Include renames

Author	SHA1	Message	Date
ViperEkura	6ac3b51496	refactor: separate extension ops and backends	2026-08-16 21:15:52 +08:00
ViperEkura	738cb8f128	fix: broadcast ref/old model state_dict for FSDP ... - Add broadcast_state_dict to sync state_dict from rank-0 to all ranks - Fix create_ref_model returning None on non-rank-0 under FSDP - Fix sync_old_model only updating old_model on rank-0 under FSDP - Split skip_no_cuda/skip_no_kernel markers and hoist to top-level conftest - Add distributed tests for broadcast_state_dict and create_ref_model	2026-07-31 08:32:22 +08:00
ViperEkura	3067a8e1a6	feat: unify attention backend with multi-dim mask support ... - Add attention() functional entry delegating to active backend - GQA/MLA forward calls attention() instead of inline cache/SDPA - CUDA kernels support 2D/3D/4D mask via mask_h_stride field - CudaBackend.fwd_decode builds 2D padding mask for mixed seq_lens - KVCache.max_len precomputed in bind_tasks to avoid GPU sync - batch==1 decode short-circuits mask=None - Split tests into conftest, test_backend, test_backend_equivalence, test_kernel_mask - 440 tests pass, L20 decode 1.44-1.60x speedup vs torch native	2026-07-30 20:38:34 +08:00