3 Commits

Include renames

Author	SHA1	Message	Date
ViperEkura	3406157431	refactor: standardize packed 3d inference ... - keep training attention on dense 4d tensors - use packed 3d tensors with KV cache for inference - extend CUDA rotary embedding to packed 3d inputs - adapt torch, CUDA and FlashAttention backend dispatch	2026-08-16 13:24:02 +08:00
ViperEkura	a317a4756b	refactor: stateless MoE routing with grouped dispatch ... - replace per-expert mask scan with sort+bincount grouped dispatch - carry router stats in forward output instead of module state - keep MoE diagnostics working under DDP/FSDP wrappers - remove unused _load_balancing_loss helper	2026-08-05 18:42:12 +08:00
ViperEkura	9b7e6c205f	feat: add moe auxloss and metrics	2026-08-05 18:12:28 +08:00