Gaolingx 6d98bb4f9f 20260801-moe model impl ...

need to add aux loss for load balancing

2026-08-01 22:48:58 +08:00

..

data

test: prune low-value and duplicate tests

2026-08-01 16:01:20 +08:00

extension

feat: SGLang-style paged attention kernels replace page-table path

2026-08-01 15:41:25 +08:00

inference

test: prune low-value and duplicate tests

2026-08-01 16:01:20 +08:00

module

20260801-moe model impl

2026-08-01 22:48:58 +08:00

optim

feat: add Mano manifold optimizer (mano_adamw)

2026-08-01 08:51:08 +08:00

parallel

fix: broadcast ref/old model state_dict for FSDP

2026-07-31 08:32:22 +08:00

trainer

test: prune low-value and duplicate tests

2026-08-01 16:01:20 +08:00

conftest.py

fix: broadcast ref/old model state_dict for FSDP

2026-07-31 08:32:22 +08:00

helpers.py

fix: broadcast ref/old model state_dict for FSDP

2026-07-31 08:32:22 +08:00

test_train_cli.py

Make Nora+NAdamW the default optimizer

2026-07-31 23:16:39 +08:00