refactor: keep muon_adamw as default optimizer and drop nora docs

- revert CLI/create_optimizer/display defaults to muon_adamw
- revert README, README-zh-CN, params.md to pre-merge state
This commit is contained in:
2026-08-01 07:51:51 +08:00
parent ffbd9b57c9
commit 25c9e81b2b
4 changed files with 24 additions and 29 deletions
+1 -3
View File
@@ -101,9 +101,7 @@ nohup python scripts/tools/train.py \
--batch_per_device=4 \
--grad_accum_steps=8 \
--warmup_ratio=0.05 \
--optimizer=nora_nadamw \
--max_lr=1e-4 \
--nora_lr=5e-3 \
--max_grad_norm=1.0 \
--weight_decay=0.1 \
--window_size=2048 \
@@ -258,4 +256,4 @@ This project is licensed under the [GPL-3.0 License](LICENSE).
<div align="center">
<em>A lightweight Transformer framework designed for both high performance and ease of use.</em>
</div>
</div>