fix: default max_grad_norm to 1.0 and drop None branch

2026-07-20 01:08:13 +08:00
parent 31d33ccdf0
commit e5f9b1a3a9
4 changed files with 5 additions and 14 deletions
@@ -26,7 +26,7 @@
 |-----------|-------------|---------|
 | `--warmup_ratio` | Fraction of total steps used for LR warmup | 0.05 |
 | `--max_lr` | Maximum learning rate (cosine decay after warmup) | 3e-4 |
-| `--max_grad_norm` | Maximum gradient norm for clipping (None disables) | None |
+| `--max_grad_norm` | Maximum gradient norm for clipping (None disables) | 1.0 |

 ### Optimizer (MuonMix)