AstrAI-paper

T

ViperEkura a0c39601a0 Add effective rank analysis, weight distribution evolution, Muon/SFT training figures

- Add SVD effective rank (ER@99%) and condition number analysis across
  three checkpoints (kami-15bt, norm-15bt, muon-25bt) in appendix
- Add post-training weight distribution analysis as §5.4, verifying
  residual scaling persists throughout training
- Add per-component weight std table in appendix showing Muon constrains
  early-stage drift vs Normal init
- Add Muon optimizer training dynamics figure (muon_pt.png)
- Add SFT training metrics figure (sft_metrics.png) on mixed CN-EN data
- Restructure: move effective rank to appendix, weight distribution to
  §5.4, delete standalone §6, tighten abstract to prose-only
- Update conclusion to reference new analyses

2026-07-17 23:05:21 +08:00

data

Add effective rank analysis, weight distribution evolution, Muon/SFT training figures

2026-07-17 23:05:21 +08:00

.gitignore

Restructure data pipeline: replace IFD analysis with length bias appendix

2026-07-05 18:59:29 +08:00

main.tex

Add effective rank analysis, weight distribution evolution, Muon/SFT training figures

2026-07-17 23:05:21 +08:00