 ViperEkura
|
459523f0e4
|
Fix IFD citation: correct author list and venue (NAACL 2024, not NeurIPS)
|
2026-07-05 00:24:43 +08:00 |
|
ViperEkura
|
4a7bf7ac3f
|
Add GQA/SwiGLU/RoPE formula blocks, Alpaca-GPT4 citation, and improve IFD-Loss Ratio interpretation
|
2026-07-05 00:17:09 +08:00 |
|
ViperEkura
|
5c915514b3
|
Add correlation analysis interpretation to IFD bias section
|
2026-07-04 23:46:25 +08:00 |
|
ViperEkura
|
bc8d4066c1
|
Add IFD analysis: density/length-bias figures and appendix
|
2026-07-04 23:33:12 +08:00 |
|
ViperEkura
|
9534316bac
|
Fix duplicate paragraph and misleading table caption
|
2026-07-04 22:39:16 +08:00 |
|
ViperEkura
|
b40fcc86c7
|
Refine abstract, switch to Times font, remove date, fix overfull hboxes with microtype
|
2026-07-04 22:31:45 +08:00 |
|
ViperEkura
|
dd412b3c9c
|
Add IFD analysis, appendix, and improve abstract
|
2026-07-04 22:25:18 +08:00 |
|
ViperEkura
|
73cb02f0aa
|
fix training hyperparams to match pretraining script: lr 1.5e-4, wd 0.1, warmup 0.02
|
2026-06-28 16:57:30 +08:00 |
|
ViperEkura
|
adc284920a
|
add Alembic SFT data cleaning section with MinHash algorithm and fix bibliography order
|
2026-06-28 16:52:11 +08:00 |
|
ViperEkura
|
13089b002a
|
fix training config: grad_accum 32, remove unused validation & activation ckpt
|
2026-06-28 15:35:15 +08:00 |
|
ViperEkura
|
d3fbe0ecc6
|
refactor: numerical stability analysis with residual scaling comparison
|
2026-06-28 14:36:12 +08:00 |
|
ViperEkura
|
3db1096c78
|
fix: add caption package, fix overfull hbox, correct RoFormer author names
|
2026-06-25 16:53:26 +08:00 |
|
ViperEkura
|
6f9278b35b
|
Initial commit: BF16 weight lock-in paper for 1.2B Transformer training with AstrAI
|
2026-06-25 15:51:05 +08:00 |