AstrAI-paper

T

ViperEkura 0a1d0573ae doc: add SFT length filter (15-token floor) with IFD bias rationale

Per-field length filtering in SFT drops instruction--response pairs
with responses shorter than 15 tokens. Short replies exhibit high
per-token variance in both conditional and unconditional loss
(Appendix A.3 / Figure 5), which would distort downstream IFD-based
difficulty estimates.

2026-07-24 06:27:10 +08:00

data

fix: align SFT/DPO figures and text with actual training data

2026-07-24 06:15:42 +08:00

.gitignore

Restructure data pipeline: replace IFD analysis with length bias appendix

2026-07-05 18:59:29 +08:00

main.tex

doc: add SFT length filter (15-token floor) with IFD bias rationale

2026-07-24 06:27:10 +08:00