ViperEkura
4e508afa2d
- change position_ids_mode default from "none" to "doc_reset" so SFT preprocessing always generates position_ids (was causing dataset load KeyError) - generate per-doc position_ids before packing (doc_reset mode), preserving document boundaries for BFD packing (cross-doc attention leak fix) - change _align_bucket padding from [1] to [0] to avoid accidentally training on loss_mask padding |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| builder.py | ||
| packing.py | ||
| pipeline.py | ||
| position_id.py | ||
| writer.py | ||