AstrAI

Files

T

ViperEkura 663ef900fc refactor: move sample-id indexing from dataset to store

- Store owns window_size/stride and __getitem__/__len__/sample_window
- Dataset classes become thin delegators binding a Store to a train-type key mapping
- Drop BaseDataset.get_index and the RecordDataset中间类 (window死代码)
- DatasetFactory forces window_size=0 for record datasets so record semantics never get window-tainted
- token_count/num_records split the legacy len() semantics (raw stream length vs record count)
- Update tests to the new .store/.token_count API and window/record mode switching

2026-07-19 16:02:50 +08:00

conftest.py

refactor: split mask builder by single/multi output

2026-07-08 21:18:34 +08:00

test_checkpoint.py

refactor : replace iteration with consumed_samples

2026-06-30 18:42:42 +08:00

test_dataset.py

refactor: move sample-id indexing from dataset to store

2026-07-19 16:02:50 +08:00

test_preprocess_builder.py

fix: rewrite GRPO data pipeline for offline record-level access