AstrAI

Files

T

ViperEkura 849e1e00a3 refactor: clean up inference design patterns

1. KVCache base: add default task_cached/task_record_hashes, remove getattr from scheduler
2. Remove page_size param from scheduler constructor (ContiguousCache-only)
3. InferenceEngine expose cache param for KVCache injection
4. Rename page_cache -> kv_cache in Executor
5. Move stream_callback from Task to TaskManager._callbacks dict
6. TaskManager.clear_queues clears callbacks

2026-07-05 11:41:54 +08:00

config

fix : SFT pipeline position_ids default & doc boundary preservation

2026-07-04 15:59:11 +08:00

dataset

feat: add JSONL dataset store with on-the-fly tokenization

2026-07-04 15:42:33 +08:00

inference

refactor: clean up inference design patterns

2026-07-05 11:41:54 +08:00

model

perf: replace paged KV cache with contiguous ContiguousCache, decode all groups