AstrAI/astrai/inference/core
ViperEkura d08a92c7bd feat: add frequency penalty to inference sampling pipeline
- Add FrequencyPenaltyStrategy (logit -= penalty * count)
- Per-task rep_window for penalty history lookup
- Wire through engine, task, executor, API layer
- Add --frequency_penalty and --rep_window to stream_chat.py
- 9 unit tests for frequency penalty strategy
2026-07-17 21:28:31 +08:00
..
__init__.py perf: replace paged KV cache with contiguous ContiguousCache, decode all groups 2026-07-05 11:34:36 +08:00
cache.py refactor: clean up inference design patterns 2026-07-05 11:41:54 +08:00
executor.py feat: add frequency penalty to inference sampling pipeline 2026-07-17 21:28:31 +08:00
scheduler.py refactor: clean up inference design patterns 2026-07-05 11:41:54 +08:00
task.py feat: add frequency penalty to inference sampling pipeline 2026-07-17 21:28:31 +08:00