ViperEkura a6e1f26cd4 refactor: simplify sample return_logprobs path ...

- SamplingPipeline.sample gains return_logprobs; both greedy and multinomial paths now share a single log_softmax+gather instead of duplicating the sampling logic
- module-level sample() becomes a thin forwarder instead of re-implementing the three-branch logic
- eliminates ~10 lines of duplicated softmax/gather code; no caller-facing API change

2026-07-20 13:16:18 +08:00

..

api

fix: memmap mode=r, tool parser json.loads, greedy decode

2026-07-19 16:38:28 +08:00

core

refactor: unify rollout onto inference engine KV-cache path

2026-07-20 12:52:20 +08:00

__init__.py

feat: add frequency penalty to inference sampling pipeline

2026-07-17 21:28:31 +08:00

engine.py

fix: memmap mode=r, tool parser json.loads, greedy decode

2026-07-19 16:38:28 +08:00

sample.py

refactor: simplify sample return_logprobs path

2026-07-20 13:16:18 +08:00