ViperEkura ee450686f3 fix: add option permutation to MMLU eval ...

- Few-shot examples now include subject preamble (consistent format)
- Add --seed flag for option permutation (default 0, -1 to disable)
- Shuffles A/B/C/D positions per-question to neutralise positional bias

2026-07-18 00:14:34 +08:00

..

analyze_weights.py

fix: eval script bugs and add missing features

2026-07-17 14:02:58 +08:00

evaluate_humaneval.py

refactor: switch eval datasets to HuggingFace source

2026-07-18 00:09:31 +08:00

evaluate_ifd.py

fix: eval script bugs and add missing features

2026-07-17 14:02:58 +08:00

evaluate_ifeval.py

refactor: switch eval datasets to HuggingFace source

2026-07-18 00:09:31 +08:00

evaluate_mmlu.py

fix: add option permutation to MMLU eval

2026-07-18 00:14:34 +08:00

evaluate_ppl.py

fix: eval script bugs and add missing features

2026-07-17 14:02:58 +08:00

evaluate_rouge.py

feat : add ROUGE evaluation script (manual impl, no deps)

2026-07-05 01:15:01 +08:00