AstrAI/scripts/eval
ViperEkura 17d6eaa2f2 refactor: rewrite humaneval evaluation with functional pipeline design
- fix KeyError race condition in inference cache touch()
- EvalConfig dataclass for centralized configuration
- load->generate->extract->test->score->report pipeline
- two-phase generation+testing for max GPU utilization
- signal-based SIGALRM timeout protection for code exec
- suppress subprocess stdout/stderr pollution
2026-07-05 07:58:28 +08:00
..
analyze_weights.py feat: SVD 有效秩/权重统计分析脚本 2026-06-29 21:39:22 +08:00
evaluate_humaneval.py refactor: rewrite humaneval evaluation with functional pipeline design 2026-07-05 07:58:28 +08:00
evaluate_ifd.py perf: add BFD bin-packing and custom attention mask to IFD batch scoring 2026-07-04 18:58:13 +08:00
evaluate_ifeval.py refactor : metric_logger 改用事件类型 (type=step/validation/epoch) 2026-06-25 17:18:20 +08:00
evaluate_mmlu.py feat: 新增 IFEval 指令遵循评测 2026-06-16 21:57:34 +08:00
evaluate_ppl.py fix: 规范 generate.py 命令行接口 2026-06-19 14:03:02 +08:00
evaluate_rouge.py feat : add ROUGE evaluation script (manual impl, no deps) 2026-07-05 01:15:01 +08:00