ViperEkura 599a51f4f7 fix: reliable test timeout, separate generate/test phases, dynamic pass@k ...

- Replace SIGALRM+exec() with subprocess.run(timeout=) for test execution
- Add --test_only flag to skip generation and test existing completions
- Add --generate_only flag for generation-only runs
- Derive pass@k values from num_samples (filter k > n)
- Support loading completions from array JSON (not just JSONL)

2026-07-05 08:47:30 +08:00

..

analyze_weights.py

feat: SVD 有效秩/权重统计分析脚本

2026-06-29 21:39:22 +08:00

evaluate_humaneval.py

fix: reliable test timeout, separate generate/test phases, dynamic pass@k

2026-07-05 08:47:30 +08:00

evaluate_ifd.py

perf: add BFD bin-packing and custom attention mask to IFD batch scoring

2026-07-04 18:58:13 +08:00

evaluate_ifeval.py

refactor : metric_logger 改用事件类型 (type=step/validation/epoch)

2026-06-25 17:18:20 +08:00

evaluate_mmlu.py

feat: 新增 IFEval 指令遵循评测

2026-06-16 21:57:34 +08:00

evaluate_ppl.py

fix: 规范 generate.py 命令行接口

2026-06-19 14:03:02 +08:00

evaluate_rouge.py

feat : add ROUGE evaluation script (manual impl, no deps)

2026-07-05 01:15:01 +08:00