ViperEkura 599a51f4f7 fix: reliable test timeout, separate generate/test phases, dynamic pass@k ... - Replace SIGALRM+exec() with subprocess.run(timeout=) for test execution - Add --test_only flag to skip generation and test existing completions - Add --generate_only flag for generation-only runs - Derive pass@k values from num_samples (filter k > n) - Support loading completions from array JSON (not just JSONL)		2026-07-05 08:47:30 +08:00
..
analyze_weights.py	feat: SVD 有效秩/权重统计分析脚本	2026-06-29 21:39:22 +08:00
evaluate_humaneval.py	fix: reliable test timeout, separate generate/test phases, dynamic pass@k	2026-07-05 08:47:30 +08:00
evaluate_ifd.py	perf: add BFD bin-packing and custom attention mask to IFD batch scoring	2026-07-04 18:58:13 +08:00
evaluate_ifeval.py	refactor : metric_logger 改用事件类型 (type=step/validation/epoch)	2026-06-25 17:18:20 +08:00
evaluate_mmlu.py	feat: 新增 IFEval 指令遵循评测	2026-06-16 21:57:34 +08:00
evaluate_ppl.py	fix: 规范 generate.py 命令行接口	2026-06-19 14:03:02 +08:00
evaluate_rouge.py	feat : add ROUGE evaluation script (manual impl, no deps)	2026-07-05 01:15:01 +08:00