10 Commits

Include renames

Author	SHA1	Message	Date
ViperEkura	e13fe53475	refactor: assemble inference engines through a shared composition root ... - add build_engine() to astrai.inference.engine as the single load-place-wire path for InferenceEngine, accepting a checkpoint path or live model/tokenizer plus passthrough engine kwargs - migrate the server lifespan, generate CLI, humaneval/ifeval evals, and all three demos to build_engine; app._create_engine collapses into a direct call - export build_engine from astrai and astrai.inference - parameterize the autoregressive demo with --prompt one-shot continuation plus model path and sampling knobs, exiting cleanly on !exit or EOF - cover the composition root with unit tests for live-object assembly, kwargs passthrough, and argument validation	2026-09-03 22:16:56 +08:00
ViperEkura	28886e4241	fix: make system prompt optional across scripts ... - stream_chat: default empty system_prompt, single-turn mode - generate_batch: drop hardcoded system role - generate.py: preserve original fields in messages branch and use response_key for the output column name	2026-07-18 14:10:37 +08:00
ViperEkura	f0339022c1	fix: batch 推理示例添加 chat template 和 system prompt ... - 新增 prompts 列表，对每个输入应用 apply_chat_template - 添加 system message 到对话模板	2026-05-14 20:59:01 +08:00
ViperEkura	9b22b1651e	refactor: 优化工具脚本接口并修复批处理问题	2026-04-05 21:56:22 +08:00
ViperEkura	fc278d17ab	feat: 实现模型动态注册机制	2026-04-05 19:38:12 +08:00
ViperEkura	861d33b1a1	refactor: 更新inference 部分的实现	2026-04-04 23:49:18 +08:00
ViperEkura	0852b852f8	refactor: 优化参数传递，清理导入样式	2026-04-03 22:06:32 +08:00
ViperEkura	912d7c7f54	chore: 更新脚本并且修改gitignore	2026-04-02 15:40:31 +08:00
ViperEkura	9f1561afe7	reafactor: 修改ModelParameter	2026-03-31 16:00:55 +08:00
ViperEkura	4ead0a20cf	chore: 修改文件夹结构	2026-03-31 10:14:08 +08:00