fix: 修复长对话截断方向错误，保留最新 token 而非最早

- add_task 中 prompt 超长时改为保留末尾 token（prompt_ids[-max_prompt_len:]）而非开头 token，确保多轮对话时模型能看到最近的提问上下文
2026-05-08 15:52:48 +08:00
parent a6f5ff3b37
commit c4401512f2
2 changed files with 2 additions and 2 deletions
@@ -148,7 +148,7 @@ class InferenceEngine:
        tokenizer: AutoTokenizer,
        max_batch_size: int = 1,
        max_seq_len: Optional[int] = None,
-        max_prompt_len: int = 512,
+        max_prompt_len: int = 2048,
        cache_capacity: int = 1000,
    ):
        """Initializes the engine and starts the scheduler background thread.