arXiv:2602.17022cs.CLcs.AI2026-02被引 1

让对话模型在出错后自动诊断并修复,无需改代码或提示词。

ReIn: Conversational Error Recovery with Reasoning Inception

  • 通过外部模块识别错误并生成修复方案,注入模型内部推理流程。
  • 在多种错误场景下任务成功率显著提升,且能应对未见过的错误类型。
  • 无需修改模型参数或提示词,适合实际部署中快速修复对话问题。

由大语言模型(LLMs)驱动并集成工具的对话代理在固定任务数据集上表现强劲,但在面对用户引发的意外错误时仍易失效。本文不聚焦于预防错误,而是关注错误恢复,需准确诊断错误对话上下文并执行恰当修复策略。在无法进行模型微调或提示修改(因成本与时间过高)的实际约束下,研究代理能否在不改变参数和提示的前提下实现上下文错误的自我修复。为此,提出测试时干预方法 Reasoning Inception (ReIn):外部的启始模块识别对话中的预定义错误并生成修复计划,随后将其融入代理的内部推理过程,引导纠正行为,无需修改模型参数或系统提示。在模拟用户请求模糊或无依据等直接阻碍目标完成的故障场景下评估发现,无论搭配何种代理模型与启始模块,ReIn均显著提升任务成功率,并泛化至未见错误类型。其表现持续优于显式提示修改方法,证明其作为高效、实时修复手段的潜力。深入分析显示,联合定义修复工具与 ReIn 可构成一种安全有效的策略,增强对话代理韧性而不改动主干模型或系统提示。

原文摘要 · Abstract (English)

Conversational agents powered by large language models (LLMs) with tool integration achieve strong performance on fixed task-oriented dialogue datasets but remain vulnerable to unanticipated, user-induced errors. Rather than focusing on error prevention, this work focuses on error recovery, which necessitates the accurate diagnosis of erroneous dialogue contexts and execution of proper recovery plans. Under realistic constraints precluding model fine-tuning or prompt modification due to significant cost and time requirements, we explore whether agents can recover from contextually flawed interactions and how their behavior can be adapted without altering model parameters and prompts. To this end, we propose Reasoning Inception (ReIn), a test-time intervention method that plants an initial reasoning into the agent's decision-making process. Specifically, an external inception module identifies predefined errors within the dialogue context and generates recovery plans, which are subsequently integrated into the agent's internal reasoning process to guide corrective actions, without modifying its parameters or system prompts. We evaluate ReIn by systematically simulating conversational failure scenarios that directly hinder successful completion of user goals: user's ambiguous and unsupported requests. Across diverse combinations of agent models and inception modules, ReIn substantially improves task success and generalizes to unseen error types. Moreover, it consistently outperforms explicit prompt-modification approaches, underscoring its utility as an efficient, on-the-fly method. In-depth analysis of its operational mechanism, particularly in relation to instruction hierarchy, indicates that jointly defining recovery tools with ReIn can serve as a safe and effective strategy for improving the resilience of conversational agents without modifying the backbone models or system prompts.

对话系统错误恢复LLM测试时干预

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。