让智能体执行指令前必须满足条件,避免因信息缺失出错。
COCORELI: Enforcing Execution Preconditions for Reliable Collaborative Instruction Following
- 检测缺失信息后直接阻止执行,实现检测与动作的强制绑定。
- 在构造任务中零幻觉行为,执行成功率提升至100%(未完成项被拦截)。
- 适用于需要可靠协作的复杂任务,尤其适合工具调用类场景。
自主智能体在执行人类指令时,即使指令不完整也需保持可靠。现有方法虽能检测信息缺失,但常在识别后仍继续执行,导致错误或危险行为。我们发现其根源在于检测与执行之间缺乏耦合,提出可靠行为需将缺失信息作为行动前提。为此设计Cocoreli:一个模块化架构,可表示任务结构、追踪缺失信息,并通过定向澄清阻断执行,直到必要细节被解决。在隔离不完整性和顺序执行的受控建造环境中验证,Cocoreli从结构上阻止未解决规范下的执行,完全消除幻觉行为。相比之下,思维链、提示链及ReAct式推理即便检测率高,仍可能在信息不足时执行。相同表示支持抽象复用,并泛化至ToolBench上的API工作流任务。结果表明,可靠协同执行依赖架构强制,而非仅靠模型能力。
原文摘要 · Abstract (English)
Autonomous agents executing human instructions must operate reliably even when instructions are incomplete. While recent approaches improve detection of missing information, detection alone is insufficient: agents often proceed to execution even after recognizing underspecification, leading to incorrect or unsafe actions. We identify this failure as arising from a lack of coupling between detection and execution, and propose that reliable behavior requires enforcing missing information as a precondition for action. We instantiate this principle in Cocoreli, a modular architecture that represents task structure, tracks missing information, and blocks execution until required details are resolved through targeted clarification. In Cocoreli, detection and prevention are structurally coupled: detecting a missing parameter simultaneously blocks execution. We evaluate Cocoreli in a controlled construction environment isolating underspecification and sequential execution. Cocoreli blocks execution under unresolved specifications by construction, eliminating hallucinated actions. In contrast, chain-of-thought, prompt-chaining, and ReAct-style reasoning may still execute under incomplete specifications despite high detection rates. The same representation supports abstraction and reuse, and generalizes to API workflow tasks on ToolBench. These results show that reliable collaborative execution requires architectural enforcement, not just model capability
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。