让大模型自动修复任务逻辑错误,且保证修改安全可追溯。
ANNEAL: Adapting LLM Agents via Governed Symbolic Patch Learning

- 通过失败驱动机制定位错误操作符,生成带类型约束的修复补丁。
- 在4个领域27次实验中,将重复故障率从72%降至0%,优于主流方法。
- 修复过程全程可溯源、可回滚,适合对安全性要求高的实际部署。
基于大模型的智能体虽能应对单次执行错误,但在同一逻辑缺陷上反复失败,因底层过程知识(如操作符模式、前置条件与约束)未被修复。现有自演化方法多通过调整提示、记忆或模型权重来改进,但均未直接修复编码执行逻辑的符号结构,且缺乏安全治理保障。本文提出ANNEAL,一种神经符号智能体,将重复失败转化为对过程知识图谱的受控符号修补,不修改基础模型权重。其核心机制失败驱动知识获取(FDKA)能定位问题操作符,通过约束式大模型生成带类型的修补方案,并经多维评分、符号防护和探针测试验证后才提交。所有已接受的修改均保留完整溯源信息并支持确定性回滚。在四个领域、27组多种子运行中,唯一实现持久性结构性修复:强基线如ReAct和Reflexion虽具高回合恢复能力,但对重复故障仍保留72%-100%的未解决率,而ANNEAL将其降至0%。消融实验表明,移除FDKA将导致所有结构性修复失效,成功率下降最高达26.7个百分点。结果表明,受控符号修复为持久故障消除提供了一种与权重级和提示级适应互补的新范式。
原文摘要 · Abstract (English)
LLM-based agents can recover from individual execution errors, yet they repeatedly fail on the same fault when the underlying process knowledge--operator schemas, preconditions, and constraints--remains unrepaired. Existing self-evolving approaches address this gap by updating prompts, memory, or model weights, but none directly repair the symbolic structures that encode how tasks are executed, and few provide the governance guarantees required for safe deployment. We introduce ANNEAL, a neuro-symbolic agent that converts recurring failures into governed symbolic edits of a process knowledge graph without modifying foundation model weights. Its core mechanism, Failure-Driven Knowledge Acquisition (FDKA), localizes the responsible operator, synthesizes a typed patch through constrained LLM generation, and validates the proposal via multi-dimensional scoring, symbolic guardrails, and canary testing before commit. Every accepted edit carries full provenance and deterministic rollback capability. Across four domains and 27 multi-seed runs, ANNEAL is the only evaluated system that commits persistent structural repairs--strong baselines such as ReAct and Reflexion achieve high episodic recovery yet retain 72--100% holdout failure rates on recurring faults, whereas ANNEAL reduces these to 0% in the tested recurring-failure settings. Ablation confirms that removing FDKA eliminates all structural repairs and drops success rate by up to 26.7 percentage points. These results suggest that governed symbolic repair offers a complementary paradigm to weight-level and prompt-level adaptation for persistent fault elimination.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。