arXiv:2512.11485cs.CL2025-12ACL被引 3

让智能体从错误中学习,自动提炼通用纠错指南。

Mistake Notebook Learning: Batch-Clustered Failures for Training-Free Agent Adaptation

论文配图:Mistake Notebook Learning: Batch-Clustered Failures for Training-Free Agent Adaptation
图 1 · 摘自论文原文
  • 将失败案例聚类成批次,提取共性错误模式
  • 仅当批量性能提升时才更新记忆,保证稳定
  • 适合需持续改进但无法重训练的智能体

随着大语言模型代理在持久性真实任务中的广泛应用,它们不断面临新任务与不可避免的失败。现有方法多仅存储原始实例或依赖成功轨迹,难以系统性地从错误中学习。本文提出「错误笔记学习」(MNL),一种无需训练的记忆框架,通过批处理聚类失败案例,自动生成可泛化的错误指导。该机制将共享错误模式抽象为结构化“错误笔记”,仅在批量性能提升时更新外部记忆,确保稳定性。为进一步增强适应性,MNL与测试时扩展结合,利用聚合错误模式主动引导搜索避开已知陷阱。在数学推理、Text-to-SQL及交互式代理基准上,MNL在效率与效果上均达到领先水平,证明结构化错误抽象是实现无参数更新持续优化的关键。代码已开源。

原文摘要 · Abstract (English)

With the growing adoption of Large Language Model (LLM) agents in persistent, real-world roles, they naturally encounter continuous streams of tasks and inevitable failures. A key limitation, however, is their inability to systematically learn from these mistakes, forcing them to repeat identical errors in similar contexts. Unlike prior training-free methods that primarily store raw instance-level experience or focus on retrieving successful trajectories, we propose Mistake Notebook Learning (MNL), a novel memory framework that enables agents to self-curate generalizable guidance from batch-clustered failures. This mechanism allows agents to distill shared error patterns into structured "mistake notes," updating an external memory only when batch performance improves to ensure stability. To further amplify adaptability, we integrate MNL with test-time scaling, leveraging aggregated failure patterns to actively steer the search process away from known pitfalls. Experiments on mathematical reasoning, Text-to-SQL, and interactive agent benchmarks show that MNL achieves competitive performance compared to existing memory mechanisms and in-context methods in both effectiveness and efficiency. These findings position structured mistake abstraction as a critical lever for robust agent evolution, enabling continuous improvement without the cost of parameter updates. The code is available at https://github.com/Bairong-Xdynamics/MistakeNotebookLearning/tree/main.

智能体错误学习记忆机制零样本适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。