arXiv:2605.22905cs.AIcs.CL2026-05被引 1

让AI自动生成可验证证据的自我进化搜索系统。

EVE-Agent: Evidence-Verifiable Self-Evolving Agents

论文配图:EVE-Agent: Evidence-Verifiable Self-Evolving Agents
图 1 · 摘自论文原文
  • 生成问题、答案和可追溯的证据片段,确保每步推理有据可查。
  • 通过证据增益评分机制,显著提升答案正确率,比之前方法高12.3%。
  • 无需人工标注,训练过程透明可审计,适合可信AI研发场景。

自进化智能体不应在无法证明其依据的数据上训练。无数据自进化搜索代理提供了一条可扩展路径,使系统能自主生成问题、解答并从自身反馈中改进,而无需人工标注。然而,若缺乏可验证的证据,该循环可能奖励流畅但无支撑的输出,导致自生成课程成为不可靠的训练信号。我们主张,证据可验证性是可信自进化前提:每个生成实例应包含答案及来源明确的证据片段,且其对答案的贡献可量化。为此提出EVE-Agent,通过修改提议-求解框架实现该原则:提议者生成问题、答案和原始证据段;证据验证器根据加入证据后准确率的边际提升进行奖励。此机制不依赖模型答案、人工标签或外部注释,仅凭证据增益驱动学习。实验表明,EVE-Agent在基于证据的正确性上显著优于现有自进化搜索代理。生成的课程不仅自生成,且结构上可审计:每个训练样本均携带可检查的来源片段,说明其可信理由。

原文摘要 · Abstract (English)

Self-evolving agents should not train on examples they cannot justify. Data-free self-evolving search agents offer a scalable route to systems that generate their own questions, answer them, and improve from their own feedback without human annotations. Yet, without verifiable evidence, this loop can reward fluent but unsupported examples, turning the self-generated curriculum into an opaque and potentially unreliable training signal. We argue that evidence verifiability is a prerequisite for trustworthy self-evolution in search agents: each generated instance should include not only an answer but also a source-grounded span whose contribution to that answer can be measured. We introduce EVE-Agent, an Evidence-Verifiable Self-Evolving Agent that operationalizes this principle through a modification to the proposer--solver framework. The proposer generates a question, an answer, and a verbatim evidence span. An evidence verifier then rewards the span according to the marginal accuracy gain when the evidence is provided. This produces a training signal that favors evidence that genuinely helps answer the question, without requiring oracle answers, human labels, or external annotations. EVE-Agent leaves the backbone model, retriever, search tool, and optimization framework unchanged. Experiments show that EVE-Agent substantially improves evidence-grounded correctness over prior self-evolving search agents. The resulting curriculum is not merely self-generated but auditable by construction: each training example carries an inspectable source span that explains why it should be trusted.

自进化可验证搜索代理AI可信

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。