arXiv:2606.21777cs.CLcs.AI2026-06

给大模型代理加个靠谱的自我评估系统,让它知道啥时候该查、啥时候别瞎查。

CalVerT: Augmenting Agents with Calibrated Verifier Telemetry Improves Action and Learning in Knowledge-Intensive Tasks

论文配图:CalVerT: Augmenting Agents with Calibrated Verifier Telemetry Improves Action and Learning in Knowledge-Intensive Tasks
图 1 · 摘自论文原文
  • 用自校准信心分和证据验证分,让代理看清自己是否真懂
  • 在4个问答数据集上提升F1,减少无效检索浪费算力
  • 不需重训练就能增强现有框架,也能让训练后模型更优

在知识密集型问答任务中,大模型代理因无法判断当前答案是否不确定、缺乏依据或已完整,导致两种错误:盲目自信输出无据答案(降低准确率)和在已有足够信息时仍过度检索(浪费计算资源)。为此,本文提出校准验证器遥测(CalVerT),通过向代理状态注入校准后的自信心评分和证据验证评分,使其更全面地感知自身状态。实验表明,CalVerT在无需训练和需训练的场景下均有效:在4个问答基准测试中,它能识别出代理过度依赖参数化知识的情况并触发检索,同时在已有足够上下文时减少冗余检索。此外,即使不进行额外训练,也可无缝集成到现有问答框架中;在强化学习训练后,使用CalVerT的代理相比相同训练但无遥测的版本表现更优。

原文摘要 · Abstract (English)

LLM agents in knowledge intensive question answering take retrieval and reasoning actions with incomplete knowledge about whether their current answer is uncertain, unsupported, or already complete. This produces two failure modes: committing to confident but unsupported answers, which hurts accuracy, and over-retrieving when the evidence in hand already suffices, resulting in wasted compute. To give agents a more complete picture of the state space they are operating in, we introduce calibrated verifier telemetry (CalVerT), which augments the agent's state with additional telemetry: a calibrated self-confidence score and a grounding verifier score. We show that CalVerT can improve agents in both training-free and training-based settings. On four QA benchmarks, we find that CalVerT raises F1 by triggering retrieval in cases where agents over-rely on parametric knowledge, while cutting redundant retrieval in cases where agents have sufficient context to answer. We show that CalVerT can augment existing QA frameworks without training. Moreover, CalVerT also improves trained systems: by simply augmenting an agent's state with telemetry, we observe improvements after reinforcement learning, as compared to an agent with identical training but no CalVerT telemetry.

大模型代理自我评估问答系统推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。