arXiv:2608.28439cs.CLcs.AI2026-08中稿 · EMNLP

仅靠结果准确度无法发现模型伪造数据,需追踪工具调用过程

Fidelity Is Not Enough: Dispatch-Level Instrumentation for Agentic Datasheet Extraction

论文配图:Fidelity Is Not Enough: Dispatch-Level Instrumentation for Agentic Datasheet Extraction
图 1 · 摘自论文原文
  • 通过记录每个工具调用,构建故障定位与隐蔽失败检测机制
  • 在37个声明中,检测器成功识别所有故意隐藏工具调用的故障
  • 适合关注模型可信性、可解释性的研发与评测人员

在评估内部提取服务模型时,发现一个模型虽通过了保真度检验,却从未打开数据表:结构化输出约束意外禁用了工具调用,模型仍自行生成虚构文本。唯有逐工具调用记录揭示了问题。当前标准保真度(提取值是否匹配源文本)仅关注结果,忽视行为过程。因此,在包含37个手选命题的25个三组件和12个四组件测试中,全面记录每项工具调用。基于此,构建两个分析工具:规则驱动的故障归因分类器,以及仅依赖工具调用与否的静默失败检测器。该检测器在三个模型族共207次保真度通过的运行中无误报,且100%捕获50个刻意隐瞒工具调用的故障。前者控制假阳性率,后者为构造性召回。对调用工具但仍出错的场景,检测能力未被测量。另一独立验证源——因果实验舱,仅能物理验证其中2个命题,其余35个不可实测,并给出不可测原因分类。在受控扰动下,保真度始终通过,而实验舱判断在测量不确定性处发生突变。在三套部署模型中,工具层提升可移植性与可观测性,而非准确性,仅当文档超出上下文窗口时才体现其价值。

原文摘要 · Abstract (English)

One model passed our fidelity check without ever opening the datasheet. We found it while qualifying models for an internal extraction service: a structured-output constraint had silently disabled tool use, and the model answered anyway, with fabricated source text. Only the per-tool trace exposed it. Fidelity -- whether an extracted value matches the source -- is the standard measure for agentic document extraction, and it scores that run a success. We therefore log every tool call in an agentic benchmark of 25 hand-curated claims over three components, with 12 more on a fourth, 37 in all. From that dispatch record we build two instruments: a rule-based failure-attribution classifier, and a silent-failure detector whose two rules check only which tools were called, never the extracted value. The detector raises no flag on 207 clean fidelity-passing extractions across three model families, and recovers all 50 planted faults that withhold exactly the tools its rules check. The two results are not symmetric: the first bounds the false-positive rate, the second is recall by construction, and detection power against runs that call their tools and still answer wrongly is unmeasured. A second, independent oracle, a causal chamber that tests whether the datasheet's claims hold under physical measurement, is intentionally partial: it confirms only what the apparatus can exercise, a verifiable envelope of 2 of those 37 claims, and we give a taxonomy of why the rest are not physically gradable. Under a controlled perturbation, fidelity passes throughout while the chamber verdict flips exactly at the measurement uncertainty. Across three deployed model stacks (one destabilised by its serving stack, not by any capability gap) the tool layer buys portability and observability rather than accuracy, and earns its premium only once a document outgrows the context window.

模型可信性工具调用保真度评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。