arXiv:2509.06902cs.CLcs.CR2025-09

让大模型的数字答案必须带证明,否则就不显示。

Proof-Carrying Numbers (PCN): A Protocol for Trustworthy Numeric Answers from LLMs via Claim Verification

  • 数字以带验证的标记形式输出,由渲染层检查
  • 未通过验证的数字默认标为不可信,防止造假
  • 适用于需要精确数值的科研、金融等场景

大型语言模型作为随机系统,可能生成与数据不符的数值,这种现象称为‘数值幻觉’。现有防护手段如检索增强生成、引用和不确定性估计虽提升透明度,但无法保证数值真实性:伪造或错误引用的数值仍可能被当作正确展示。我们提出‘可携带证明的数字(PCN)’,一种在呈现层强制数值可信性的协议。在PCN中,数值以绑定结构化声明的‘声明绑定标记’形式输出,验证器依据预设策略(如精确相等、四舍五入、别名匹配或带限定条件的容差)逐项检查。关键在于,验证环节置于渲染层而非模型内部:仅经验证的数值才标记为可信,其余默认为未验证。该设计防止欺骗,确保失败闭合行为。我们形式化了PCN,并证明其在诚实标记下的正确性、完备性、失败闭合性及策略细化下的单调性。PCN轻量且模型无关,可无缝集成至现有应用,并支持加密承诺扩展。通过将验证设为显示前的必经步骤,PCN建立了一个简单契约:数值可信需凭证明,无标记即表示不确定。

原文摘要 · Abstract (English)

Large Language Models (LLMs) as stochastic systems may generate numbers that deviate from available data, a failure known as \emph{numeric hallucination}. Existing safeguards -- retrieval-augmented generation, citations, and uncertainty estimation -- improve transparency but cannot guarantee fidelity: fabricated or misquoted values may still be displayed as if correct. We propose \textbf{Proof-Carrying Numbers (PCN)}, a presentation-layer protocol that enforces numeric fidelity through mechanical verification. Under PCN, numeric spans are emitted as \emph{claim-bound tokens} tied to structured claims, and a verifier checks each token under a declared policy (e.g., exact equality, rounding, aliases, or tolerance with qualifiers). Crucially, PCN places verification in the \emph{renderer}, not the model: only claim-checked numbers are marked as verified, and all others default to unverified. This separation prevents spoofing and guarantees fail-closed behavior. We formalize PCN and prove soundness, completeness under honest tokens, fail-closed behavior, and monotonicity under policy refinement. PCN is lightweight and model-agnostic, integrates seamlessly into existing applications, and can be extended with cryptographic commitments. By enforcing verification as a mandatory step before display, PCN establishes a simple contract for numerically sensitive settings: \emph{trust is earned only by proof}, while the absence of a mark communicates uncertainty.

大模型数值可信验证协议

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。