用能量模型检测大模型结构化输出中的不确定性和违规,提升推理可靠性。
Distributional Energy-Based Models for Uncertainty-Aware Structured LLM Reasoning

- 分步能量函数结合评分器与约束惩罚,实现结构化输出验证。
- 在5个基准上优于单次生成的Qwen-72B,约束违规减少53%。
- 可量化不确定性,驱动重生成或放弃,适合高可靠场景使用。
当大语言模型生成旅行计划、代码或多步证明等结构化输出时,单个步骤可能正确,但整体可能违反预算、测试失败或自相矛盾。本文提出一种分解式能量函数,将学习的品质评分器与确定性分析约束惩罚结合,用于验证结构化输出。评分器是基于单一冻结编码器的低秩适配器异质集成(仅3%参数可训练);集成均值用于候选排序,标准差量化认知不确定性,驱动双轮推理循环,触发针对性重生成或弃权。在五个基准(GSM8K、MuSR、TravelPlanner、TACO、Knights & Knaves)上,149M参数的验证器协调7-260亿参数的开源生成器,优于单次生成的Qwen-72B,MuSR上达到67.7%(接近Claude Sonnet 4.6的68.0%),TravelPlanner上约束违规率相对降低53%(最优0.028,随机0.231)。两种路径互补:结构验证在约束可检时占优(捕获模型无法自检的信号),预训练先验在不可检时更优(如叙事推理、代码语义)。跨数据集混淆分析确认了对四类任务的真实质量区分,并发现代码中的模型身份捷径,通过最后一层重训缓解。在困难数据上训练的评分器可零样本迁移:穆斯尔训练的评分器在无数学题经验下于GSM8K达93.9%。
原文摘要 · Abstract (English)
When Large Language Models produce structured outputs such as travel plans, code solutions, or multi-step proofs, individual reasoning steps may appear correct while the output as a whole violates budgets, fails test cases, or contradicts earlier deductions. We propose a decomposed energy function that combines a learned quality scorer with deterministic analytical constraint penalties for verifying structured LLM outputs. The quality scorer is a heterogeneous ensemble of low-rank adapters on a single frozen encoder (3% trainable parameters); the ensemble mean ranks candidates while the standard deviation quantifies epistemic uncertainty, driving a two-pass inference loop that triggers targeted regeneration or abstention. Across five benchmarks (GSM8K, MuSR, TravelPlanner, TACO, Knights & Knaves), our 149M-parameter verifier orchestrating a pool of 7-26B open generators outperforms single-shot Qwen-72B on every benchmark, matches Claude Sonnet 4.6 on MuSR (67.7% vs. 68.0%), and reduces constraint violations by 53% relative to Opus 4.6 on TravelPlanner (oracle 0.028, random 0.231). The two routes are complementary: structural verification wins when constraints are checkable (the verifier captures signal frontier models cannot self-detect), while pretraining-scale priors win where they are not (narrative inference, code semantics). A cross-dataset confounding analysis confirms genuine quality discrimination on four reasoning tasks and identifies a model-identity shortcut on code, mitigated via last-layer retraining. Scorers trained on difficult data transfer zero-shot: a MuSR-trained scorer achieves 93.9% on GSM8K without seeing a math problem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。