让冻结语言模型一次前向传播即可答对或放弃,避免胡说八道。
You Only Pass Once: Answering and Abstaining Together in a Single Forward Pass of a Frozen Language Model
- 用小网络重建被干扰的中间表示,实现答案与弃权同步生成。
- 1.5B模型在alphaNLI上准确率从37.5%提升至79.8%,超越双次推理。
- 无需标注即可跨域保持性能,适合高可靠性推理场景。
冻结语言模型在推理任务中存在双重缺陷:未能充分利用自身残差流已编码的信息,且无法识别输入不足时仍强行回答。本文将两种基于同一残差流的方法整合:条件性引导探针可恢复冻结主干的推理能力,零样本充分性方向则能检测信息不足并选择弃权。二者若在同一前向传播中使用会相互干扰,导致小模型跨域迁移性能下降最高达8 AUROC点;而单独处理需两次前传,成本翻倍。为此,我们固定充分性方向,训练一个小型网络从受扰状态重建原始干净状态(仅用均方误差损失,无需弃权标签),并在重建结果上读取充分性方向。由此构建的YOPO系统,在单次前向传播中完成回答、引导与弃权。以冻结的Qwen2.5(1.5B/3B/7B)为骨干,端到端三元准确率超过基线两倍以上(1.5B模型在alphaNLI上从0.375升至0.798),且在所有规模下均优于双次推理方案(0.798/0.830/0.893 vs 0.753/0.790/0.863),覆盖六个模型家族共十个主干。我们绘制了容量-迁移前沿,强调弃权不应被显式训练;源端审计发现alphaNLI构造中泄露表面特征,因此架构结论基于原生标签复现(SQuAD2, RepLiQA, MuSiQue);在标准四领域基准上,首次提出答案或弃权评测体系,本系统门控机制在各域内表现最优,且唯一无监督方向能在跨域迁移中保持有效。
原文摘要 · Abstract (English)
A frozen language model on reasoning tasks has two coupled weaknesses: it under-uses evidence its own residual stream already encodes, and it fails to detect when the input is insufficient to answer, so it confabulates. This paper consolidates two research lines that address these on the same residual stream: a conditional steering probe writes the stream at mid-stack layers and recovers reasoning accuracy from a frozen backbone, and a zero-shot sufficiency direction reads the stream and abstains when information is insufficient. Deployed in one forward pass they interfere: the steering write shifts the state the direction reads, costing up to 8 AUROC points of cross-domain transfer on small models; a separate clean pass doubles inference cost. We keep the direction fixed and train a small network to reconstruct the pre-steering residual from the steered one -- mean-squared error on (steered, clean) pairs, no sufficiency labels -- and read the direction on the reconstruction. The resulting system, YOPO (You Only Pass Once), answers, steers, and abstains in one forward pass of a frozen Qwen2.5 backbone (1.5B/3B/7B). End to end, three-way accuracy more than doubles the frozen baseline (0.375->0.798 on 1.5B alphaNLI) and one pass beats the two-pass reference at every scale (0.798/0.830/0.893 vs 0.753/0.790/0.863) and on ten backbones across six model families. We chart the capacity-transfer frontier quantifying the principle that abstention should not be trained in; a source-side audit catches our own alphaNLI construction leaking a surface artifact, so architectural claims are anchored on native-label replications (SQuAD2, RepLiQA, MuSiQue); and on the standard four-domain suite we contribute, to our knowledge, the first answer-or-abstain benchmark, where our gate tops every in-domain dataset and the label-free direction is the only gate family to survive domain transfer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。