arXiv:2602.06022cs.LGcs.AI2026-02被引 2

用内部激活信号优化推理时纠错,提升大模型准确率与校准性。

Correctness-Optimized Residual Activation Lens (CORAL): Transferrable and Calibration-Aware Inference-Time Steering

  • 通过正则化MLP探针捕捉模型内部分布式正确性信号
  • 平均提升准确率10%,预期校准误差降低50%
  • 无需重训即可跨数据集迁移,适合需可靠推理的场景

大语言模型在指令微调和偏好对齐后普遍存在校准偏差。虽可通过修改训练目标改善,但重训成本高。推理时调控提供轻量替代方案,但多数方法优化的是正确性的代理指标而非正确性本身。本文提出CORAL(Correctness-Optimized Residual Activation Lens),一种基于权重衰减MLP探针的正则化推理时调控方法,从模型内部激活中提取分布式正确性信号。我们在三个70亿参数模型上评估,结果表明其平均提升准确率10%、预期校准误差(ECE)50%。进一步验证显示,这些改进无需重训即可迁移到四个未见基准测试集(ARC-Challenge、HellaSwag、Math-MC、OpenBookQA),平均准确率提升14%,ECE降低49%。结果支持了在个体神经元不足时,可通过正则化探针提取模型内部分布式信息的假设。CORAL因此提供了一种计算高效、可迁移且关注校准性的推理时改进方案,适用于多项选择题问答任务。

原文摘要 · Abstract (English)

Large language models (LLMs) exhibit persistent miscalibration, especially after instruction tuning and preference alignment. Modified training objectives can improve calibration, but retraining is expensive. Inference-time steering offers a lightweight alternative, yet most existing methods optimize proxies for correctness rather than correctness itself. We introduce CORAL (Correctness-Optimized Residual Activation Lens), a regularized inference-time steering method that captures distributed correctness signals from model internal activations using weight-decay MLP probes. We evaluate CORAL across three 7B-parameter models and find that it consistently improves accuracy by 10\% and expected calibration error (ECE) by 50\% on average. We additionally demonstrate that these gains transfer without retraining to the complete published test sets of four held-out benchmarks (ARC-Challenge, HellaSwag, Math-MC, OpenBookQA), averaging 14\% accuracy improvements and 49\% ECE improvements. Our results support the hypothesis that distributed information in model internals can be extracted using regularized probes when individual neurons are insufficient. CORAL thus provides a compute-efficient, transferable, and calibration-aware approach to improve MCQA performance during inference.

大模型推理校准优化激活探针MCQA

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。