通过自演化解码提升大模型事实准确性,无需额外训练或知识库。
SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Models
- 对比模型不同层的输出概率,引导自我修正生成内容。
- 在多个模型(1B~45B)和任务上,事实准确率显著提升。
- 兼容现有解码方法,适合追求高可信度生成的场景。
大型语言模型虽具备强大能力,但输出常含不实信息。为此,我们提出自演化解码(SLED),一种无需外部知识库或微调即可提升模型真实性的新解码框架。从优化视角出发,SLED通过对比模型最终层与早期层的输出概率,利用近似梯度方法激活模型内部隐含知识,指导输出自我修正,有效提升事实准确性。我们在多种模型家族(Gemma、Qwen、Mixtral、gpt-oss)及规模(1B至45B)上进行了广泛实验,涵盖混合专家(MoE)等先进架构。评估覆盖多样化任务,结果表明SLED在保持自然语言流畅性与极低延迟开销的前提下,持续优于现有解码方法。此外,其可灵活与其它解码策略结合,进一步增强性能。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated remarkable capabilities, but their outputs can sometimes be unreliable or factually incorrect. To address this, we introduce Self Logits Evolution Decoding (SLED), a novel decoding framework that enhances the truthfulness of LLMs without relying on external knowledge bases or requiring further fine-tuning. From an optimization perspective, our SLED framework leverages the latent knowledge embedded within the LLM by contrasting the output logits from the final layer with those from early layers. It then utilizes an approximate gradient approach to enable latent knowledge to guide the self-refinement of outputs, thereby effectively improving factual accuracy. Extensive experiments have been conducted on established benchmarks across a diverse range of model families (Gemma, Qwen, Mixtral, gpt-oss) and scales (from 1B to 45B), including more advanced architectural configurations such as the mixture of experts (MoE). Our evaluation spans a wide variety of tasks and the results demonstrate that SLED consistently improves factual accuracy compared to existing decoding methods while maintaining natural language fluency and negligible latency overhead. Furthermore, it can be flexibly combined with other decoding methods to further enhance their performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。