通过自适应噪声注入减少大模型幻觉,提升生成可靠性。
Noise Augmented Fine Tuning for Mitigating Hallucinations in Large Language Models
- 根据信噪比动态选择层并注入高斯噪声,增强鲁棒性。
- 在多个数据集上显著降低幻觉率,性能优于或匹配基线。
- 方法轻量高效,适合追求可信生成的模型部署场景。
大语言模型常产生不准确或误导性内容——即幻觉。为应对这一挑战,本文提出噪声增强微调(NoiseFiT),一种基于信噪比(SNR)自适应噪声注入的新框架,以增强模型鲁棒性。具体而言,NoiseFiT动态缩放高斯噪声,仅对高SNR(更稳健)或低SNR(可能欠正则化)层进行选择性扰动。同时设计混合损失函数,融合标准交叉熵、软交叉熵与一致性正则化,确保在噪声训练下输出稳定且准确。理论分析表明,该噪声注入策略无偏且方差保持,为期望收敛提供强保障。在多组测试与基准数据集上的实证结果表明,NoiseFiT显著降低幻觉率,关键任务表现常优于或等同于基线。研究证实,噪声驱动策略可在不增加显著计算开销的前提下实现更可靠、可信赖的语言建模。为促进研究复现,我们已将微调日志、评测结果及源代码分别公开于W&B、Hugging Face和GitHub。
原文摘要 · Abstract (English)
Large language models (LLMs) often produce inaccurate or misleading content-hallucinations. To address this challenge, we introduce Noise-Augmented Fine-Tuning (NoiseFiT), a novel framework that leverages adaptive noise injection based on the signal-to-noise ratio (SNR) to enhance model robustness. In particular, NoiseFiT selectively perturbs layers identified as either high-SNR (more robust) or low-SNR (potentially under-regularized) using a dynamically scaled Gaussian noise. We further propose a hybrid loss that combines standard cross-entropy, soft cross-entropy, and consistency regularization to ensure stable and accurate outputs under noisy training conditions. Our theoretical analysis shows that adaptive noise injection is both unbiased and variance-preserving, providing strong guarantees for convergence in expectation. Empirical results on multiple test and benchmark datasets demonstrate that NoiseFiT significantly reduces hallucination rates, often improving or matching baseline performance in key tasks. These findings highlight the promise of noise-driven strategies for achieving robust, trustworthy language modeling without incurring prohibitive computational overhead. Given the comprehensive and detailed nature of our experiments, we have publicly released the fine-tuning logs, benchmark evaluation artifacts, and source code online at W&B, Hugging Face, and GitHub, respectively, to foster further research, accessibility and reproducibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。