通过神经多样性降低大模型幻觉,不增参数也能更可靠。
Neural Diversity Regularizes Hallucinations in Language Models
- 用并行分支+去相关正则,让模型内部表示更多样化。
- 幻觉率最高降25.6%,平均降14.6%,且不损失准确率。
- 发现不同任务需不同多样程度,为模型可靠性提供新维度。
尽管参数、算力和数据持续增长,语言模型仍频繁产生幻觉。本文提出神经多样性——即去相关的并行表征——作为在固定参数与数据预算下降低幻觉率的原理性机制。不同于现有侧重准确率的方法,我们首次为集成语言模型的幻觉概率提供了形式化尾部界,将其重构为二阶矩可靠性问题,并解释了跨并行配置中94.3%的实证可靠性差异。引入ND-LoRA(神经多样性低秩适配),结合并行LoRA适配器与Barlow Twins正则,在保持通用准确性的同时,使幻觉率最高降低25.6%(平均降低14.6%)。消融实验表明,LoRA适配器与正则化协同作用;因果干预证实神经多样性是中介因子;相关研究显示,神经相关性每上升0.1%,幻觉率增加3.8%。最终,任务依赖的最优多样性出现:不同任务需要不同水平的神经多样性。整体结果表明,神经多样性是独立于参数与数据的第三维缩放轴,可在固定预算下提升语言模型的可靠性。
原文摘要 · Abstract (English)
Language models continue to hallucinate despite increases in parameters, compute, and data. We propose neural diversity -- decorrelated parallel representations -- as a principled mechanism that reduces hallucination rates at fixed parameter and data budgets. While existing mitigation strategies largely target accuracy, we provide the first formal tail bounds for hallucination probability in ensembled language models, reframing it as a second-moment reliability problem and explaining 94.3% of empirical reliability variation seen across parallel configurations. We introduce ND-LoRA (Neural Diversity Low-Rank Adaptation), combining parallel LoRA adapters with Barlow Twins regularization, and reduce hallucinations by up to 25.6% (and 14.6% on average) while preserving general accuracy. Ablations show LoRA adapters and regularization act synergistically, causal interventions prove neurodiversity as the mediating factor and correlational studies indicate scale: a 0.1% neural correlation increase is associated with a 3.8% hallucination increase. Finally, task-dependent optimality emerges: different tasks require different optimal amounts of neurodiversity. Together, our results highlight neural diversity as a third axis of scaling -- orthogonal to parameters and data -- to improve the reliability of language models at fixed budgets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。