用轻量软提示减少大模型幻觉,让回答更可信且不确定时会主动回避。
Towards Lightweight Reliability: Using Soft Prompts for Hallucination Mitigation in Large Language Models

- 用软提示配合对比损失和课程学习,训练模型抑制幻觉并学会不确定时沉默。
- 在5个数据集上测试,对Gemma 3(12B)和Llama 3.1(8B)均提升F分数。
- 仅需微调极少参数,适合部署在资源受限的高风险场景。
大语言模型(LLMs)虽广泛应用,但其幻觉问题——即看似合理却事实错误的输出——严重影响可靠性。为应对此挑战,我们提出一种参数高效的方法:负责任对比软提示(RCSP),通过复合损失函数训练软提示,在生成问答任务中平衡抑制幻觉、鼓励不确定时回避以及保持或提升事实召回率。方法融合对比损失、课程学习与KL正则化。在五个多样化生成式QA数据集上,使用LLM-as-a-Judge框架评估。实验表明,基于Gemma 3(12B)和Llama 3.1(8B)的模型,RCSP有效提升整体F-score,优于标准推理与指令提示基线。关键优势在于仅需极少量参数微调,即可实现显著可靠性提升,为提升大模型可信度提供模块化、低开销路径。
原文摘要 · Abstract (English)
Large language models (LLMs) have seen widespread adoption across various domains, yet their reliability is frequently undermined by hallucinations - responses that are plausible-sounding but factually incorrect. In high-stakes domains, these errors can reduce trust and introduce real-world risk. To address this challenge, we present a parameter-efficient approach that uses soft prompts to mitigate hallucinated content and promote responsible abstention in generative question-answering (QA) tasks. Our method, called Responsible Contrastive Soft Prompting (RCSP), uses a composite loss to train soft prompts that balance three goals: suppressing hallucinatory content, encouraging abstention under uncertainty, and preserving or improving factual recall. To achieve these goals, we incorporate contrastive loss, curriculum learning, and KL regularization into our training mechanism. We evaluate our approach on five diverse generative QA datasets using an LLM-as-a-Judge framework. Experimental results on the Gemma 3 (12B) and Llama 3.1 (8B) backbones demonstrate that RCSP effectively balances factual recall with hallucination suppression and abstention, yielding a generally superior F-score over standard reasoning and instruction-based prompting baselines. Notably, these improvements are achieved by training only a fraction of the parameters required by other tuning techniques. Our results demonstrate that soft prompts provide a modular and computationally efficient path toward improving LLM reliability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。