arXiv:2504.11277cs.CL2025-04ACL被引 2

让大模型学会识别并修正误导性输入,提升回答准确性。

From Misleading Queries to Accurate Answers: A Three-Stage Fine-Tuning Method for LLMs

  • 分三阶段训练模型识别、纠正输入中的误导信息
  • 在含误导信息的查询下,回答准确率显著提升
  • 适合关注幻觉减少与输入鲁棒性的研究者

大语言模型在自然语言处理中表现优异,但对输入查询质量极为敏感,尤其当查询包含误导或错误信息时。现有方法多聚焦于修正输出,却忽视了提升模型检测和修正输入误导内容的能力。本文提出一种新颖的三阶段微调方法:第一阶段训练模型识别误导信息;第二阶段利用内置或外部知识修正误导内容;第三阶段基于修正后的查询生成准确答案。我们在三个幻觉检测与问答任务数据集,以及两个自建的含误导信息数据集上进行实验。结果表明,该方法显著提升了响应的准确性和事实性,增强了幻觉检测能力,并有效减少了输出中的幻觉,尤其在输入存在误导信息时效果明显。

原文摘要 · Abstract (English)

Large language models (LLMs) exhibit excellent performance in natural language processing (NLP), but remain highly sensitive to the quality of input queries, especially when these queries contain misleading or inaccurate information. Existing methods focus on correcting the output, but they often overlook the potential of improving the ability of LLMs to detect and correct misleading content in the input itself. In this paper, we propose a novel three-stage fine-tuning method that enhances the ability of LLMs to detect and correct misleading information in the input, further improving response accuracy and reducing hallucinations. Specifically, the three stages include (1) training LLMs to identify misleading information, (2) training LLMs to correct the misleading information using built-in or external knowledge, and (3) training LLMs to generate accurate answers based on the corrected queries. To evaluate our method, we conducted experiments on three datasets for the hallucination detection task and the question answering~(QA) task, as well as two datasets containing misleading information that we constructed. The experimental results demonstrate that our method significantly improves the accuracy and factuality of LLM responses, while also enhancing the ability to detect hallucinations and reducing the generation of hallucinations in the output, particularly when the query contains misleading information.

大模型幻觉抑制输入纠错

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。