arXiv:2502.11113cs.CL2025-02被引 3

给大模型的幻觉分类,发现部分虚构内容有实际价值。

Valuable Hallucinations: Realizable Non-realistic Propositions

  • 将幻觉分为可实现的非真实命题,提出可控生成方法
  • 使用ReAct提示使幻觉率降5.12%,有价值幻觉占比升至7.92%
  • 适合研究模型生成机制与创造性应用的读者

本文首次为大语言模型中的'有价值幻觉'提供正式定义,填补了现有文献空白。不同于以往将幻觉视为普遍缺陷,本文聚焦特定情境下某些幻觉可能带来的积极价值。所谓'有价值幻觉',是指那些当前不真实但可在特定条件下实现的非现实命题。我们通过人工判断和形式化表示,探索其潜在价值,并采用ReAct提示(包含推理、置信度评估与答案验证)对幻觉进行控制与优化。实验基于Qwen2.5模型与HalluQA数据集,结果显示,使用ReAct提示后,整体幻觉率下降5.12%,而有价值幻觉的比例从6.45%提升至7.92%。结果表明,系统性控制幻觉可在不损害事实可靠性的情况下增强其有用性。

原文摘要 · Abstract (English)

This paper introduces the first formal definition of valuable hallucinations in large language models (LLMs), addressing a gap in the existing literature. We provide a systematic definition and analysis of hallucination value, proposing methods for enhancing the value of hallucinations. In contrast to previous works, which often treat hallucinations as a broad flaw, we focus on the potential value that certain types of hallucinations can offer in specific contexts. Hallucinations in LLMs generally refer to the generation of unfaithful, fabricated, inconsistent, or nonsensical content. Rather than viewing all hallucinations negatively, this paper gives formal representations and manual judgments of "valuable hallucinations" and explores how realizable non-realistic propositions--ideas that are not currently true but could be achievable under certain conditions--can have constructive value. We present experiments using the Qwen2.5 model and HalluQA dataset, employing ReAct prompting (which involves reasoning, confidence assessment, and answer verification) to control and optimize hallucinations. Our findings show that ReAct prompting results in a 5.12\% reduction in overall hallucinations and an increase in the proportion of valuable hallucinations from 6.45\% to 7.92\%. These results demonstrate that systematically controlling hallucinations can improve their usefulness without compromising factual reliability.

大模型幻觉生成质量提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。