arXiv:2512.22416cs.CLcs.IR2025-12被引 2

提出轻量级框架HHEM,高效检测大模型幻觉

Hallucination Detection and Evaluation of Large Language Model

  • 用分类模型独立判断,避免依赖大模型验证
  • 评估时间从8小时缩至10分钟,准确率82.2%
  • 适合需快速质检的LLM应用开发团队

大语言模型的幻觉问题严重影响内容可信度。现有评估方法如KnowHalu需多阶段验证,计算成本高。本文引入轻量级分类框架HHEM,独立于LLM判断,显著提升效率并保持高检测精度。在问答与摘要任务上,对比多种检测方法,评估了真阳性率(TPR)、真阴性率(TNR)和准确率。结果表明,HHEM将评估时间从8小时降至10分钟,结合非捏造检查时达到最高准确率82.2%、TPR 78.9%。但对摘要中的局部幻觉检测效果不佳。为此,提出基于片段的检索策略,通过验证小段文本提升检测能力。累积分布函数分析显示,7B-9B参数规模的模型整体幻觉较少,中等规模模型更不稳定。研究强调需构建兼顾效率与事实验证的结构化评估体系,以增强生成内容可靠性。

原文摘要 · Abstract (English)

Hallucinations in Large Language Models (LLMs) pose a significant challenge, generating misleading or unverifiable content that undermines trust and reliability. Existing evaluation methods, such as KnowHalu, employ multi-stage verification but suffer from high computational costs. To address this, we integrate the Hughes Hallucination Evaluation Model (HHEM), a lightweight classification-based framework that operates independently of LLM-based judgments, significantly improving efficiency while maintaining high detection accuracy. We conduct a comparative analysis of hallucination detection methods across various LLMs, evaluating True Positive Rate (TPR), True Negative Rate (TNR), and Accuracy on question-answering (QA) and summarization tasks. Our results show that HHEM reduces evaluation time from 8 hours to 10 minutes, while HHEM with non-fabrication checking achieves the highest accuracy \(82.2\%\) and TPR \(78.9\%\). However, HHEM struggles with localized hallucinations in summarization tasks. To address this, we introduce segment-based retrieval, improving detection by verifying smaller text components. Additionally, our cumulative distribution function (CDF) analysis indicates that larger models (7B-9B parameters) generally exhibit fewer hallucinations, while intermediate-sized models show higher instability. These findings highlight the need for structured evaluation frameworks that balance computational efficiency with robust factual validation, enhancing the reliability of LLM-generated content.

幻觉检测大模型评估轻量化框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。