用专业模型差异检测大模型幻觉,跨语言效果稳定。
Ask a Local: Detecting Hallucinations With Specialized Model Divergence
- 通过对比专业模型在文本上的困惑度差异定位幻觉段落。
- 14种语言测试中平均IoU达0.3,意大利语和加泰罗尼亚语超0.38。
- 无需微调即可多语言部署,适合跨语言内容审核场景。
大语言模型生成看似合理却事实错误的信息(即幻觉)是AI面临的重要挑战。本文提出「Ask a Local」,一种基于专业化模型对领域性错误产生更大惊讶的原理,通过计算语言专用模型间困惑度分布的差异来识别潜在幻觉段落。该方法特别适用于多语言场景,无需适配、训练或依赖内部数据,可自然扩展至多种语言。我们选用计算高效的模型,实现可扩展的多语言检测方案。在包含14种语言的人工标注问答数据集上,方法表现出稳定的跨语言性能,平均交并比(IoU)约0.3,斯皮尔曼相关性表现良好;其中意大利语和加泰罗尼亚语分别达到0.42和0.38的高IoU,且无需语言特化调整。代码与架构已开源,以促进多语言幻觉检测研究。
原文摘要 · Abstract (English)
Hallucinations in large language models (LLMs) - instances where models generate plausible but factually incorrect information - present a significant challenge for AI. We introduce "Ask a Local", a novel hallucination detection method exploiting the intuition that specialized models exhibit greater surprise when encountering domain-specific inaccuracies. Our approach computes divergence between perplexity distributions of language-specialized models to identify potentially hallucinated spans. Our method is particularly well-suited for a multilingual context, as it naturally scales to multiple languages without the need for adaptation, relying on external data sources, or performing training. Moreover, we select computationally efficient models, providing a scalable solution that can be applied to a wide range of languages and domains. Our results on a human-annotated question-answer dataset spanning 14 languages demonstrate consistent performance across languages, with Intersection-over-Union (IoU) scores around 0.3 and comparable Spearman correlation values. Our model shows particularly strong performance on Italian and Catalan, with IoU scores of 0.42 and 0.38, respectively, while maintaining cross-lingual effectiveness without language-specific adaptations. We release our code and architecture to facilitate further research in multilingual hallucination detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。