用极少数据训练出高效幻觉检测模型,适合工业场景部署。
Data-efficient Meta-models for Evaluation of Context-based Questions and Answers in LLMs
- 结合高效分类与降维技术,大幅减少标注数据需求。
- 仅用250个样本即达到顶尖商用模型性能。
- 适合标注资源有限的现实应用,如企业级系统部署。
大型语言模型(LLMs)和检索增强生成(RAG)系统在工业应用中日益普及,但其可靠性仍受幻觉检测难题制约。尽管基于模型隐藏状态的监督式先进方法(如激活追踪与表征分析)展现潜力,但其对大规模标注数据的依赖限制了实际可扩展性。本文聚焦数据标注瓶颈,研究降低两种先进幻觉检测框架——Lookback Lens(分析注意力头动态)与探针式方法(解码内部表征)——的训练数据需求的可行性。提出一种结合高效分类算法与维度压缩技术的方法,在保持竞争力的前提下显著减少样本量。在标准化的RAG问答基准上评估显示,该方法仅需250个训练样本即可达到强于主流商用LLM基线的性能。结果表明,轻量、数据高效的范式在标注受限场景下具备工业部署潜力。
原文摘要 · Abstract (English)
Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems are increasingly deployed in industry applications, yet their reliability remains hampered by challenges in detecting hallucinations. While supervised state-of-the-art (SOTA) methods that leverage LLM hidden states -- such as activation tracing and representation analysis -- show promise, their dependence on extensively annotated datasets limits scalability in real-world applications. This paper addresses the critical bottleneck of data annotation by investigating the feasibility of reducing training data requirements for two SOTA hallucination detection frameworks: Lookback Lens, which analyzes attention head dynamics, and probing-based approaches, which decode internal model representations. We propose a methodology combining efficient classification algorithms with dimensionality reduction techniques to minimize sample size demands while maintaining competitive performance. Evaluations on standardized question-answering RAG benchmarks show that our approach achieves performance comparable to strong proprietary LLM-based baselines with only 250 training samples. These results highlight the potential of lightweight, data-efficient paradigms for industrial deployment, particularly in annotation-constrained scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。