让黑盒大模型说出‘我不知道’,提升回答可信度。
Deep Learning-based Method for Expressing Knowledge Boundary of Black-Box LLM
- 用输入问题、答案和概率构建映射模型,推断模型知识边界。
- 在多个数据集上准确率显著优于基线模型,召回率提升明显。
- 适用于无参数访问的黑盒模型,对实际应用友好。
大语言模型虽取得显著进展,但内容生成失真(幻觉)限制了其实际应用。幻觉的核心原因在于模型缺乏对其内部知识范围的自我认知,无法像人类一样表达超出知识边界的未知状态。现有研究多聚焦于白盒模型,而仅提供API访问的黑盒模型仍缺乏有效方法。本文提出LSCL(LLM监督置信度学习),一种基于深度学习的黑盒模型知识边界表达方法。该方法基于知识蒸馏框架,以输入问题、输出答案及令牌概率为输入,构建输入与模型内部知识状态间的映射关系,实现对黑盒模型知识边界的量化与表达。在多个公开数据集和主流黑盒大模型上的实验表明,LSCL能有效帮助模型准确表达知识边界,各项指标显著优于现有基线模型。针对部分模型不支持令牌概率访问的情况,还提出了自适应替代方案,性能接近LSCL且优于基线。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have achieved remarkable success, however, the emergence of content generation distortion (hallucination) limits their practical applications. The core cause of hallucination lies in LLMs' lack of awareness regarding their stored internal knowledge, preventing them from expressing their knowledge state on questions beyond their internal knowledge boundaries, as humans do. However, existing research on knowledge boundary expression primarily focuses on white-box LLMs, leaving methods suitable for black-box LLMs which offer only API access without revealing internal parameters-largely unexplored. Against this backdrop, this paper proposes LSCL (LLM-Supervised Confidence Learning), a deep learning-based method for expressing the knowledge boundaries of black-box LLMs. Based on the knowledge distillation framework, this method designs a deep learning model. Taking the input question, output answer, and token probability from a black-box LLM as inputs, it constructs a mapping between the inputs and the model' internal knowledge state, enabling the quantification and expression of the black-box LLM' knowledge boundaries. Experiments conducted on diverse public datasets and with multiple prominent black-box LLMs demonstrate that LSCL effectively assists black-box LLMs in accurately expressing their knowledge boundaries. It significantly outperforms existing baseline models on metrics such as accuracy and recall rate. Furthermore, considering scenarios where some black-box LLMs do not support access to token probability, an adaptive alternative method is proposed. The performance of this alternative approach is close to that of LSCL and surpasses baseline models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。