arXiv:2502.17026cs.CLcs.AI2025-02中稿 · COLM被引 26

用图结构分析大模型推理中的不确定性,提升解释可靠性。

Understanding the Uncertainty of LLM Explanations: A Perspective Based on Reasoning Topology

  • 将解释转化为图结构,从路径和语义双重维度量化不确定性。
  • 能检测知识冗余,揭示推理过程中的薄弱环节。
  • 适合关注模型可信度与可解释性的研究人员。

理解大语言模型(LLM)解释中的不确定性对评估其忠实性与推理一致性至关重要,有助于判断输出的可靠性。本文提出一种基于推理拓扑的新框架,通过设计结构化启发策略,引导模型将答案解释构建为图拓扑结构。该方法将解释分解为相关子问题与拓扑推理结构,从而在语义层面和推理路径层面同时量化不确定性,便于评估知识冗余并提供可解释的推理洞察。本方法系统性地解析了模型推理过程,揭示其局限性,并为提升鲁棒性与忠实性提供指导。该工作首次将图结构用于LLM解释的不确定性度量,展示了拓扑量化在推理分析中的潜力。

原文摘要 · Abstract (English)

Understanding the uncertainty in large language model (LLM) explanations is important for evaluating their faithfulness and reasoning consistency, and thus provides insights into the reliability of LLM's output regarding a question. In this work, we propose a novel framework that quantifies uncertainty in LLM explanations through a reasoning topology perspective. By designing a structural elicitation strategy, we guide the LLMs to frame the explanations of an answer into a graph topology. This process decomposes the explanations into the knowledge related sub-questions and topology-based reasoning structures, which allows us to quantify uncertainty not only at the semantic level but also from the reasoning path. It further brings convenience to assess knowledge redundancy and provide interpretable insights into the reasoning process. Our method offers a systematic way to interpret the LLM reasoning, analyze limitations, and provide guidance for enhancing robustness and faithfulness. This work pioneers the use of graph-structured uncertainty measurement in LLM explanations and demonstrates the potential of topology-based quantification.

大模型解释推理拓扑不确定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。