arXiv:2507.06829cs.CL2025-07被引 10

用语义熵自动判断推理是否该结束,提升大模型多轮推理效率。

Adaptive Termination for Multi-round Parallel Reasoning: An Universal Semantic Entropy-Guided Framework

  • 基于语义熵动态评估并行推理结果的多样性,指导终止决策。
  • 实验显示在多个数据集上比固定长度更早终止且准确率更高。
  • 适合需要高效推理的场景,如智能客服、自动编程等应用。

大语言模型的推理时扩展技术正推动通用人工智能发展。当前方法或采用串行推理(逐步扩展思维链),或采用并行推理(同时生成多个解)。但两者均有局限:串行方法依赖预设的词元数量终止,常导致效率低下或过早中断;并行方法缺乏分支间协调,且需侵入式微调才能有效。为此,我们设计了一种灵活的推理时协作框架,融合串行与并行推理优势。核心挑战在于构建一个高效准确的内在质量度量以评估推理过程,实现动态控制与早期终止。为此,我们提出语义熵(SE),量化并行响应的语义多样性,因其与准确率呈强负相关,可作为可靠的推理质量指示器。

原文摘要 · Abstract (English)

Recent advances in large language models (LLMs) have accelerated progress toward artificial general intelligence, with inference-time scaling emerging as a key technique. Contemporary approaches leverage either sequential reasoning (iteratively extending chains of thought) or parallel reasoning (generating multiple solutions simultaneously) to scale inference. However, both paradigms face fundamental limitations: sequential scaling typically relies on arbitrary token budgets for termination, leading to inefficiency or premature cutoff; while parallel scaling often lacks coordination among parallel branches and requires intrusive fine-tuning to perform effectively. In light of these challenges, we aim to design a flexible test-time collaborative inference framework that exploits the complementary strengths of both sequential and parallel reasoning paradigms. Towards this goal, the core challenge lies in developing an efficient and accurate intrinsic quality metric to assess model responses during collaborative inference, enabling dynamic control and early termination of the reasoning trace. To address this challenge, we introduce semantic entropy (SE), which quantifies the semantic diversity of parallel model responses and serves as a robust indicator of reasoning quality due to its strong negative correlation with accuracy...

大模型推理语义熵自适应终止并行推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。