arXiv:2607.27248cs.AIcs.LG2026-07

不训练即可融合通用与专业模型,动态提升科学问答准确率

Divergence Decoding: Training-Free Capability Fusion

论文配图:Divergence Decoding: Training-Free Capability Fusion
图 1 · 摘自论文原文
  • 用JS散度监测两模型分歧,分歧大时自动切换到通用模型
  • 在GPQA等三数据集上超越单一模型,最高提升12.7个百分点
  • 无需训练,适合需要快速融合多模型能力的场景

大型语言模型在推理方面表现出色,但往往缺乏特定科学领域的知识;而领域专用模型虽知识丰富,却存在逻辑能力下降和鲁棒性减弱等问题。为此,我们提出无训练的Divergence Decoding框架,将推测解码的‘草稿-验证’结构重构为自适应路由机制。核心是利用Jensen-Shannon散度监控两个模型在每个词元上的分布差异。当专用模型出现显著分歧时,系统识别为潜在推理风险并即时将控制权交还通用模型。这实现了在保留领域专长的同时动态注入通用推理能力,达成通用模型与专用模型在推理时的策略组合。我们在Qwen和Llama系列模型上,于GPQA、ChemBench和ChemCoTBench等挑战性科学基准上评估该方法。实验结果表明,Divergence Decoding在性能上优于所有单模型基线,显著超越多数专用与通用模型,证明其是一种通用、无训练的、通过推理时协作融合不同大模型能力的新范式。

原文摘要 · Abstract (English)

While large language models excel in reasoning, these generalists often lack knowledge for specialized scientific domains. Conversely, domain models~(specialists), while knowledgeable, suffer from specialization side-effects including diminished logic and reduced robustness.To address this dilemma, we introduce Divergence Decoding, a training-free framework for capability fusion. It reconstructs the "draft-and-verify" skeleton of speculative decoding into an adaptive routing mechanism. The core is using Jensen-Shannon divergence to monitor the distributional disagreement between the two models at each token. When the specialist exhibits significant divergence, our method identifies it as a potential reasoning risk and instantaneously routes control to the generalist. This allows the dynamic injection of general reasoning while preserving domain expertise, achieving inference-time policy composition of the generalist and the specialist.We evaluate Divergence Decoding across diverse model families (Qwen and Llama series) on challenging scientific benchmarks (GPQA, ChemBench, and ChemCoTBench). Experimental results demonstrate that Divergence Decoding outperforms both the domain-specialized and general-purpose models, effectively surpassing the performance of most single-model baseline. This suggests that Divergence Decoding provides a general, training-free paradigm for fusing diverse LLM capabilities through adaptive inference-time collaboration.

模型融合推理优化科学问答

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。