arXiv:2608.26141cs.CLcs.LG2026-08

让大模型自动判断何时思考,提升复杂任务准确率同时节省计算资源。

AdaThinking-E: One-Token Entropy Regulation for Adaptive Thinking

论文配图:AdaThinking-E: One-Token Entropy Regulation for Adaptive Thinking
图 1 · 摘自论文原文
  • 通过单个词的熵值动态调节思考行为,实现自适应推理决策。
  • 在复杂任务上准确率提升,简单任务处理速度加快30%以上。
  • 无需人工标注难度,模型可自主学习何时该深度思考。

多模态大语言模型通过引入显式的思维过程,在文档推理任务中展现出强大能力。然而,当前模型对所有问题统一应用深度推理,导致简单任务产生不必要的计算开销,不仅降低用户体验,还影响基准测试的准确性。本文提出AdaThinking-E,一种基于强化学习的自适应思考框架,通过单个词的熵值调控实现思考决策的智能化。核心思想是:在关键决策词上,通过预测概率分布的熵来量化模型对是否进行思考的置信度。训练过程中,模型从高熵探索(尝试不同推理策略)逐步收敛到低熵确定性决策,形成稳健且通用的思考策略。该方法使模型能内在地判断何时需要思考,无需外部难度标签或人工干预。大量实验表明,该方法在多样化文档任务中兼顾复杂问题的高精度与简单问题的高效处理。

原文摘要 · Abstract (English)

Multimodal large language models have demonstrated strong document reasoning capabilities by incorporating explicit thinking processes. While this capability significantly improves performance on challenging tasks, current models apply such deep reasoning uniformly to all questions, resulting in unnecessary computational overhead for simple task. This not only degrades user experience but also negatively impact accuracy on benchmark datasets. We identify the critical need for adaptive thinking mechanisms that can intelligently determine when to engage reasoning based on question complexity. To address this, we propose AdaThinking-E, a novel reinforcement learning framework that learns adaptive thinking through one-token entropy regulation. Our key insight is that model confidence in the decision to engage thinking (or not) can be quantified through entropy analysis of the predicted probability distribution at critical decision tokens. This observation motivates our entropy-governed reward mechanism: the training process naturally transitions from high-entropy exploration, where the model experiments with different thinking strategies, to low-entropy convergence with confident, generalizable decision-making policies. Crucially, this approach enables models to intrinsically discover when to think without requiring manual intervention or external difficulty labels. Extensive experiments demonstrate that our approach enables models to be both accurate on complex problems and efficient on simple ones across diverse document tasks.

自适应推理强化学习熵调控大模型效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。