arXiv:2509.21960cs.LG2025-09ACL被引 2

让大模型根据问题难易自动调节思考深度,又快又准。

Think Smart, Not Hard: Difficulty Adaptive Reasoning for Large Audio Language Models

  • 用难度感知奖励函数动态调节推理长度
  • 复杂问题推理更深入,简单问题更简洁,平均推理长度显著减少
  • 适合需要高效精准推理的音频语言任务

大型音频语言模型(LALMs)在链式思维(CoT)范式下展现出强大的推理能力。然而,不同问题所需的推理深度各异,现有方法多仅判断是否推理,缺乏对推理深度的精细调控,导致简单问题冗余思考、复杂问题思考不足。本文深入分析LALMs后提出一种难度自适应推理方法:设计一个动态奖励函数,将推理长度与模型感知的问题难度关联,鼓励简单任务简洁推理、复杂任务深入推理。大量实验表明,该方法在提升任务性能的同时显著缩短平均推理长度,为未来推理结构研究提供重要启示。

原文摘要 · Abstract (English)

Large Audio Language Models (LALMs), powered by the chain-of-thought (CoT) paradigm, have shown remarkable reasoning capabilities. Intuitively, different problems often require varying depths of reasoning. While some methods can determine whether to reason for a given problem, they typically lack a fine-grained mechanism to modulate how much to reason. This often results in a ``one-size-fits-all'' reasoning depth, which generates redundant overthinking for simple questions while failing to allocate sufficient thought to complex ones. In this paper, we conduct an in-depth analysis of LALMs and find that an effective and efficient LALM should reason smartly by adapting its reasoning depth to the problem's complexity. To achieve this, we propose a difficulty-adaptive reasoning method for LALMs. Specifically, we propose a reward function that dynamically links reasoning length to the model's perceived problem difficulty. This reward encourages shorter, concise reasoning for easy tasks and more elaborate, in-depth reasoning for complex ones. Extensive experiments demonstrate that our method is both effective and efficient, simultaneously improving task performance and significantly reducing the average reasoning length. Further analysis on reasoning structure paradigm offers valuable insights for future work.

音频理解推理优化智能模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。