arXiv:2603.08659cs.CL2026-03被引 3

让大模型按难易自动调节推理深度,省资源又提效果

CODA: Difficulty-Aware Compute Allocation for Adaptive Reasoning

  • 用难度信号动态分配计算资源,难题多思考,简单题少绕弯
  • 简单任务节省超60%算力,难题表现更优,无需人工设定预算
  • 无需标注或外部指令,适配多种模型和评测集

大型推理模型表明,增加推理时计算量可显著提升复杂任务表现。但常陷入另一个问题:对简单问题过度思考,重复推理解析带来微小准确率提升却消耗大量算力。这促使我们探索自适应推理——根据实例难度动态调整推理深度。本文从最优性角度研究该问题,将其建模为效用最大化问题:持续分配token直至边际准确率增益低于增量成本。基于此,提出CODA(基于难度感知的计算分配)方法,通过内部难度信号动态分配token。具体地,CODA利用分组回溯估计难度,并映射为两个非负门控机制:易题门控抑制简单任务的冗长表达,难题门控鼓励复杂任务进行更多审慎推演。在不同模型规模与基准测试上,CODA实现无需外部标注或用户预算的自适应推理:简单任务降低60%以上算力消耗且保持高准确率;复杂任务则激励更深入推演以最大化性能。

原文摘要 · Abstract (English)

The emergence of large reasoning models demonstrates that scaling inference-time compute significantly enhances performance on complex tasks. However, it often falls into another trap: overthinking simple problems, where repetitive rationales yield minimal accuracy gains at a disproportionately high cost. This motivates adaptive reasoning: dynamically aligning reasoning depth with instance difficulty. In this paper, we study adaptive reasoning from an optimality perspective, formalizing it as a utility maximization problem where tokens are allocated until the marginal accuracy gain falls below the incremental cost. Based on this, we propose CODA (Compute Allocation by Difficulty Awareness), a method that operationalizes this principle by allocating tokens via a policy-internal difficulty signal. Specifically, CODA estimates difficulty via group-based rollouts and maps it to two non-negative gates that modulate a length-dependent shaping term on top of the binary base reward. The easy-side gate penalizes verbosity on simple instances, whereas the hard-side gate encourages more deliberative rollouts on challenging ones. Across model scales and benchmarks, CODA achieves adaptive reasoning without external annotations or user-provided budgets: on easy tasks, CODA reduces token costs by over 60% while maintaining strong accuracy, whereas on hard tasks it incentivizes more deliberative rollouts to maximize performance.

自适应推理计算分配大模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。