用智能路由让大模型高效思考,少算多准。
ODAR: Principled Adaptive Routing for LLM Reasoning via Active Inference
- 根据题目难易动态分配快慢两种推理方式
- 在MATH上达98.2%准确率,计算量减少82%
- 适合追求高精度与低耗能的推理系统设计
大语言模型推理正从参数扩展转向测试时计算扩展,但现有方法仍依赖固定采样策略(如固定最佳N或自洽性),代价高、难以归因,且易陷入无效反复。本文提出ODAR-Expert,一种基于变分自由能原理的自适应路由框架,通过缓解主动推断中的可摊销难度估计,动态调度查询在启发式快速代理与深思熟虑的慢速代理之间。我们进一步引入一种基于自由能原则的风险敏感融合机制,通过最小化变分自由能目标,平衡对数似然与认知不确定性(方差熵),作为对异构候选答案的随意投票的合理替代。在23个基准上的广泛评估显示显著且一致的提升:在MATH上达到98.2%准确率,在Humanity's Last Exam(HLE)上达54.8%,同时在计算匹配条件下优化了计算-精度前沿。我们在完全开源栈(Llama 4 + DeepSeek)上验证了可复现性,表明ODAR在超越同质采样策略的同时,将计算成本降低82%。总体而言,结果表明,最优思考需要基于自由能决策的自适应资源分配,而非单纯增加测试时计算。
原文摘要 · Abstract (English)
The paradigm of large language model (LLM) reasoning is shifting from parameter scaling to test-time compute scaling, yet many existing approaches still rely on uniform brute-force sampling (for example, fixed best-of-N or self-consistency) that is costly, hard to attribute, and can trigger overthinking with diminishing returns. We propose ODAR-Expert, an adaptive routing framework that optimizes the accuracy-efficiency trade-off via principled resource allocation. ODAR uses a difficulty estimator grounded in amortized active inference to dynamically route queries between a heuristic Fast Agent and a deliberative Slow Agent. We further introduce a free-energy-principled, risk-sensitive fusion mechanism that selects answers by minimizing a variational free energy objective, balancing log-likelihood with epistemic uncertainty (varentropy) as a principled alternative to ad hoc voting over heterogeneous candidates. Extensive evaluation across 23 benchmarks shows strong and consistent gains, including 98.2% accuracy on MATH and 54.8% on Humanity's Last Exam (HLE), while improving the compute-accuracy frontier under compute-matched settings. We also validate reproducibility on a fully open-source stack (Llama 4 + DeepSeek), where ODAR surpasses homogeneous sampling strategies while reducing computational costs by 82%. Overall, our results suggest that thinking-optimal scaling requires adaptive resource allocation with free-energy-based decision-making rather than simply increasing test-time compute.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。