arXiv:2503.04530cs.AI2025-03被引 1

SOLAR动态优化推理拓扑,提升大模型准确率与效率。

SOLAR: Scalable Optimization of Large-scale Architecture for Reasoning

  • 通过自动标注与难度分层,动态优化CoT/ToT/GoT拓扑结构。
  • 在MATH和GSM8K上最高提升10.02%准确率,响应长度减少5%以上。
  • 单次推理即选最优拓扑与答案,适合高效部署的推理场景。

大语言模型虽擅长推理,但常依赖Chain-of-Thought提示,限制了在需复杂拓扑结构任务上的表现。我们提出SOLAR(Scalable Optimization of Large-scale Architecture for Reasoning),一个动态优化Chain-of-Thought(CoT)、Tree-of-Thought(ToT)和Graph-of-Thought(GoT)拓扑的框架,以提升准确率与效率。其Topological-Annotation-Generation(TAG)系统实现数据集自动化创建、标注与难度分段,显著增强后训练与推理性能。我们还提出基于课程学习的Topological-Scaling方法,自适应结合后训练与推理缩放。在MATH和GSM8K上,SOLAR实现+5%准确率(拓扑调优)、+9%(拓扑奖励)和+10.02%(混合缩放),同时响应长度降低超5%,推理延迟下降。为提升效率,引入多任务拓扑奖励模型(M-TRM),单次推理即可选择最优推理拓扑与最终答案,取代多个单任务TRM。M-TRM性能超越所有单任务模型,准确率提升+10%,排名相关性提高+9%。总体而言,SOLAR建立了可扩展高精度推理的新基准,并引入全自动动态拓扑竞争机制。

原文摘要 · Abstract (English)

Large Language Models excel in reasoning yet often rely on Chain-of-Thought prompts, limiting performance on tasks demanding more nuanced topological structures. We present SOLAR (Scalable Optimization of Large-scale Architecture for Reasoning), a framework that dynamically optimizes Chain-of-Thought (CoT), Tree-of-Thought (ToT), and Graph-of-Thought (GoT) topologies to boost accuracy and efficiency. Our Topological-Annotation-Generation (TAG) system automates dataset creation, annotation, and difficulty segmentation, leading to stronger post training and test-time performance. We also propose Topological-Scaling, a curriculum-learning-based approach that adaptively combines post training and inference scaling to each task. On MATH and GSM8K, SOLAR delivers notable gains: +5% accuracy with Topological Tuning, +9% with Topological Rewarding, and +10.02% with Hybrid Scaling, while reducing response length by over 5%, lowering inference latency. To further enhance efficiency, we introduce a multi-task Topological Reward Model (M-TRM) that selects both the optimal reasoning topology and final answer in a single pass, eliminating multiple single-task TRMs. Remarkably, M-TRM also surpasses all single-task TRMs, improving accuracy by +10% and rank correlation by +9%. Overall, SOLAR establishes a new benchmark for scalable, high-precision LLM reasoning and introduces a fully automated, dynamic topology competition mechanism.

大模型推理拓扑优化链式思考效率提升

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。