用十台开源大模型协作,成本更低却超越谷歌Gemini-3-Pro。
Beyond Gemini-3-Pro: Revisiting LLM Routing and Aggregation at Scale
- 混合查询与响应路由,更好判断任务难易
- 根据任务自动选最优聚合器,性能提升明显
- 适合追求低成本高效果的AI系统开发者
大型语言模型迅速发展,Gemini-3-Pro树立了新性能标杆。本文探索集体智能作为单一模型扩展的替代路径,证明开源LLM协同可超越Gemini-3-Pro。我们重新审视大规模下LLM路由与聚合,发现三大瓶颈:(1) 当前免训练路由受限于仅关注文本相似性的查询范式;(2) 近期聚合方法普遍静态,无法为不同任务选择合适聚合器;(3) 路由与聚合的互补性未被充分利用。为此提出JiSi框架,通过三项创新释放LLM协作潜力:(1) 查询-响应混合路由,同时捕捉语义信息与问题难度;(2) 基于支持集的聚合器选择,联合评估聚合能力与领域适配性;(3) 自适应路由-聚合切换,动态利用两者优势。在九个基准上的实验表明,仅用47%成本、协调十台开源LLM,JiSi即可超越Gemini-3-Pro,并显著优于主流基线。结果表明,集体智能是通向通用人工智能(AGI)的新路径。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have rapidly advanced, with Gemini-3-Pro setting a new performance milestone. In this work, we explore collective intelligence as an alternative to monolithic scaling, and demonstrate that open-source LLMs' collaboration can surpass Gemini-3-Pro. We first revisit LLM routing and aggregation at scale and identify three key bottlenecks: (1) current train-free routers are limited by a query-based paradigm focusing solely on textual similarity; (2) recent aggregation methods remain largely static, failing to select appropriate aggregators for different tasks;(3) the complementarity of routing and aggregation remains underutilized. To address these problems, we introduce JiSi, a novel framework designed to release the full potential of LLMs' collaboration through three innovations: (1) Query-Response Mixed Routing capturing both semantic information and problem difficulty; (2) Support-Set-based Aggregator Selection jointly evaluating the aggregation and domain capacity of aggregators; (3) Adaptive Routing-Aggregation Switch dynamically leveraging the advantages of routing and aggregation. Comprehensive experiments on nine benchmarks demonstrate that JiSi can surpass Gemini-3-Pro with only 47% costs by orchestrating ten open-source LLMs, while outperforming mainstream baselines. It suggests that collective intelligence represents a novel path towards Artificial General Intelligence (AGI).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。