arXiv:2604.07725cs.AIcs.CL2026-04被引 4

用多模型协作提升无验证进化效率,降本十倍还更准。

Squeeze Evolve: Unified Multi-Model Orchestration for Verifier-Free Evolution

论文配图:Squeeze Evolve: Unified Multi-Model Orchestration for Verifier-Free Evolution
图 1 · 摘自论文原文
  • 根据任务阶段动态分配强弱模型,实现算力最优利用。
  • 在多个基准上成本降低三倍,相同预算下吞吐提升十倍。
  • 首次实现无验证进化性能媲美甚至超越有验证方法,适合部署优化场景。

我们发现无验证进化受限于多样性和效率:缺乏外部修正时,重复进化会加速退化至狭窄模式;而始终使用高成本模型则浪费算力且难以持续。为此提出Squeeze Evolve,一种统一的多模型协同框架,核心思想是将模型能力分配到边际效益最高的阶段——强模型仅用于关键环节,廉价模型处理其余步骤,显著降低成本。该方法兼顾多样性与经济性,且轻量易部署。支持开源、闭源及混合模型共存。在AIME 2025、HMMT 2025、LiveCodeBench V6、GPQA-Diamond、ARC-AGI-V2以及多模态视觉基准如MMMU-Pro和BabyVision上,均优于单模型进化,达成多项新纪录。实测表明,API成本最高降低约3倍,固定预算下的服务吞吐提升最高约10倍。此外,在探索类任务中,Squeeze Evolve首次实现无验证进化性能达到甚至超过有验证方法水平。

原文摘要 · Abstract (English)

We show that verifier-free evolution is bottlenecked by both diversity and efficiency: without external correction, repeated evolution accelerates collapse toward narrow modes, while the uniform use of a high-cost model wastes compute and quickly becomes economically impractical. We introduce Squeeze Evolve, a unified multi-model orchestration framework for verifier-free evolutionary inference. Our approach is guided by a simple principle: allocate model capability where it has the highest marginal utility. Stronger models are reserved for high-impact stages, while cheaper models handle the other stages at much lower costs. This principle addresses diversity and cost-efficiency jointly while remaining lightweight. Squeeze Evolve naturally supports open-source, closed-source, and mixed-model deployments. Across AIME 2025, HMMT 2025, LiveCodeBench V6, GPQA-Diamond, ARC-AGI-V2, and multimodal vision benchmarks, such as MMMU-Pro and BabyVision, Squeeze Evolve consistently improves the cost-capability frontier over single-model evolution and achieves new state-of-the-art results on several tasks. Empirically, Squeeze Evolve reduces API cost by up to $\sim$3$\times$ and increases fixed-budget serving throughput by up to $\sim$10$\times$. Moreover, on discovery tasks, Squeeze Evolve is the first verifier-free evolutionary method to match, and in some cases exceed, the performance of verifier-based evolutionary methods.

多模型协同进化推理成本优化无验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。