arXiv:2505.23604cs.CLcs.AI2025-05被引 14

小模型也能高效解决真实编程问题,靠的是自我迭代优化。

Satori-SWE: Evolutionary Test-Time Scaling for Sample-Efficient Software Engineering

  • 让模型像进化一样不断优化生成结果,减少试错次数。
  • 32B模型在SWE-Bench上达到100B以上模型水平,仅需少量样本。
  • 无需外部验证器,模型自己学会提升生成质量,适合资源有限场景。

语言模型在标准编码基准上表现良好,但在真实软件工程任务(如SWE-Bench)中,尤其当参数少于100B时性能下降。尽管小模型计算成本低,但提升其性能困难。现有方法依赖高质量数据的监督微调,成本高昂。测试时扩展(test-time scaling)虽有效,但常需大量采样和昂贵评分,难以实用。本文提出进化式测试时扩展(EvoScale),将生成过程视为进化过程:通过选择与变异迭代优化输出,使分布向高分区域收敛,显著减少所需样本数。为降低重复采样与筛选开销,采用强化学习训练模型实现自进化,无需推理时依赖外部验证器,而是自主提升自身生成得分。在SWE-Bench-Verified上,32B模型Satori-SWE-32B达到或超过100B以上模型性能,且仅用少量样本。代码、数据与模型将完全开源。

原文摘要 · Abstract (English)

Language models (LMs) perform well on standardized coding benchmarks but struggle with real-world software engineering tasks such as resolving GitHub issues in SWE-Bench, especially when model parameters are less than 100B. While smaller models are preferable in practice due to their lower computational cost, improving their performance remains challenging. Existing approaches primarily rely on supervised fine-tuning (SFT) with high-quality data, which is expensive to curate at scale. An alternative is test-time scaling: generating multiple outputs, scoring them using a verifier, and selecting the best one. Although effective, this strategy often requires excessive sampling and costly scoring, limiting its practical application. We propose Evolutionary Test-Time Scaling (EvoScale), a sample-efficient method that treats generation as an evolutionary process. By iteratively refining outputs via selection and mutation, EvoScale shifts the output distribution toward higher-scoring regions, reducing the number of samples needed to find correct solutions. To reduce the overhead from repeatedly sampling and selection, we train the model to self-evolve using reinforcement learning (RL). Rather than relying on external verifiers at inference time, the model learns to self-improve the scores of its own generations across iterations. Evaluated on SWE-Bench-Verified, EvoScale enables our 32B model, Satori-SWE-32B, to match or exceed the performance of models with over 100B parameters while using a few samples. Code, data, and models will be fully open-sourced.

代码生成小模型进化算法自进化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。