用熵引导动态调整,让代码生成更准更快。
EGSS: Entropy-guided Stepwise Scaling for Reliable Software Engineering
- 根据输出熵动态调整搜索步数,平衡效率与效果。
- 在SWE-Bench-Verified上提升准确率5%-10%,最高达74.6%。
- 适合追求高效高精度代码生成的开发者使用。
代理式测试时扩展(TTS)在代码生成和缺陷修复等复杂软件工程任务中取得了当前最优性能。然而,其实际应用受限于显著的计算开销,主要源于两大挑战:(1) 部署过大集成模型带来的高昂成本;(2) 缺乏可靠的最优解选择机制,限制了性能提升空间。为此,我们提出熵引导的分步扩展(EGSS),通过熵引导的自适应搜索与鲁棒测试集增强,动态平衡效率与有效性。在SWE-Bench-Verified上的大量实验表明,EGSS在所有评估模型上均实现5%-10%的性能提升。具体而言,将Kimi-K2-Instruct的解决率从63.2%提升至72.2%,GLM-4.6从65.8%提升至74.6%。此外,结合GLM-4.6时,EGSS在开源大模型中达到新的最优水平。除准确性提升外,相比现有TTS方法,EGSS推理阶段的词元使用量减少超过28%,实现了有效性和计算效率的双重优化。
原文摘要 · Abstract (English)
Agentic Test-Time Scaling (TTS) has delivered state-of-the-art (SOTA) performance on complex software engineering tasks such as code generation and bug fixing. However, its practical adoption remains limited due to significant computational overhead, primarily driven by two key challenges: (1) the high cost associated with deploying excessively large ensembles, and (2) the lack of a reliable mechanism for selecting the optimal candidate solution, ultimately constraining the performance gains that can be realized. To address these challenges, we propose Entropy-Guided Stepwise Scaling (EGSS), a novel TTS framework that dynamically balances efficiency and effectiveness through entropy-guided adaptive search and robust test-suite augmentation. Extensive experiments on SWE-Bench-Verified demonstrate that EGSS consistently boosts performance by 5-10% across all evaluated models. Specifically, it increases the resolved ratio of Kimi-K2-Intruct from 63.2% to 72.2%, and GLM-4.6 from 65.8% to 74.6%. Furthermore, when paired with GLM-4.6, EGSS achieves a new state-of-the-art among open-source large language models. In addition to these accuracy improvements, EGSS reduces inference-time token usage by over 28% compared to existing TTS methods, achieving simultaneous gains in both effectiveness and computational efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。