arXiv:2509.23331cs.CL2025-09被引 4

通过群体投票筛选最优提示,提升大模型推理能力。

C-Evolve: Consensus-based Evolution for Prompt Groups

  • 用岛屿演化算法维护提示多样性,群体投票决定优劣。
  • 在HotpotQA和MATH任务上分别达70.67%和95.33%准确率。
  • 适合需要提升闭源模型推理性能的研究者使用。

提示演化算法为增强基于闭源模型的AI系统提供了强大范式,但很少研究探讨是否可通过多个提示聚合结果并达成共识来进一步突破系统能力边界。本文提出共识演化(C-Evolve),一种进化算法,旨在发现一组提示,其多数投票后的联合输出表现最优。C-Evolve采用基于岛屿的进化策略以维持种群多样性,从不同岛屿选取提示组成群体进行输出聚合。与单个提示演化不同,关键在于引入投票得分,用于评估每个提示在群体中的贡献,并以此作为进化适应度,而非个体性能。这使C-Evolve更倾向于生成并保留具备高组合适配潜力的提示,逐步淘汰低效提示,从而实现群体共识下的性能持续提升。该方法在多种任务上达到领先效果:在Qwen3-8B上,HotpotQA准确率达70.67%(比GEPA高4.95%),IFBench达43.88%(高2.73%);在GPT-4.1-mini上,IFBench提升至47.96%,MATH达95.33%,验证了其竞争力。

原文摘要 · Abstract (English)

Prompt evolution algorithms offer a powerful paradigm for enhancing AI systems based on closed-source models, while few work explores whether aggregating results from multiple prompts to reach a consensus can further advance the system capability boundary. In this paper, we introduce Consensus-Evolve (C-Evolve), an evolutionary algorithm that discovers a group of prompts whose aggregated outputs after majority voting achieve optimal performance. More specifically, C-Evolve employs an island-based evolutionary algorithm to maintain population diversity, and prompts from distinct islands are selected to form groups to aggregate their outputs. The key difference from single individual evolution is a voting score, which evaluates each individual prompt's contribution within groups. We take this as the fitness score for evolution instead of individual performance. Consequently, C-Evolve is more likely to produce and maintain prompts with higher potential to form a high-performing group and eliminate low-performing ones, gradually improving the group performance after reaching consensus. Our method achieves state-of-the-art performance across a wide range of tasks, including both open-ended tasks like HotpotQA and closed-ended tasks like MATH. On Qwen3-8B, C-Evolve achieves 70.67% on HotpotQA and 43.88% on IFBench, which are 4.95% and 2.73% higher than GEPA, respectively. For GPT-4.1-mini, the accuracy on IFBench is further improved to 47.96% and reaches 95.33% in the MATH benchmark. These results demonstrate the C-Evolve's competitive performance.

提示工程进化算法大模型推理多提示聚合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。