用不同大模型做进化搜索,让创意多样性提升代码生成质量。
DEI: Diversity in Evolutionary Inference for Quality-Diversity Search

- 用多个不同大模型当变异算子,跨模型协作生成新解。
- 四节点异构组合比单模型提升124%搜索得分和28%覆盖范围。
- 模型多样性是性能关键,不靠简单并行就能实现突破。
我们提出DEI:进化推断中的多样性,一种分布式质量-多样性(QD)搜索框架,将异构大语言模型(LLMs)作为通信节点间的变异算子,通过非阻塞集体操作进行协作。与复制单一模型归纳偏置的同质并行搜索不同,DEI将每个LLM独特的创造先验视为互补的行为新颖性来源。在每轮结束时,节点共享本地最优解以种子化下一轮种群,扩展了数字红皇后框架,形成跨模型对抗压力,推动鲁棒性超越模型内自对弈。在核心战争(Core War)领域评估,该四节点异构集成(GPT-5.4-mini、Claude Sonnet 4.6、GPT-5.2、Claude Haiku 4.5)在同等总LLM调用预算下,相比单节点基线,合并归档的QD得分提升124%(45.90 vs. 20.46),覆盖率提升28%(80.6% vs. 63.0%的单元格)。该异构集成在QD得分、覆盖率及未见解泛化性上均优于同等预算的同质集成。结果首次提供实证证据表明,在基于大模型的分布式QD搜索中,模型多样性而非单纯并行性才是性能提升的关键。
原文摘要 · Abstract (English)
We present DEI: Diversity in Evolutionary Inference, a distributed Quality-Diversity (QD) search framework that assigns heterogeneous large language models (LLMs) as mutation operators across peer nodes communicating with non-blocking collective operations. Unlike homogeneous parallel search, which replicates a single model's inductive biases across all workers, DEI treats each LLM's distinct creative prior as a complementary source of behavioral novelty. Extending the Digital Red Queen framework with DEI, nodes share local optimal solutions at the end of each round to seed the next round's population. This creates cross-model adversarial pressure that drives robustness beyond intra-model self-play. Evaluated on the Core War domain, a competitive programming benchmark in which Redcode warrior programs battle inside a simulated machine, a four-node heterogeneous ensemble (GPT-5.4-mini, Claude Sonnet 4.6, GPT-5.2, and Claude Haiku 4.5) achieves 124 percent higher merged-archive QD-Score (45.90 vs. 20.46) and 28 percent higher coverage (80.6 percent vs. 63.0 percent of cells) than a single-node baseline at equal total LLM-call budget. The heterogeneous ensemble also outperforms an equally-budgeted homogeneous ensemble on QD-Score, coverage, and held-out solution generality across all four model families. These results provide the first empirical evidence that model diversity, not merely parallelism, is the key driver of gain in distributed LLM-based QD search.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。