arXiv:2603.02510cs.LGcs.DC2026-03

用智能演化生成高效并行代码,解决不规则数据的并发难题。

ParEVO: Synthesizing Code for Irregular Data: High-Performance Parallelism through Agentic Evolution

  • 通过进化代理迭代修复代码,结合编译器与性能分析反馈。
  • 在复杂不规则图任务上实现13.6倍平均加速,最高达1103倍。
  • 适配专家级并行编程需求,尤其适合高难度异构数据场景。

从串行到并行计算对现代高性能应用至关重要,但并发编程门槛高,尤其在稀疏图、不平衡树等不规则数据结构上,静态调度失效且数据依赖不可预测。当前大语言模型在此类任务中常生成含微妙竞争条件、死锁或扩展性差的代码。本文提出ParEVO框架,专为不规则数据设计高性能并行算法合成:(1)构建包含13,820个任务的Parlay-Instruct语料库,通过“批判-优化”流程筛选出实测高效的算法;(2)对DeepSeek、Qwen和Gemini模型进行微调,使其生成符合ParlayLib并行原语语义的代码;(3)引入进化编码代理(ECA),利用编译器、动态竞争检测器和性能分析器反馈持续修复代码。在ParEval基准测试中,ParEVO平均实现106倍加速(最高1103倍),复杂不规则图任务仍保持13.6倍加速,优于当前商用先进模型。其进化方法达到顶尖人类专家水平,在特定高度不规则核函数上实现4.1倍加速。源码与数据集已开源。

原文摘要 · Abstract (English)

The transition from sequential to parallel computing is essential for modern high-performance applications but is hindered by the steep learning curve of concurrent programming. This challenge is magnified for irregular data structures (such as sparse graphs, unbalanced trees, and non-uniform meshes) where static scheduling fails and data dependencies are unpredictable. Current Large Language Models (LLMs) often fail catastrophically on these tasks, generating code plagued by subtle race conditions, deadlocks, and sub-optimal scaling. We bridge this gap with ParEVO, a framework designed to synthesize high-performance parallel algorithms for irregular data. Our contributions include: (1) The Parlay-Instruct Corpus, a curated dataset of 13,820 tasks synthesized via a "Critic-Refine" pipeline that explicitly filters for empirically performant algorithms that effectively utilize Work-Span parallel primitives; (2) specialized DeepSeek, Qwen, and Gemini models fine-tuned to align probabilistic generation with the rigorous semantics of the ParlayLib library; and (3) an Evolutionary Coding Agent (ECA) that improves the "last mile" of correctness by iteratively repairing code using feedback from compilers, dynamic race detectors, and performance profilers. On the ParEval benchmark, ParEVO achieves an average 106x speedup (with a maximum of 1103x) across the suite, and a robust 13.6x speedup specifically on complex irregular graph problems, outperforming state-of-the-art commercial models. Furthermore, our evolutionary approach matches state-of-the-art expert human baselines, achieving up to a 4.1x speedup on specific highly-irregular kernels. Source code and datasets are available at https://github.com/WildAlg/ParEVO.

并行计算代码生成进化算法不规则数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。