用进化算法自动优化GPU内核,速度超越顶级商业模型。
Kernel-Smith: A Unified Recipe for Evolutionary Kernel Optimization
- 结合演化搜索与强化学习,持续优化可执行代码
- 在NVIDIA和MetaX平台上均达领先性能,平均提速显著
- 适合需要高效算子生成的系统级开发者
我们提出Kernel-Smith,一个面向高性能GPU内核与算子生成的统一框架,融合稳定评估驱动的演化代理与面向演化的后训练策略。在代理端,维护可执行候选集,利用顶级且多样化的程序存档及编译、正确性、加速比等结构化执行反馈迭代优化。为确保搜索可靠性,构建了针对NVIDIA GPU的Triton和MetaX GPU的Maca后端评估服务。在训练端,将长时程演化轨迹转化为以步骤为中心的监督信号与强化学习信号,仅保留保持正确性且收益高的修改,使模型作为演化循环内的强局部改进者而非一次性生成器进行优化。在统一演化协议下,Kernel-Smith-235B-RL在NVIDIA Triton后端的KernelBench上达到当前最优整体性能,平均加速比领先,超越包括Gemini-3.0-pro和Claude-4.6-opus在内的前沿专有模型。进一步验证其在MetaX MACA后端的可行性,Kernel-Smith-MACA-30B优于DeepSeek-V3.2-think和Qwen3-235B-2507-think等大规模模型,展现出跨异构平台的无缝适配潜力。除基准测试外,该流程已贡献至SGLang和LMDeploy等生产系统,证明大模型驱动的内核优化可从评测环境成功迁移至实际部署。
原文摘要 · Abstract (English)
We present Kernel-Smith, a framework for high-performance GPU kernel and operator generation that combines a stable evaluation-driven evolutionary agent with an evolution-oriented post-training recipe. On the agent side, Kernel-Smith maintains a population of executable candidates and iteratively improves them using an archive of top-performing and diverse programs together with structured execution feedback on compilation, correctness, and speedup. To make this search reliable, we build backend-specific evaluation services for Triton on NVIDIA GPUs and Maca on MetaX GPUs. On the training side, we convert long-horizon evolution trajectories into step-centric supervision and reinforcement learning signals by retaining correctness-preserving, high-gain revisions, so that the model is optimized as a strong local improver inside the evolutionary loop rather than as a one-shot generator. Under a unified evolutionary protocol, Kernel-Smith-235B-RL achieves state-of-the-art overall performance on KernelBench with Nvidia Triton backend, attaining the best average speedup ratio and outperforming frontier proprietary models including Gemini-3.0-pro and Claude-4.6-opus. We further validate the framework on the MetaX MACA backend, where our Kernel-Smith-MACA-30B surpasses large-scale counterparts such as DeepSeek-V3.2-think and Qwen3-235B-2507-think, highlighting potential for seamless adaptation across heterogeneous platforms. Beyond benchmark results, the same workflow produces upstream contributions to production systems including SGLang and LMDeploy, demonstrating that LLM-driven kernel optimization can transfer from controlled evaluation to practical deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。