arXiv:2601.15727cs.LGcs.CL2026-01被引 9

用大模型自动生成高性能GPU内核,解决人工编写耗时难题。

Towards Automated Kernel Generation in the Era of LLMs

  • 利用大模型压缩专家级内核知识,实现自动化生成。
  • 通过智能体迭代优化,提升内核性能并支持规模化应用。
  • 系统梳理现有方法与评测数据集,为后续研究提供参考。

现代AI系统的性能本质上受限于其底层GPU内核的质量,这些内核将高层算法语义转化为低层硬件操作。达到近似最优的内核需要对硬件架构和编程模型有专家级理解,导致内核工程成为关键但耗时且不可扩展的过程。近年来,大语言模型(LLM)及基于LLM的智能体在自动化内核生成与优化方面展现出新可能:LLM擅长压缩难以形式化的专家知识,而智能体系统则通过迭代反馈循环实现可扩展优化。尽管该领域进展迅速,但目前仍分散且缺乏系统性视角。本文综述填补这一空白,系统梳理基于LLM的方法与智能体优化流程,组织支撑学习与评估的数据集与基准测试。同时,明确关键开放挑战与未来研究方向,旨在为下一代自动化内核优化建立全面参考。我们维护一个开源项目仓库以持续追踪该领域进展:https://github.com/flagos-ai/awesome-LLM-driven-kernel-generation。

原文摘要 · Abstract (English)

The performance of modern AI systems is fundamentally constrained by the quality of their underlying GPU kernels, which translate high-level algorithmic semantics into low-level hardware operations. Achieving near-optimal kernels requires expert-level understanding of hardware architectures and programming models, making kernel engineering a critical but notoriously time-consuming and non-scalable process. Recent advances in large language models and LLM-based agents have opened new possibilities for automating kernel generation and optimization. LLMs are well-suited to compress expert-level kernel knowledge that is difficult to formalize, while agentic systems further enable scalable optimization by casting kernel development as an iterative, feedback-driven loop. Rapid progress has been made in this area. However, the field remains fragmented and lacks a systematic perspective for LLM-driven kernel generation. This survey addresses this gap by providing a structured overview of existing approaches, spanning LLM-based approaches and agentic optimization workflows, and systematically organizing the datasets and benchmarks that underpin learning and evaluation in this domain. Moreover, key open challenges and future research directions are further outlined, aiming to establish a comprehensive reference for the next generation of automated kernel optimization. To keep track of this field, we maintain an open-source GitHub repository at https://github.com/flagos-ai/awesome-LLM-driven-kernel-generation.

大模型内核优化自动化GPU

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。