HIERA动态选择GPU内核优化空间,提升效率与适应性。
HIERA: Workload-Aware Planning Across Implementation Spaces for GPU Kernel Optimization

- 分层规划多层级实现空间,融合PyTorch、CUDA库与自定义内核
- 在KernelBench上实现更高有效性与采样效率,优于现有无训练方法
- 适用于科学计算等复杂场景,可加速专用算子1.53倍
高性能GPU内核支撑现代深度学习与科学计算。随着工作负载日益多样及GPU硬件快速演进,自动化生成与优化GPU内核的方法变得愈发重要。现有基于大模型的方法通常在固定实现空间中优化,限制了灵活性或搜索效率。本文提出HIERA——一种面向工作负载的分层搜索空间规划框架,用于GPU内核优化。HIERA构建带合约的任务规范,跨PyTorch算子、CUDA库与自定义CUDA内核选择合适实现空间,并利用性能分析反馈与专家知识引导结构化迭代优化。在KernelBench上对多种工作负载层级和基础LLM的实验表明,HIERA在整体实现有效性、样本效率与优化性能方面均优于现有无训练方法,且在无需额外模型训练的前提下,与基于训练的CUDA-L1保持竞争力。针对科学计算中的专用卷积算子案例研究,相较cuDNN实现1.53倍加速,证明该框架在标准机器学习以外场景的潜力。
原文摘要 · Abstract (English)
High-performance GPU kernels underpin modern deep learning and scientific computing. As workloads become increasingly diverse and GPU hardware evolves rapidly, developing efficient methods for automated GPU kernel generation and optimization has become increasingly important. Existing LLM-based methods typically optimize within a fixed implementation space, limiting either optimization flexibility or search efficiency. We propose \textsc{HIERA}, a hierarchical search-space planning framework for GPU kernel optimization. \textsc{HIERA} constructs contract-augmented task specifications, selects an appropriate implementation space across PyTorch operators, CUDA libraries, and custom CUDA kernels, and uses profiling feedback and expert knowledge to guide structured iterative refinement. Experiments on KernelBench across multiple various workload levels and base LLMs show that \textsc{HIERA} delivers stronger overall implementation validity, sample efficiency, and optimization performance than existing training-free methods, while remaining competitive with the training-based CUDA-L1 without additional model training. A case study on a specialized stencil operator from scientific computing further achieves a \(1.53\times\) speedup over cuDNN, demonstrating the potentiality of the general framework beyond standard machine-learning workloads.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。