arXiv:2608.26110cs.DCcs.AI2026-08综述被引 2

LLMs能辅助高性能计算编程,但离替代专家还远。

Exploring the Role of LLMs in HPC Programming: A Survey

论文配图:Exploring the Role of LLMs in HPC Programming: A Survey
图 1 · 摘自论文原文
  • 用微调和检索增强生成提升专用模型代码准确率
  • 通用模型在串行任务表现尚可,分布式任务易出错
  • 适合初学者入门与原型开发,不适用于生产级要求

大型语言模型(LLMs)正成为高性能计算(HPC)中的有力助手,该综述系统分析其在代码生成、并行化与优化、框架与架构、评估与基准测试以及更广泛挑战等五个方面的应用。结果显示,通用模型在串行和OpenMP类任务中表现合理,但在MPI等分布式范式下因正确性与可扩展性要求而表现不足。领域专用模型(如HPC-Coder、HPC-GPT、chatHPC)通过微调、精选数据集和检索增强生成(RAG)实现更高准确率,但覆盖范围有限,评估多局限于基准或微内核。总体而言,LLMs可降低入门门槛、加速原型设计与支持代码现代化,但在生产级场景中仍显脆弱,无法保障正确性、性能可移植性和可扩展性。未来需构建更丰富数据集、集成性能分析与调度器、建立严格评估框架与治理机制。AI与HPC的融合是长期共演过程,每一步进步都带来新挑战与机遇。

原文摘要 · Abstract (English)

Large Language Models (LLMs) are emerging as promising assistants in High-Performance Computing (HPC), where programming remains complex and expertise-intensive. This survey systematically reviews their application across five categories: code generation, parallelization and optimization, frameworks and architectures, evaluation and benchmarking, and broader challenges. The analysis highlights both opportunities and limitations: while general-purpose LLMs perform reasonably well on serial and OpenMP-like tasks, they fall short in distributed paradigms such as MPI, where correctness and scalability are critical. Domain-specialized models (e.g., HPC-Coder, HPC-GPT, chatHPC) achieve higher accuracy through fine-tuning, curated datasets, and retrieval-augmented generation (RAG), yet their scope remains narrow and their evaluations largely limited to benchmarks or micro-kernels. The broader picture is one of dual potential and fragility: LLMs can lower barriers to entry, accelerate prototyping, and support code modernization, but they remain brittle under production-level requirements where correctness, performance portability, and scaling cannot be compromised. We conclude that LLMs are unlikely to replace HPC experts in the near term but are positioned to become powerful collaborators in the software development pipeline. Their effective deployment will require richer datasets, integration with performance analysis and schedulers, rigorous evaluation frameworks, and governance structures that ensure transparency and trust. The convergence of AI and HPC should therefore be understood as a long-term, co-evolutionary process, where each advance uncovers new challenges and opportunities for reshaping scientific software development.

HPC大模型编程辅助代码生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。