专为高性能计算并行代码优化的开源模型，性能领先。
HPC-Coder-V2: Studying Code LLMs Across Low-Resource Parallel Languages
- 针对高并发编程场景微调专用代码大模型。
- 在并行代码生成任务上达到当前开源模型最佳表现。
- 适合需要高效编写并行计算代码的研究者使用。
基于大语言模型（LLM）的编程辅助工具在通用编程任务中表现卓越，但在高性能计算（HPC）等专业领域仍表现不佳。尽管已有研究尝试构建面向HPC的专用模型，但现有模型在生成并行代码方面依然困难重重，其根本障碍尚不明确。本文从多个维度深入研究了专用HPC LLM的微调过程，揭示了关键挑战。基于研究发现，我们训练并评估了一款专用HPC LLM，该模型在并行代码生成任务上成为迄今性能最优的开源代码大模型。
原文摘要 · Abstract (English)
Large Language Model (LLM) based coding tools have been tremendously successful as software development assistants, yet they are often designed for general purpose programming tasks and perform poorly for more specialized domains such as high performance computing. Creating specialized models and tools for these domains is crucial towards gaining the benefits of LLMs in areas such as HPC. While previous work has explored HPC-specific models, LLMs still struggle to generate parallel code and it is not at all clear what hurdles are still holding back these LLMs and what must be done to overcome them. In this work, we conduct an in-depth study along the many axes of fine-tuning a specialized HPC LLM in order to better understand the challenges. Based on our findings we fine-tune and evaluate a specialized HPC LLM that is shown to be the best performing open-source code LLM for parallel code generation to date.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。