Helios模型专攻智能能源领域,解决通用大模型知识不足问题。
Helios: A Foundational Language Model for Smart Energy Knowledge Reasoning and Application
- 构建多智能体框架Enersys,自动生成专业数据集
- 在能源知识库和指令数据上训练,准确率显著提升
- 适合能源工程、政策制定者及研究者使用
在全球迈向碳中和的进程中,高度协同的智能能源系统是产业转型的核心。然而,该领域跨学科、碎片化且快速演进的知识体系,导致通用大语言模型因缺乏领域知识与物理约束意识,难以实现精准的工程推理与生成。为此,我们提出针对智能能源领域的专用大模型Helios,以及一套完整的资源体系以推动该领域LLM研究。具体而言,我们开发了多智能体协作框架Enersys,用于端到端数据集构建,产出:(1) 智能能源知识库EnerBase,增强模型基础认知;(2) 指令微调数据集EnerInstruct,提升特定任务表现;(3) 基于强化学习的人类反馈数据集EnerReinforce,使模型更符合人类偏好与行业标准。基于这些资源,Helios完成大规模预训练、监督微调与强化学习对齐。我们还发布了评估基准EnerBench,实验表明该方法显著提升了模型在领域知识掌握、任务执行准确率与人类偏好对齐方面的能力。
原文摘要 · Abstract (English)
In the global drive toward carbon neutrality, deeply coordinated smart energy systems underpin industrial transformation. However, the interdisciplinary, fragmented, and fast-evolving expertise in this domain prevents general-purpose LLMs, which lack domain knowledge and physical-constraint awareness, from delivering precise engineering-aligned inference and generation. To address these challenges, we introduce Helios, a large language model tailored to the smart energy domain, together with a comprehensive suite of resources to advance LLM research in this field. Specifically, we develop Enersys, a multi-agent collaborative framework for end-to-end dataset construction, through which we produce: (1) a smart energy knowledge base, EnerBase, to enrich the model's foundational expertise; (2) an instruction fine-tuning dataset, EnerInstruct, to strengthen performance on domain-specific downstream tasks; and (3) an RLHF dataset, EnerReinforce, to align the model with human preferences and industry standards. Leveraging these resources, Helios undergoes large-scale pretraining, SFT, and RLHF. We also release EnerBench, a benchmark for evaluating LLMs in smart energy scenarios, and demonstrate that our approach significantly enhances domain knowledge mastery, task execution accuracy, and alignment with human preferences.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。