用图神经网络自动设计高效热力循环,发现性能更优的新结构。
Automated co-design of high-performance thermodynamic cycles via graph-based hierarchical reinforcement learning
- 将热力循环建模为带约束的图结构,分层强化学习协同优化结构与参数。
- 发现18种新型热泵和21种新型热机循环,性能提升达4.6%至133.3%。
- 适合能源系统设计、智能优化方向研究者,可替代人工经验设计。
热力循环是决定能量转换系统效率的核心。传统设计依赖专家知识或穷举法,效率低且难以扩展,限制了高性能循环的发现。本文提出一种基于图的分层强化学习方法,用于热力循环的结构与参数协同设计。循环被编码为图,组件与连接分别表示为节点与边,并遵循语法规则。基于深度学习的热物性代理模型实现稳定图解码并同步求解全局参数。在此基础上,构建分层强化学习框架:高层管理器探索结构演化并生成候选配置,底层工作者优化参数并提供性能奖励以引导搜索至高性能区域。通过图表示、热物性代理与管理-工作协同学习的融合,该方法建立从编码、解码到协同优化的全自动流程。以热泵和热机循环为例,结果表明该方法不仅能复现经典循环,还分别发现18种和21种新型循环,相对经典循环性能提升4.6%和133.3%,显著优于传统设计。该方法有效平衡效率与普适性,为专家驱动的设计提供了一种实用且可扩展的智能化替代方案。
原文摘要 · Abstract (English)
Thermodynamic cycles are pivotal in determining the efficacy of energy conversion systems. Traditional design methodologies, which rely on expert knowledge or exhaustive enumeration, are inefficient and lack scalability, thereby constraining the discovery of high-performance cycles. In this study, we introduce a graph-based hierarchical reinforcement learning approach for the co-design of structure parameters in thermodynamic cycles. These cycles are encoded as graphs, with components and connections depicted as nodes and edges, adhering to grammatical constraints. A deep learning-based thermophysical surrogate facilitates stable graph decoding and the simultaneous resolution of global parameters. Building on this foundation, we develop a hierarchical reinforcement learning framework wherein a high-level manager explores structural evolution and proposes candidate configurations, whereas a low-level worker optimizes parameters and provides performance rewards to steer the search towards high-performance regions. By integrating graph representation, thermophysical surrogate, and manager-worker learning, this method establishes a fully automated pipeline for encoding, decoding, and co-optimization. Using heat pump and heat engine cycles as case studies, the results demonstrate that the proposed method not only replicates classical cycle configurations but also identifies 18 and 21 novel heat pump and heat engine cycles, respectively. Relative to classical cycles, the novel configurations exhibit performance improvements of 4.6% and 133.3%, respectively, surpassing the traditional designs. This method effectively balances efficiency with broad applicability, providing a practical and scalable intelligent alternative to expert-driven thermodynamic cycle design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。