用强化学习优化空调系统,发现气候差异显著影响节能效果。
Reinforcement Learning (RL) Meets Urban Climate Modeling: Investigating the Efficacy and Impacts of RL-Based HVAC Control
- 将强化学习与城市气候模型结合,评估不同气候下的空调控制策略
- 炎热气候下节能与舒适度平衡的奖励值更高,温差大地区策略更易迁移
- 为跨城市部署智能空调系统提供新思路,强调气候适应性测试
基于强化学习(RL)的供暖、通风与空调(HVAC)控制技术有望降低建筑能耗并维持室内热舒适性。然而,该策略的有效性受背景气候影响,且其实施可能改变室内及局部城市气候。本研究提出一个整合框架,融合建筑能耗模型与城市气候模型,评估不同气候背景下RL空调控制的效能、对室内外气候的影响以及策略在城市间的可迁移性。结果表明,奖励值(能量消耗与热舒适性的加权组合)及策略对气候的影响在不同气候城市间存在显著差异。奖励权重敏感性和策略迁移能力也强烈依赖于背景气候。炎热气候城市在多数能量-舒适度权衡配置下获得更高奖励,大气温度变化较大的城市表现出更强的策略迁移能力。研究强调需在多样化气候条件下全面评估基于RL的空调控制策略,并提出城市间学习有望助力该技术的推广应用。
原文摘要 · Abstract (English)
Reinforcement learning (RL)-based heating, ventilation, and air conditioning (HVAC) control has emerged as a promising technology for reducing building energy consumption while maintaining indoor thermal comfort. However, the efficacy of such strategies is influenced by the background climate and their implementation may potentially alter both the indoor climate and local urban climate. This study proposes an integrated framework combining RL with an urban climate model that incorporates a building energy model, aiming to evaluate the efficacy of RL-based HVAC control across different background climates, impacts of RL strategies on indoor climate and local urban climate, and the transferability of RL strategies across cities. Our findings reveal that the reward (defined as a weighted combination of energy consumption and thermal comfort) and the impacts of RL strategies on indoor climate and local urban climate exhibit marked variability across cities with different background climates. The sensitivity of reward weights and the transferability of RL strategies are also strongly influenced by the background climate. Cities in hot climates tend to achieve higher rewards across most reward weight configurations that balance energy consumption and thermal comfort, and those cities with more varying atmospheric temperatures demonstrate greater RL strategy transferability. These findings underscore the importance of thoroughly evaluating RL-based HVAC control strategies in diverse climatic contexts. This study also provides a new insight that city-to-city learning will potentially aid the deployment of RL-based HVAC control.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。