用安全过滤器让智能供暖系统高效节能,还能配合电网调度需求。
Safe Deep Reinforcement Learning for Building Heating Control and Demand-side Flexibility

- 引入实时自适应安全滤波器,确保控制策略符合电网灵活性要求。
- 相比规则控制器节能最高达50%,且能源与成本表现优于纯强化学习方法。
- 适合关注建筑节能与电网协同的智能控制研究者或工程师。
建筑占全球能源消耗约40%,随着间歇性可再生能源比例上升,提升建筑供暖系统的需方灵活性对电网稳定和能效至关重要。本文提出一种基于深度强化学习的安全控制框架,优化建筑空间供暖,同时支持电力系统运营商的需方灵活性需求。采用深度确定性策略梯度算法,使控制器在与建筑热模型交互中学习最优加热策略,兼顾用户舒适度、最低能耗成本及灵活性供给。为解决强化学习的安全隐患,尤其是对灵活性指令的合规性问题,提出实时自适应安全滤波器,确保系统在提供灵活性时始终满足预设约束。该方法实现对电网灵活性请求的完全合规,能源与成本效率显著提升,相比规则控制器最高节能50%,且优于独立强化学习控制器,仅小幅增加舒适度偏差。
原文摘要 · Abstract (English)
Buildings account for approximately 40% of global energy consumption, and with the growing share of intermittent renewable energy sources, enabling demand-side flexibility, particularly in heating, ventilation and air conditioning systems, is essential for grid stability and energy efficiency. This paper presents a safe deep reinforcement learning-based control framework to optimize building space heating while enabling demand-side flexibility provision for power system operators. A deep deterministic policy gradient algorithm is used as the core deep reinforcement learning method, enabling the controller to learn an optimal heating strategy through interaction with the building thermal model while maintaining occupant comfort, minimizing energy cost, and providing flexibility. To address safety concerns with reinforcement learning, particularly regarding compliance with flexibility requests, we propose a real-time adaptive safety-filter to ensure that the system operates within predefined constraints during demand-side flexibility provision. The proposed real-time adaptive safety filter guarantees full compliance with flexibility requests from system operators and improves energy and cost efficiency -- achieving up to 50% savings compared to a rule-based controller -- while outperforming a standalone deep reinforcement learning-based controller in energy and cost metrics, with only a slight increase in comfort temperature violations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。