用深度强化学习让家庭能源系统动态适配用户偏好,兼顾节能与舒适。
Integration of Multi-Mode Preference into Home Energy Management System Using Deep Reinforcement Learning
- 基于无模型强化学习,动态捕捉用户对不同电器的偏好模式。
- 在真实15分钟数据上实现近最优节能,计算效率优于传统方法。
- 适合关注智能家居节能与个性化体验的研究者和开发者。
家庭能源管理系统(HEMS)是智慧家庭生态中的关键工具,旨在提升能效、降低能耗成本并改善用户舒适度。现有研究常将用户舒适度简化为设备设定值的固定偏差,并通过静态权重纳入优化目标,忽略了用户行为与偏好的动态性。本文提出一种基于深度强化学习的多模式HEMS框架(DRL-HEMS),通过动态、用户自定义的偏好模式优化家庭能源使用。采用无模型单智能体DRL算法,在真实世界15分钟粒度数据(含电价、环境温度、电器功耗等)上验证,结果表明该模型在不同偏好模式下均显著优化了能源消耗。相较于基于混合整数线性规划(MILP)的传统算法,本模型达到近乎最优性能,且计算效率更高。
原文摘要 · Abstract (English)
Home Energy Management Systems (HEMS) have emerged as a pivotal tool in the smart home ecosystem, aiming to enhance energy efficiency, reduce costs, and improve user comfort. By enabling intelligent control and optimization of household energy consumption, HEMS plays a significant role in bridging the gap between consumer needs and energy utility objectives. However, much of the existing literature construes consumer comfort as a mere deviation from the standard appliance settings. Such deviations are typically incorporated into optimization objectives via static weighting factors. These factors often overlook the dynamic nature of consumer behaviors and preferences. Addressing this oversight, our paper introduces a multi-mode Deep Reinforcement Learning-based HEMS (DRL-HEMS) framework, meticulously designed to optimize based on dynamic, consumer-defined preferences. Our primary goal is to augment consumer involvement in Demand Response (DR) programs by embedding dynamic multi-mode preferences tailored to individual appliances. In this study, we leverage a model-free, single-agent DRL algorithm to deliver a HEMS framework that is not only dynamic but also user-friendly. To validate its efficacy, we employed real-world data at 15-minute intervals, including metrics such as electricity price, ambient temperature, and appliances' power consumption. Our results show that the model performs exceptionally well in optimizing energy consumption within different preference modes. Furthermore, when compared to traditional algorithms based on Mixed-Integer Linear Programming (MILP), our model achieves nearly optimal performance while outperforming in computational efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。