用自适应域随机化训练通用空调控制器,跨建筑部署更稳定高效。
Generalizing HVAC Control With Domain Randomized Reinforcement Learning

- 基于物理约束的动态域随机化,模拟真实建筑热特性分布。
- 在多区场景下逼近调优过的模型预测控制性能,优于传统PID和普通强化学习。
- 无需建筑模型或现场调参,适合大规模空调系统快速部署。
将先进空调控制器大规模部署仍面临挑战,因性能依赖精确建筑模型或逐场地调参。本文提出NOMAD-RL(神经在线元适应动力学),一种通过通用非侵入式温控接口实现跨异构热区迁移的通用强化学习控制器。该控制器基于区域温度测量与预测调整设定点,采用循环策略支持部分可观测环境下的在线适应。核心贡献在于一种基于物理信息归一化流的自适应域随机化方案,可建模热区参数的关联性与多模态分布,同时保持物理合理性与可控性。该方案生成真实且渐进式适应的训练课程,显著提升跨建筑迁移能力。我们在单区与多区场景中对比了恒定设定点的PID控制器、无域随机化的强化学习以及模型预测控制(MPC)。NOMAD-RL始终优于PID和非随机化强化学习基线,尤其在更具挑战性的多区情况下接近调优后MPC的表现。结果表明,自适应、物理引导的域随机化在实现鲁棒且可迁移的空调控制方面具有潜力。
原文摘要 · Abstract (English)
Deploying advanced HVAC (Heating, Ventilation and Air Conditioning) controllers at scale remains difficult because performance often depends on accurate building models or per-site retuning. We propose NOMAD-RL (Neural Online Meta-Adaptation for Dynamics), a general-purpose Reinforcement Learning (RL) controller designed to transfer across heterogeneous thermal zones through a universal, non-invasive thermostat interface. The controller acts on temperature setpoints from zone measurements and forecasts, while a recurrent policy supports online adaptation under partial observability. Our main contribution is an adaptive domain randomization scheme based on physics-informed normalizing flows, which models correlated and multimodal distributions of thermal-zone parameters while maintaining physical plausibility and controllability. This produces a realistic and progressively adaptive training curriculum that improves transfer across buildings. We evaluate NOMAD-RL against a constant-setpoint PID controller, RL without domain randomization, and MPC in single- and multi-zone settings. NOMAD-RL consistently outperforms the PID and non-randomized RL baselines, and approaches the performance of a well-tuned MPC, especially in the more challenging multi-zone case. These results highlight the potential of adaptive, physics-informed domain randomization for robust and transferable HVAC control.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。