构建大规模真实空调控制基准,提升强化学习泛化能力
Building2Building: A Large Scale Benchmark for Generalizable Real-World Reinforcement Learning

- 基于EnergyPlus生成多样化建筑环境,支持动态、观测、动作空间变化
- 涵盖目标迁移、跨域转移等挑战任务,验证策略泛化性
- 适合研究强化学习通用性与智能楼宇节能应用的学者与工程师
强化学习在控制任务中表现强劲,但对动力学、动作空间、观测空间或目标的变化仍显脆弱,制约其在真实世界的应用。现有基准多样性与复杂度有限,难以系统研究迁移、多任务学习与元学习。我们提出Building2Building(B2B),一个基于EnergyPlus建筑模拟器构建的大规模暖通空调(HVAC)控制基准环境套件。该套件完全兼容Gymnasium接口,配备参数化建筑生成器,可系统生成具有异构观测与动作空间的多样化建筑配置。基于此套件,我们定义了针对强化学习关键挑战的任务,包括目标适应、动力学适应、动作空间变化及跨域迁移。B2B提供大规模、多样化且物理真实的测试平台,具备标准化评估协议,可系统研究连续控制中的泛化与迁移问题。除推动强化学习泛化研究外,该基准还具有显著社会价值,有助于实现建筑级高效空调控制,降低能源消耗。
原文摘要 · Abstract (English)
Reinforcement learning (RL) has achieved strong results in control, yet learned policies remain brittle to changes in dynamics, action spaces, observation spaces, or goals, a critical limitation for real-world deployment. Existing benchmarks offer limited diversity and complexity, making it difficult to rigorously study transfer, multi-task learning, and meta-learning in RL. We introduce Building2Building (B2B), a large-scale suite of realistic Heating, Ventilation, and Air Conditioning (HVAC) control environments built on EnergyPlus, a state-of-the-art building simulator. B2B is fully compatible with the Gymnasium interface and features a parametric building generator, enabling the systematic generation of diverse building configurations with heterogeneous observation and action spaces. Based on this suite, we define benchmark tasks targeting key open challenges in RL, including goal adaptation, dynamics adaptation, action-space shifts, and cross-domain transfer. By providing a large-scale, diverse, and physically grounded testbed with standardized evaluation protocols, B2B enables systematic investigation of generalization and transfer in continuous control. Beyond advancing research on generalization in RL, this new benchmark also carries significant societal implications by enabling improved HVAC control at scale, one of the most energy-intensive systems in buildings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。