对比传统与强化学习在储能控制中的表现，揭示适用场景差异。
Comparing Traditional and Reinforcement-Learning Methods for Energy Storage Control
- 构建简化微电网模型，分三类复杂度比较控制方法
- 强化学习策略在理想与损耗场景下均存在性能损失
- 适合需快速部署的场景使用传统方法，研究新算法时用强化学习
本文旨在深入理解传统方法与强化学习（RL）在能源存储管理中的权衡。具体而言，研究生成式强化学习策略相较于传统方法在特定实例中寻找最优控制策略时带来的性能损失。基于包含负载、光伏电源和储能设备的简化微电网模型，分析三种复杂度递增的应用场景：理想储能与凸成本函数、有损耗的储能设备、以及含凸传输损耗的有损耗储能设备。为推动该关键领域中基于强化学习方法的合理应用，本文详细阐述了每种场景的建模方式与优化挑战，并系统比较了传统方法与强化学习的性能表现，讨论了各自优势适用场景，提出未来研究方向。
原文摘要 · Abstract (English)
We aim to better understand the tradeoffs between traditional and reinforcement learning (RL) approaches for energy storage management. More specifically, we wish to better understand the performance loss incurred when using a generative RL policy instead of using a traditional approach to find optimal control policies for specific instances. Our comparison is based on a simplified micro-grid model, that includes a load component, a photovoltaic source, and a storage device. Based on this model, we examine three use cases of increasing complexity: ideal storage with convex cost functions, lossy storage devices, and lossy storage devices with convex transmission losses. With the aim of promoting the principled use RL based methods in this challenging and important domain, we provide a detailed formulation of each use case and a detailed description of the optimization challenges. We then compare the performance of traditional and RL methods, discuss settings in which it is beneficial to use each method, and suggest avenues for future investigation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。