对比三种补全电表缺失数据的方法,发现加权平均法最稳定准确。
Large-Scale Evaluation of Advanced Imputation Methods for Missing Values in Smart Meter Data
- 用加权平均、矩阵填充和自编码器三种方法补全数据
- 加权平均在1到168小时缺损下误差最小,且最抗极端情况
- 适合电力公司做负荷分析,尤其关注数据稳定性时
通过先进计量基础设施(AMI)准确采集用电数据对智能电网运行至关重要,尤其用于识别非技术性损耗(NTL)。然而实际数据常因通信故障出现缺失。本文针对北马其顿17,428个商业电表两年的真实数据,大规模评估了三种先进填补算法:最优加权平均(OWA)、基于SoftImpute的低秩矩阵补全,以及形状建模自编码器。通过模拟1至168小时连续数据缺失,评估各方法鲁棒性。结果表明,OWA在所有缺损时长下均呈现最低重建误差,并在长达一周的缺失场景中表现最强稳定性;自编码器方差较大,SoftImpute虽稳定但精度较差。研究提示应根据负荷曲线特征选择补全方法,并支持未来采用混合算法架构提升电网管理能力。
原文摘要 · Abstract (English)
Accurate and reliable collection of electricity consumption data through Advanced Metering Infrastructure (AMI) is of great importance for the operation of smart grids, especially for the detection of non-technical losses (NTL). However, real-world datasets frequently suffer from missing values due to communication failures. This paper presents an empirical evaluation of three advanced algorithms for large-scale data imputation: the Optimally Weighted Average (OWA) method, Low-Rank Matrix Completion via SoftImpute, and a Shape-Modeling Autoencoder. Existing studies on missing value imputation in electricity consumption data often lack validation on larger datasets. Therefore, the goal of this paper is to validate the selected algorithms on a large-scale real-world electricity consumption dataset from North Macedonia that includes 17,428 commercial smart meters over two years. The robustness of each algorithm is evaluated by simulating continuous gaps in the data ranging from 1 to 168 hours. The results indicate that OWA provides the lowest overall reconstruction error across the evaluated gap sizes and strong stability in worst-case scenarios for gaps of up to one week. In contrast, the autoencoder exhibits higher variance, while SoftImpute has stable but inferior accuracy. These findings suggest that imputation methods should be selected based on the characteristics of load curve data and highlight the potential for hybrid algorithmic architectures in future grid management systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。