提出时空域联合异常检测方法,提升智能电表数据质量。
Time and Frequency Domain-based Anomaly Detection in Smart Meter Data for Distribution Network Studies
- 结合孤立森林与快速傅里叶变换,同时分析时间与频率域特征。
- 可有效识别点异常和上下文异常,不受数据噪声干扰。
- 适合高比例智能电表的配电网实时监测场景。
低压配电网络中消费者侧新技术的广泛应用,要求配电系统运营商进行先进的实时计算以评估网络状态。近年来,基于机器学习和大数据分析的数据驱动模型被用于利用智能电表及其他先进测量基础设施生成的大规模数据集。然而,现有数据驱动算法未考虑智能电表数据的质量,缺乏内置异常检测机制,无法区分异常值或异常上下文。本文提出一种基于孤立森林和快速傅里叶变换的异常检测框架,可在时间域和频率域协同工作,对主动功率和无功功率数据中的异常具有鲁棒性,不受点异常或上下文异常影响。通过高智能电表覆盖率的配电网分析,验证了集成异常检测方法的重要性。
原文摘要 · Abstract (English)
The widespread integration of new technologies in low-voltage distribution networks on the consumer side creates the need for distribution system operators to perform advanced real-time calculations to estimate network conditions. In recent years, data-driven models based on machine learning and big data analysis have emerged for calculation purposes, leveraging the information available in large datasets obtained from smart meters and other advanced measurement infrastructure. However, existing data-driven algorithms do not take into account the quality of data collected from smart meters. They lack built-in anomaly detection mechanisms and fail to differentiate anomalies based on whether the value or context of anomalous data instances deviates from the norm. This paper focuses on methods for detecting and mitigating the impact of anomalies on the consumption of active and reactive power datasets. It proposes an anomaly detection framework based on the Isolation Forest machine learning algorithm and Fast Fourier Transform filtering that works in both the time and frequency domain and is unaffected by point anomalies or contextual anomalies of the power consumption data. The importance of integrating anomaly detection methods is demonstrated in the analysis important for distribution networks with a high share of smart meters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。