用流模型统一修复电网数据中的噪声与缺失,提升系统可靠性。
CINDI: Conditional Imputation and Noisy Data Integrity with Flows in Power Grid Data
- 基于条件归一化流建模数据联合分布,端到端完成异常检测与修复。
- 在挪威电网真实数据上,修复后误差降低23.7%,优于主流方法。
- 适合电力系统、工业时序等关键基础设施的数据清洗场景。
现实世界中的多变量时间序列,尤其是电力电网等关键基础设施数据,常因噪声和异常导致下游任务性能下降。传统数据清洗方法通常分步进行:先用一个模型检测错误,再用另一个模型填补缺失。此类方法难以捕捉数据的完整联合分布,且忽略预测不确定性。本文提出一种无监督概率框架CINDI(Conditional Imputation and Noisy Data Integrity),旨在恢复复杂时间序列的数据完整性。与碎片化方法不同,CINDI将异常检测与数据填补统一为基于条件归一化流的端到端系统,通过精确建模数据的条件似然,识别低概率片段,并迭代采样统计一致的替代值。该方法能有效复用已学信息,同时保留系统的物理与统计特性。我们在挪威某电网运营商的真实负荷数据上进行了评估,结果表明,相较于现有基线方法,CINDI表现更稳健,为噪声环境下的可靠数据维护提供了可扩展解决方案。
原文摘要 · Abstract (English)
Real-world multivariate time series, particularly in critical infrastructure such as electrical power grids, are often corrupted by noise and anomalies that degrade the performance of downstream tasks. Standard data cleaning approaches often rely on disjoint strategies, which involve detecting errors with one model and imputing them with another. Such approaches can fail to capture the full joint distribution of the data and ignore prediction uncertainty. This work introduces Conditional Imputation and Noisy Data Integrity (CINDI), an unsupervised probabilistic framework designed to restore data integrity in complex time series. Unlike fragmented approaches, CINDI unifies anomaly detection and imputation into a single end-to-end system built on conditional normalizing flows. By modeling the exact conditional likelihood of the data, the framework identifies low-probability segments and iteratively samples statistically consistent replacements. This allows CINDI to efficiently reuse learned information while preserving the underlying physical and statistical properties of the system. We evaluate the framework using real-world grid loss data from a Norwegian power distribution operator, though the methodology is designed to generalize to any multivariate time series domain. The results demonstrate that CINDI yields robust performance compared to competitive baselines, offering a scalable solution for maintaining reliability in noisy environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。