提出新方法填补时空数据缺失,精度高且算力消耗少
RDPI: A Refine Diffusion Probability Generation Method for Spatiotemporal Data Imputation
- 先用确定性方法初估缺失值,再以残差为目标精修
- 在多个数据集上达到当前最好精度,采样计算成本显著降低
- 适合交通、气象等需高效精准补全时空数据的场景
时空数据补全是交通流量监测、空气质量评估和气候预测等领域的重要任务。然而,传感器采集的时空数据常因时间不完整及空间分布稀疏不均导致缺失。现有方法中,自回归模型易产生误差累积,而简单条件扩散模型难以充分捕捉观测与缺失数据间的时空关系。为此,我们提出一种基于初始网络与条件扩散模型的两阶段精修扩散概率补全(RDPI)框架。第一阶段使用确定性方法生成缺失数据的初步估计;第二阶段将残差作为扩散目标,并创新性地将观测值融入前向过程,构建更适配时空数据补全的条件扩散模型,有效缩小初估值与真实值之间的差距。在多个数据集上的实验表明,RDPI不仅实现了最先进的补全精度,还显著降低了采样计算成本。
原文摘要 · Abstract (English)
Spatiotemporal data imputation plays a crucial role in various fields such as traffic flow monitoring, air quality assessment, and climate prediction. However, spatiotemporal data collected by sensors often suffer from temporal incompleteness, and the sparse and uneven distribution of sensors leads to missing data in the spatial dimension. Among existing methods, autoregressive approaches are prone to error accumulation, while simple conditional diffusion models fail to adequately capture the spatiotemporal relationships between observed and missing data. To address these issues, we propose a novel two-stage Refined Diffusion Probability Impuation (RDPI) framework based on an initial network and a conditional diffusion model. In the initial stage, deterministic imputation methods are used to generate preliminary estimates of the missing data. In the refinement stage, residuals are treated as the diffusion target, and observed values are innovatively incorporated into the forward process. This results in a conditional diffusion model better suited for spatiotemporal data imputation, bridging the gap between the preliminary estimates and the true values. Experiments on multiple datasets demonstrate that RDPI not only achieves state-of-the-art imputation accuracy but also significantly reduces sampling computational costs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。