提出自适应依赖建模的扩散模型,提升时空数据插补精度。
AdaSTI: Conditional Diffusion Models with Adaptive Dependency Modeling for Spatio-Temporal Imputation
- 用双向S4网络预插补,再通过条件器提取时空依赖
- 引入噪声感知注意力机制,动态捕捉不同噪声步的依赖变化
- 在3个真实数据集上误差降低最高达46.4%,适合高精度插补场景
时空数据广泛存在于交通与环境监测等领域,但常因传感器故障或传输失败出现缺失。近年来,基于扩散模型的方法在时空插补任务中表现优异。然而,现有方法在利用时空依赖作为条件信息时存在误差累积问题,且忽略噪声数据中依赖关系随扩散步骤的变化。本文提出AdaSTI(基于扩散模型的自适应时空依赖建模插补方法),其核心为基于双向S4的BiS4PI网络用于预插补,生成结果由设计的时空条件器(STC)提取条件信息;同时提出噪声感知时空(NAST)网络,结合门控注意力机制,捕捉不同扩散步骤下的依赖变异。在三个真实数据集上的大量实验表明,AdaSTI在所有设置下均优于现有方法,插补误差最高降低46.4%。
原文摘要 · Abstract (English)
Spatio-temporal data abounds in domain like traffic and environmental monitoring. However, it often suffers from missing values due to sensor malfunctions, transmission failures, etc. Recent years have seen continued efforts to improve spatio-temporal data imputation performance. Recently diffusion models have outperformed other approaches in various tasks, including spatio-temporal imputation, showing competitive performance. Extracting and utilizing spatio-temporal dependencies as conditional information is vital in diffusion-based methods. However, previous methods introduce error accumulation in this process and ignore the variability of the dependencies in the noisy data at different diffusion steps. In this paper, we propose AdaSTI (Adaptive Dependency Model in Diffusion-based Spatio-Temporal Imputation), a novel spatio-temporal imputation approach based on conditional diffusion model. Inside AdaSTI, we propose a BiS4PI network based on a bi-directional S4 model for pre-imputation with the imputed result used to extract conditional information by our designed Spatio-Temporal Conditionalizer (STC)network. We also propose a Noise-Aware Spatio-Temporal (NAST) network with a gated attention mechanism to capture the variant dependencies across diffusion steps. Extensive experiments on three real-world datasets show that AdaSTI outperforms existing methods in all the settings, with up to 46.4% reduction in imputation error.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。