用扩散模型捕捉时间动态,生成更连贯的时序预测结果。
Dynamical Diffusion: Learning Temporal Dynamics with Diffusion Models
- 设计时序感知的前向与逆向过程,显式建模每步的时间转移。
- 在科学时空预测、视频与时间序列任务中均提升性能。
- 适合需要高时序一致性的生成建模研究者。
扩散模型通过逐步加噪与逆向去噪实现强大生成能力,已在多任务多模态中表现优异,但在时序预测学习中的应用仍不充分。现有方法将预测视为条件生成问题,却未能充分利用数据中的内在时序动态,导致生成序列时序不连贯。为此,我们提出动态扩散(Dynamical Diffusion, DyDiff),一个理论严谨的框架,引入时序感知的前向与逆向过程。该框架在每一步扩散中显式建模时间转移,建立对先前状态的依赖关系,以更好捕捉时序动态。通过重参数化技巧,DyDiff实现与标准扩散模型相当的高效训练与推理。在科学时空预测、视频预测和时间序列预测等多个任务上的广泛实验表明,DyDiff持续提升时序预测性能,填补了现有方法的关键空白。代码已开源:https://github.com/thuml/dynamical-diffusion。
原文摘要 · Abstract (English)
Diffusion models have emerged as powerful generative frameworks by progressively adding noise to data through a forward process and then reversing this process to generate realistic samples. While these models have achieved strong performance across various tasks and modalities, their application to temporal predictive learning remains underexplored. Existing approaches treat predictive learning as a conditional generation problem, but often fail to fully exploit the temporal dynamics inherent in the data, leading to challenges in generating temporally coherent sequences. To address this, we introduce Dynamical Diffusion (DyDiff), a theoretically sound framework that incorporates temporally aware forward and reverse processes. Dynamical Diffusion explicitly models temporal transitions at each diffusion step, establishing dependencies on preceding states to better capture temporal dynamics. Through the reparameterization trick, Dynamical Diffusion achieves efficient training and inference similar to any standard diffusion model. Extensive experiments across scientific spatiotemporal forecasting, video prediction, and time series forecasting demonstrate that Dynamical Diffusion consistently improves performance in temporal predictive tasks, filling a crucial gap in existing methodologies. Code is available at this repository: https://github.com/thuml/dynamical-diffusion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。