arXiv:2410.19538cs.LGcs.CV2024-10NeurIPS被引 60

将时间序列转为图像,用扩散模型统一生成长短序列。

Utilizing Image Transforms and Diffusion Models for Generative Modeling of Short and Long Time Series

  • 把序列转成图像,用现成的视觉扩散模型处理
  • 短序列生成得分提升58.17%,超长序列分类得分提升132.61%
  • 适合需要统一处理长短序列的研究者

近期时间序列生成建模备受关注。现有方法通常仅适用于短序列或长序列,这源于循环网络的梯度问题、Transformer的计算成本以及状态空间模型表达力有限。为此,本文提出将时间序列通过可逆变换(如延迟嵌入、短时傅里叶变换)转化为图像,从而实现三个优势:一、可利用先进的扩散视觉模型;二、在统一框架内高效处理短/长序列;三、可复用时序转图像领域的成熟工具。我们在多个任务上进行验证,包括无条件生成、插值和外推。结果表明,该方法在多项指标上达到领先水平:无条件生成任务中,短序列判别得分相比先前扩散模型平均提升58.17%,(超)长序列分类得分提升132.61%。代码已开源。

原文摘要 · Abstract (English)

Lately, there has been a surge in interest surrounding generative modeling of time series data. Most existing approaches are designed either to process short sequences or to handle long-range sequences. This dichotomy can be attributed to gradient issues with recurrent networks, computational costs associated with transformers, and limited expressiveness of state space models. Towards a unified generative model for varying-length time series, we propose in this work to transform sequences into images. By employing invertible transforms such as the delay embedding and the short-time Fourier transform, we unlock three main advantages: i) We can exploit advanced diffusion vision models; ii) We can remarkably process short- and long-range inputs within the same framework; and iii) We can harness recent and established tools proposed in the time series to image literature. We validate the effectiveness of our method through a comprehensive evaluation across multiple tasks, including unconditional generation, interpolation, and extrapolation. We show that our approach achieves consistently state-of-the-art results against strong baselines. In the unconditional generation tasks, we show remarkable mean improvements of 58.17% over previous diffusion models in the short discriminative score and 132.61% in the (ultra-)long classification scores. Code is at https://github.com/azencot-group/ImagenTime.

时间序列生成扩散模型图像转换

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。