arXiv:2505.03790cs.LGcs.AI2025-05被引 3

融合扩散模型与Transformer,生成高质量时序数据。

A Time-Series Data Augmentation Model through Diffusion and Transformer Integration

  • 用改进的扩散模型生成初始时序动作数据,再由Transformer预测后续动作。
  • 加入加权损失函数使模型收敛,生成数据在性能提升上优于传统方法。
  • 适合需要大量高质量时序数据的场景,如医疗、金融时间序列建模。

随着人工智能的发展,深度学习已广泛应用于各类实际任务。为实现最佳性能,深度神经网络通常需要大量数据训练。尽管数据增强技术进步帮助获取大规模数据集,但多数集中在图像和语音领域,时序数据增强仍相对不足。为此,本文提出一种简单有效的时序数据增强方法,结合扩散模型与Transformer:先利用调整后的扩散去噪模型生成大量初始时间步动作数据,再通过Transformer模型预测后续动作,并引入加权损失函数以实现收敛。以应用增强数据后模型性能提升为基准,对比无数据增强或传统增强方法的结果,该方法展现出生成高质量时序数据的能力。

原文摘要 · Abstract (English)

With the development of Artificial Intelligence, numerous real-world tasks have been accomplished using technology integrated with deep learning. To achieve optimal performance, deep neural networks typically require large volumes of data for training. Although advances in data augmentation have facilitated the acquisition of vast datasets, most of this data is concentrated in domains like images and speech. However, there has been relatively less focus on augmenting time-series data. To address this gap and generate a substantial amount of time-series data, we propose a simple and effective method that combines the Diffusion and Transformer models. By utilizing an adjusted diffusion denoising model to generate a large volume of initial time-step action data, followed by employing a Transformer model to predict subsequent actions, and incorporating a weighted loss function to achieve convergence, the method demonstrates its effectiveness. Using the performance improvement of the model after applying augmented data as a benchmark, and comparing the results with those obtained without data augmentation or using traditional data augmentation methods, this approach shows its capability to produce high-quality augmented data.

时序数据扩散模型Transformer数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。