arXiv:2410.04703cs.LGstat.ML2024-10被引 4

用傅里叶域直接建模时间序列,更紧凑高效。

Neural Fourier Modelling: A Highly Compact Approach to Time-Series Analysis

  • 在傅里叶域直接建模时间序列,利用频率插值与外推作为核心机制。
  • 参数少于4万,在100到16000长度序列上实现顶尖性能。
  • 适合需要轻量级、泛化性强的时序分析场景。

传统神经时间序列分析多在时域建模,部分方法仅将傅里叶域作为辅助频谱特征。本文将焦点转向频率表示,提出完全在傅里叶域建模时间序列的 Neural Fourier Modelling (NFM)。NFM 基于傅里叶变换的两个关键性质:(i) 将有限长度时序视为傅里叶域中的连续函数,嵌入函数空间;(ii) 在傅里叶域内实现重采样与时长扩展等数据操作。我们将这些操作重新诠释为频率外推与插值,并将其作为核心学习机制应用于多种任务。为此设计两个模块:可学习频率令牌(LFT)和隐式神经傅里叶滤波器(INFF),支持灵活频率扩展与有效频域调制。大量实验表明,NFM 在预测、异常检测与分类等任务上达到当前最优表现,包括测试时出现前所未见采样率的挑战性场景。且模型高度紧凑,每项任务参数少于40,000,适用时序长度从100至16,000。

原文摘要 · Abstract (English)

Neural time-series analysis has traditionally focused on modeling data in the time domain, often with some approaches incorporating equivalent Fourier domain representations as auxiliary spectral features. In this work, we shift the main focus to frequency representations, modeling time-series data fully and directly in the Fourier domain. We introduce Neural Fourier Modelling (NFM), a compact yet powerful solution for time-series analysis. NFM is grounded in two key properties of the Fourier transform (FT): (i) the ability to model finite-length time series as functions in the Fourier domain, treating them as continuous-time elements in function space, and (ii) the capacity for data manipulation (such as resampling and timespan extension) within the Fourier domain. We reinterpret Fourier-domain data manipulation as frequency extrapolation and interpolation, incorporating this as a core learning mechanism in NFM, applicable across various tasks. To support flexible frequency extension with spectral priors and effective modulation of frequency representations, we propose two learning modules: Learnable Frequency Tokens (LFT) and Implicit Neural Fourier Filters (INFF). These modules enable compact and expressive modeling in the Fourier domain. Extensive experiments demonstrate that NFM achieves state-of-the-art performance on a wide range of tasks (forecasting, anomaly detection, and classification), including challenging time-series scenarios with previously unseen sampling rates at test time. Moreover, NFM is highly compact, requiring fewer than 40K parameters in each task, with time-series lengths ranging from 100 to 16K.

时间序列傅里叶域轻量建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。