提出新框架揭示时间序列预测中线性模型的系统性偏差。
TimeSynth: A Framework for Uncovering Systematic Biases in Time Series Forecasting
- 构建合成数据框架,模拟真实时间序列的非平稳、周期等特性。
- 线性模型在复杂信号下退化为简单振荡,非线性模型优势明显。
- 适合研究模型鲁棒性与复杂信号适应性的研究人员参考。
时间序列预测应用广泛,但近期争议质疑复杂非线性模型是否真优于简单线性模型。以往结论常源于缺乏多样时序动态且评估协议有偏的基准。我们通过TimeSynth框架重新审视该问题,该框架模拟真实时间序列的关键特性,包括非平稳性、周期性、趋势和相位调制,生成参数源自真实数据的合成信号。评估了四类模型:线性模型、多层感知机(MLP)、卷积神经网络(CNN)和Transformer。结果发现线性模型存在系统性偏差:无论信号复杂度如何,均退化为简单振荡。非线性模型避免此退化,在信号复杂度增加时表现更优。值得注意的是,Transformer和基于CNN的模型对复杂调制信号的适应性略优于MLP。此外,该框架在分布和噪声扰动下揭示了不同模型的鲁棒性差异,并通过为每类信号独立划分训练、测试、验证实例,消除了先前基准的偏差。总体而言,TimeSynth为理解各类预测方法在何种条件下成功或失败提供了原则性基础,超越了模型等效性的简化论断。
原文摘要 · Abstract (English)
Time series forecasting is a fundamental tool with wide ranging applications, yet recent debates question whether complex nonlinear architectures truly outperform simple linear models. Prior claims of dominance of the linear model often stem from benchmarks that lack diverse temporal dynamics and employ biased evaluation protocols. We revisit this debate through TimeSynth, a structured framework that emulates key properties of real world time series,including non-stationarity, periodicity, trends, and phase modulation by creating synthesized signals whose parameters are derived from real-world time series. Evaluating four model families Linear, Multi Layer Perceptrons (MLP), Convolutional Neural Networks (CNNs), and Transformers, we find a systematic bias in linear models: they collapse to simple oscillation regardless of signal complexity. Nonlinear models avoid this collapse and gain clear advantages as signal complexity increases. Notably, Transformers and CNN based models exhibit slightly greater adaptability to complex modulated signals compared to MLPs. Beyond clean forecasting, the framework highlights robustness differences under distribution and noise shifts and removes biases of prior benchmarks by using independent instances for train, test, and validation for each signal family. Collectively, TimeSynth provides a principled foundation for understanding when different forecasting approaches succeed or fail, moving beyond oversimplified claims of model equivalence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。