arXiv:2512.06932cs.LGcs.AI2025-12被引 5

LSTM时间序列预测中,数据泄露可导致评估结果虚高,尤其在交叉验证时风险显著。

Hidden Leaks in Time Series Forecasting: How Data Leakage Affects LSTM Evaluation Across Configurations and Validation Strategies

  • 先分数据再构造序列,避免未来信息泄露训练集
  • 10折交叉验证在长滞后步下泄露率最高达20.5%
  • 小输入窗口和长滞后步会加剧泄露风险,需警惕

深度学习模型,尤其是长短期记忆(LSTM)网络,因其能捕捉复杂的时间依赖性而广泛应用于时间序列预测。然而,评估的可靠性常因数据泄露而受损——即在数据集划分前就构建输入输出序列,导致未来信息无意中影响训练。本研究探讨了数据泄露对性能的影响,重点分析验证策略如何调节泄露敏感性。对比了三种常用验证方法(两路分割、三路分割、10折交叉验证)在有泄漏(预分割序列生成)与无泄漏(划分后按时间顺序构造序列)条件下的表现。通过计算RMSE Gain(即泄露与清洁设置下RMSE的相对增长百分比)评估影响。实证结果表明,10折交叉验证在长滞后步下最大RMSE Gain达20.5%;而两路和三路分割则更稳健,通常保持在5%以下。此外,输入窗口大小与滞后步长显著影响泄露敏感度:窗口越小、滞后越长,泄露风险越高;反之,大窗口有助于降低风险。研究强调必须建立配置感知、抗泄露的评估流程,以确保性能估计的可靠性。

原文摘要 · Abstract (English)

Deep learning models, particularly Long Short-Term Memory (LSTM) networks, are widely used in time series forecasting due to their ability to capture complex temporal dependencies. However, evaluation integrity is often compromised by data leakage, a methodological flaw in which input-output sequences are constructed before dataset partitioning, allowing future information to unintentionally influence training. This study investigates the impact of data leakage on performance, focusing on how validation design mediates leakage sensitivity. Three widely used validation techniques (2-way split, 3-way split, and 10-fold cross-validation) are evaluated under both leaky (pre-split sequence generation) and clean conditions, with the latter mitigating leakage risk by enforcing temporal separation during data splitting prior to sequence construction. The effect of leakage is assessed using RMSE Gain, which measures the relative increase in RMSE caused by leakage, computed as the percentage difference between leaky and clean setups. Empirical results show that 10-fold cross-validation exhibits RMSE Gain values of up to 20.5% at extended lag steps. In contrast, 2-way and 3-way splits demonstrate greater robustness, typically maintaining RMSE Gain below 5% across diverse configurations. Moreover, input window size and lag step significantly influence leakage sensitivity: smaller windows and longer lags increase the risk of leakage, whereas larger windows help reduce it. These findings underscore the need for configuration-aware, leakage-resistant evaluation pipelines to ensure reliable performance estimation.

时间序列LSTM数据泄露评估验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。