arXiv:2409.13181cs.LG2024-09被引 4

用迁移学习和小波增强解决小运营商流量预测数据少问题

Overcoming Data Limitations in Internet Traffic Forecasting: LSTM Models with Transfer Learning and Wavelet Augmentation

  • 用大厂数据预训练LSTM模型,再迁移到小数据集
  • 小波变换增广数据后,短期预测准确率显著提升
  • 复杂模型未必更好,注意力机制提升短期一致性

小型ISP网络的互联网流量预测因数据有限而困难。本文采用迁移学习与数据增强技术,基于两个LSTM模型(LSTMSeq2Seq与LSTMSeq2SeqAtn)进行研究:先在Juniper Networks提供的大规模数据集上训练,再应用于小规模数据集。实验发现,单步预测表现良好,但多步预测尤其是长期预测精度下降。在小数据集上,LSTMSeq2Seq优于LSTMSeq2SeqAtn,表明更高模型复杂度并不必然带来更好效果。不同网络域间性能差异明显,反映流量特征影响。通过离散小波变换进行数据增强,显著提升了模型性能,尤其在短期预测中。分析显示,数据增强对小数据场景至关重要。此外,注意力机制虽提升短期预测一致性,但长期预测变异性更大。结果表明,迁移学习与数据增强能有效提升小数据下流量预测的准确性。

原文摘要 · Abstract (English)

Effective internet traffic prediction in smaller ISP networks is challenged by limited data availability. This paper explores this issue using transfer learning and data augmentation techniques with two LSTM-based models, LSTMSeq2Seq and LSTMSeq2SeqAtn, initially trained on a comprehensive dataset provided by Juniper Networks and subsequently applied to smaller datasets. The datasets represent real internet traffic telemetry, offering insights into diverse traffic patterns across different network domains. Our study revealed that while both models performed well in single-step predictions, multi-step forecasts were challenging, particularly in terms of long-term accuracy. In smaller datasets, LSTMSeq2Seq generally outperformed LSTMSeq2SeqAtn, indicating that higher model complexity does not necessarily translate to better performance. The models' effectiveness varied across different network domains, reflecting the influence of distinct traffic characteristics. To address data scarcity, Discrete Wavelet Transform was used for data augmentation, leading to significant improvements in model performance, especially in shorter-term forecasts. Our analysis showed that data augmentation is crucial in scenarios with limited data. Additionally, the study included an analysis of the models' variability and consistency, with attention mechanisms in LSTMSeq2SeqAtn providing better short-term forecasting consistency but greater variability in longer forecasts. The results highlight the benefits and limitations of different modeling approaches in traffic prediction. Overall, this research underscores the importance of transfer learning and data augmentation in enhancing the accuracy of traffic prediction models, particularly in smaller ISP networks with limited data availability.

流量预测LSTM迁移学习数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。