用多尺度卷积LSTM+迁移学习,高效检测蜂窝网络异常
Multi-Scale Convolutional LSTM with Transfer Learning for Anomaly Detection in Cellular Networks
- 设计多尺度卷积LSTM捕捉网络时序特征
- 迁移学习使模型仅20轮就达95%准确率
- 适合网络运维与异常检测场景
移动宽带使用量和用户数量的快速增长,使得保障网络性能变得至关重要。随着网络复杂度提升,尤其在高峰时段,手动收集关键性能指标(KPI)因数据量庞大而耗时。在繁忙时段检测网络故障和异常行为对评估网络健康状况至关重要。研究者已应用深度学习(DL)和机器学习(ML)技术,通过预测吞吐量、分析通话记录和检测中断来理解网络行为。然而,这些方法通常需要大量计算资源、大规模标注数据集且高度专用,导致新场景下的重训练成本高、耗时长。本研究提出一种新型方法:多尺度卷积LSTM结合迁移学习(TL),用于检测蜂窝网络中的异常。模型首先在公开数据集上从头训练,学习正常网络行为;随后利用迁移学习,将已学权重应用于不同数据集进行微调。我们对比了从头训练模型与微调模型的性能。为缓解类别不平衡并获得更深入洞察,采用探索性数据分析(EDA)和合成少数类过采样技术(SMOTE)。结果表明,从头训练的模型在100个周期后达到99%准确率,而微调模型在不同数据集上仅需20个周期即达95%准确率。
原文摘要 · Abstract (English)
The rapid growth in mobile broadband usage and increasing subscribers have made it crucial to ensure reliable network performance. As mobile networks grow more complex, especially during peak hours, manual collection of Key Performance Indicators (KPIs) is time-consuming due to the vast data involved. Detecting network failures and identifying unusual behavior during busy periods is vital to assess network health. Researchers have applied Deep Learning (DL) and Machine Learning (ML) techniques to understand network behavior by predicting throughput, analyzing call records, and detecting outages. However, these methods often require significant computational power, large labeled datasets, and are typically specialized, making retraining for new scenarios costly and time-intensive. This study introduces a novel approach Multi-Scale Convolutional LSTM with Transfer Learning (TL) to detect anomalies in cellular networks. The model is initially trained from scratch using a publicly available dataset to learn typical network behavior. Transfer Learning is then employed to fine-tune the model by applying learned weights to different datasets. We compare the performance of the model trained from scratch with that of the fine-tuned model using TL. To address class imbalance and gain deeper insights, Exploratory Data Analysis (EDA) and the Synthetic Minority Over-sampling Technique (SMOTE) are applied. Results demonstrate that the model trained from scratch achieves 99% accuracy after 100 epochs, while the fine-tuned model reaches 95% accuracy on a different dataset after just 20 epochs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。