用双向LSTM与多尺度注意力提升序列模式挖掘效果
A Deep Learning Framework for Sequence Mining with Bidirectional LSTM and Multi-Scale Attention
- 结合双向LSTM与多尺度注意力,捕捉序列的前后依赖关系
- 在多变量时间序列数据上准确率、精确率、召回率均优于主流模型
- 适合处理复杂序列模式识别任务,尤其对长序列有良好适应性
本文针对复杂序列数据中隐含模式挖掘与上下文依赖建模的挑战,提出一种融合双向长短期记忆网络(BiLSTM)与多尺度注意力机制的序列模式挖掘算法。BiLSTM能够同时捕获序列的前向与后向依赖,增强对全局上下文结构的感知能力;多尺度注意力模块则在不同窗口尺寸下为关键特征区域分配自适应权重,提升对局部与全局重要信息的响应能力。在公开的多变量时间序列数据集上进行了大量实验,将该模型与多种主流序列建模方法进行对比。结果表明,该模型在准确率、精确率和召回率方面均优于现有方法,验证了其在复杂模式识别任务中的有效性与鲁棒性。进一步的消融研究与敏感性分析揭示了注意力尺度及输入序列长度对模型性能的影响,为模型结构优化提供了实证支持。
原文摘要 · Abstract (English)
This paper addresses the challenges of mining latent patterns and modeling contextual dependencies in complex sequence data. A sequence pattern mining algorithm is proposed by integrating Bidirectional Long Short-Term Memory (BiLSTM) with a multi-scale attention mechanism. The BiLSTM captures both forward and backward dependencies in sequences, enhancing the model's ability to perceive global contextual structures. At the same time, the multi-scale attention module assigns adaptive weights to key feature regions under different window sizes. This improves the model's responsiveness to both local and global important information. Extensive experiments are conducted on a publicly available multivariate time series dataset. The proposed model is compared with several mainstream sequence modeling methods. Results show that it outperforms existing models in terms of accuracy, precision, and recall. This confirms the effectiveness and robustness of the proposed architecture in complex pattern recognition tasks. Further ablation studies and sensitivity analyses are carried out to investigate the effects of attention scale and input sequence length on model performance. These results provide empirical support for structural optimization of the model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。