arXiv:2512.18475cs.CLcs.LG2025-12

融合LSTM、CNN与注意力机制,提升网页文本分类准确率。

Research on a hybrid LSTM-CNN-Attention model for text-based web content classification

  • 用CNN抓局部词序特征,LSTM学长距离依赖,注意力聚焦关键信息
  • 在5折交叉验证中达98%准确率,优于单一模型和BERT等基线
  • 适合需要实时处理的复杂文本分类任务,兼具精度与效率

本研究提出一种融合LSTM、CNN与注意力机制的混合深度学习架构,用于基于文本的网页内容分类。采用预训练GloVe嵌入表示词汇为稠密向量,保留语义相似性。CNN层提取局部n-gram模式与词汇特征,LSTM层建模长程依赖与序列结构,集成注意力机制使模型能聚焦输入序列中最关键部分。通过5折交叉验证评估模型鲁棒性与泛化能力。实验结果表明,该混合模型取得优异性能:准确率0.98,精确率0.94,召回率0.92,F1分数0.93,显著优于仅使用CNN、LSTM或基于Transformer的BERT等基线模型。各组件协同有效捕捉细粒度文本结构与整体语义上下文。GloVe嵌入提供高效且有效的文本表征,使模型适用于具有实时或近实时要求的系统。该混合架构在需同时兼顾句法特征提取与语义理解的任务中表现出高有效性。通过组合各机制,模型克服了单一架构局限,实现更好泛化能力。研究支持在自然语言处理应用中更广泛采用混合深度学习方法,尤其适用于需高可靠性处理复杂非结构化文本数据的场景。

原文摘要 · Abstract (English)

This study presents a hybrid deep learning architecture that integrates LSTM, CNN, and an Attention mechanism to enhance the classification of web content based on text. Pretrained GloVe embeddings are used to represent words as dense vectors that preserve semantic similarity. The CNN layer extracts local n-gram patterns and lexical features, while the LSTM layer models long-range dependencies and sequential structure. The integrated Attention mechanism enables the model to focus selectively on the most informative parts of the input sequence. A 5-fold cross-validation setup was used to assess the robustness and generalizability of the proposed solution. Experimental results show that the hybrid LSTM-CNN-Attention model achieved outstanding performance, with an accuracy of 0.98, precision of 0.94, recall of 0.92, and F1-score of 0.93. These results surpass the performance of baseline models based solely on CNNs, LSTMs, or transformer-based classifiers such as BERT. The combination of neural network components enabled the model to effectively capture both fine-grained text structures and broader semantic context. Furthermore, the use of GloVe embeddings provided an efficient and effective representation of textual data, making the model suitable for integration into systems with real-time or near-real-time requirements. The proposed hybrid architecture demonstrates high effectiveness in text-based web content classification, particularly in tasks requiring both syntactic feature extraction and semantic interpretation. By combining presented mechanisms, the model addresses the limitations of individual architectures and achieves improved generalization. These findings support the broader use of hybrid deep learning approaches in NLP applications, especially where complex, unstructured textual data must be processed and classified with high reliability.

文本分类混合模型注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。