融合统计与语义特征,用注意力机制提升新闻分类准确率
Attention-Guided Feature Fusion (AGFF) Model for Integrating Statistical and Semantic Features in News Text Classification
- 用注意力机制动态分配统计与语义特征权重
- 在多个新闻数据集上优于纯统计或纯深度学习模型
- 适合需要兼顾效率与精度的新闻分类场景
新闻文本分类是自然语言处理中的关键任务,对海量数字内容的组织与过滤至关重要。传统方法依赖词频或TF-IDF等统计特征,虽能捕捉词级重要性,却难以反映上下文语义;现代深度学习方法利用语义特征理解词语上下文,但可能忽略简单而高效的统计指标。本文提出一种注意力引导的特征融合(AGFF)模型,在统一框架中结合统计与语义特征。该模型通过注意力机制动态确定各类特征的重要性,辅助更精准的分类决策。在多个基准新闻数据集上的评估表明,AGFF模型性能优于传统统计模型和纯语义深度学习模型。消融实验验证了各组件在融合过程中的贡献。结果表明,合理整合多种特征类型可显著提升分类准确率。该模型有效平衡并利用统计与语义表示的互补优势,为实际新闻分类任务提供高效可行的解决方案。
原文摘要 · Abstract (English)
News text classification is a crucial task in natural language processing, essential for organizing and filtering the massive volume of digital content. Traditional methods typically rely on statistical features like term frequencies or TF-IDF values, which are effective at capturing word-level importance but often fail to reflect contextual meaning. In contrast, modern deep learning approaches utilize semantic features to understand word usage within context, yet they may overlook simple, high-impact statistical indicators. This paper introduces an Attention-Guided Feature Fusion (AGFF) model that combines statistical and semantic features in a unified framework. The model applies an attention-based mechanism to dynamically determine the relative importance of each feature type, enabling more informed classification decisions. Through evaluation on benchmark news datasets, the AGFF model demonstrates superior performance compared to both traditional statistical models and purely semantic deep learning models. The results confirm that strategic integration of diverse feature types can significantly enhance classification accuracy. Additionally, ablation studies validate the contribution of each component in the fusion process. The findings highlight the model's ability to balance and exploit the complementary strengths of statistical and semantic representations, making it a practical and effective solution for real-world news classification tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。