融合多尺度特征与图神经网络,提升大模型文本分类性能
Multi-Scale Feature Fusion and Graph Neural Network Integration for Text Classification with Large Language Models
- 用特征金字塔融合不同层级语义特征,兼顾全局与细节
- 将融合特征转为图结构,图神经网络捕捉深层语义关系
- 在多个数据集上超越现有模型,适合复杂语义任务
本研究提出一种融合大型语言模型深度特征提取、多尺度特征金字塔融合与图神经网络结构建模的文本分类方法,以增强复杂语义场景下的表现。首先,大语言模型捕捉输入文本的上下文依赖与深层语义表征,提供丰富的特征基础。随后,基于多层级特征表示,特征金字塔机制有效整合不同尺度的语义特征,平衡全局信息与局部细节,构建层次化语义表达。进一步地,将融合后的特征转换为图表示,利用图神经网络捕获文本中隐含的语义关系与逻辑依赖,实现对语义单元间复杂交互的全面建模。在此基础上,读出与分类模块生成最终类别预测。该方法在鲁棒性对齐实验中表现显著优势,在准确率(ACC)、F1分数(F1-Score)、AUC和精确率(Precision)上均优于现有模型,验证了框架的有效性与稳定性。本研究不仅构建了一个兼顾全局与局部信息、语义与结构平衡的集成框架,也为多尺度特征融合与结构化语义建模提供了新视角。
原文摘要 · Abstract (English)
This study investigates a hybrid method for text classification that integrates deep feature extraction from large language models, multi-scale fusion through feature pyramids, and structured modeling with graph neural networks to enhance performance in complex semantic contexts. First, the large language model captures contextual dependencies and deep semantic representations of the input text, providing a rich feature foundation for subsequent modeling. Then, based on multi-level feature representations, the feature pyramid mechanism effectively integrates semantic features of different scales, balancing global information and local details to construct hierarchical semantic expressions. Furthermore, the fused features are transformed into graph representations, and graph neural networks are employed to capture latent semantic relations and logical dependencies in the text, enabling comprehensive modeling of complex interactions among semantic units. On this basis, the readout and classification modules generate the final category predictions. The proposed method demonstrates significant advantages in robustness alignment experiments, outperforming existing models on ACC, F1-Score, AUC, and Precision, which verifies the effectiveness and stability of the framework. This study not only constructs an integrated framework that balances global and local information as well as semantics and structure, but also provides a new perspective for multi-scale feature fusion and structured semantic modeling in text classification tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。