arXiv:2504.04861cs.CLcs.AI2025-04被引 1

融合文本与图结构信息,提升电商社交中交互分类精度

SAFT: Structure-aware Transformers for Textual Interaction Classification

  • 结合语言模型与图注意力机制,动态融合文本和交互结构
  • 在多个真实数据集上准确率超越现有方法,最高提升4.2%
  • 适合处理带文本描述的用户-物品交互分类任务

文本交互网络(TINs)广泛用于建模电商网站、社交网络中用户与物品间的交互行为,每条交互附带文本描述。文本交互分类(TIC)在识别电商垃圾评论、金融欺诈交易等方面有重要应用。现有方法或因使用上下文无关的文本嵌入而忽略丰富语义,或忽视TIN的二分图结构与节点异质性,导致性能受限。本文提出SAFT架构,通过语言模型与图模块的协同设计,融合交互级与词元级语义信号。采用线图注意力(LGA)/门控注意力单元(GAUs)与预训练语言模型(PLMs),并通过代理词实现迭代式上下文融合。同时,提出一种高效且理论支持的方法,将局部与全局拓扑信息编码为结构嵌入,不仅增强文本交互表示,还支持图采样策略设计。在多个真实TIN数据集上的实验表明,SAFT在分类准确率上显著优于当前最优基线。

原文摘要 · Abstract (English)

Textual interaction networks (TINs) are an omnipresent data structure used to model the interplay between users and items on e-commerce websites, social networks, etc., where each interaction is associated with a text description. Classifying such textual interactions (TIC) finds extensive use in detecting spam reviews in e-commerce, fraudulent transactions in finance, and so on. Existing TIC solutions either (i) fail to capture the rich text semantics due to the use of context-free text embeddings, and/or (ii) disregard the bipartite structure and node heterogeneity of TINs, leading to compromised TIC performance. In this work, we propose SAFT, a new architecture that integrates language- and graph-based modules for the effective fusion of textual and structural semantics in the representation learning of interactions. In particular, line graph attention (LGA)/gated attention units (GAUs) and pretrained language models (PLMs) are capitalized on to model the interaction-level and token-level signals, which are further coupled via the proxy token in an iterative and contextualized fashion. Additionally, an efficient and theoretically-grounded approach is developed to encode the local and global topology information pertaining to interactions into structural embeddings. The resulting embeddings not only inject the structural features underlying TINs into the textual interaction encoding but also facilitate the design of graph sampling strategies. Extensive empirical evaluations on multiple real TIN datasets demonstrate the superiority of SAFT over the state-of-the-art baselines in TIC accuracy.

文本分类图神经网络交互建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。