arXiv:2607.25471cs.AIcs.MM2026-07

用文本驱动的随机游走增强异构图,提升稀疏推荐的语义精准度。

TRWH: A Text-Driven Random Walk Heterogeneous GNN for Semantic-Aware Sparse Recommendation

论文配图:TRWH: A Text-Driven Random Walk Heterogeneous GNN for Semantic-Aware Sparse Recommendation
图 1 · 摘自论文原文
  • 结合LLM文本嵌入与异构图结构,通过随机游走扩展关系路径
  • 在时尚和美妆数据集上分别降低80.0% RMSE和25.7%误差
  • 适合做语义感知稀疏推荐的研究者或工业落地场景

图神经网络(GNN)和大语言模型(LLM)分别在建模结构与语义信号方面推动了推荐系统的发展。然而,在稀疏场景下融合两者优势仍具挑战,尤其需保持语义精度。本文提出TRWH(文本驱动的随机游走异构图神经网络),通过策略性随机游走将LLM生成的文本特征与异构图结构融合。TRWH包含三部分:(1) 嵌入生成,结合Word2Vec与基于LLM的文本画像生成用户与物品表示;(2) 异构图神经网络(HeteroGNN),实现跨多关系边的信息传播;(3) 基于随机游走的路径构建,为稀疏图补充二阶用户-用户与物品-物品连接。在Amazon-2023 Fashion(200万用户,82.5万物品)和Beauty(63.1万用户,11.2万物品)数据集上的实验表明,TRWH显著优于现有方法,其中在Fashion数据集上RMSE降低80.0%,MAE降低52.6%;在Beauty上分别提升25.7%和10.8%。值得注意的是,传统嵌入配合随机游走可增益性能,但会稀释LLM学习到的细粒度表征,凸显自适应融合策略的重要性。

原文摘要 · Abstract (English)

Graph Neural Networks (GNNs) and Large Language Models (LLMs) have each advanced recommendation systems by modeling structural and semantic signals, respectively. However, integrating their complementary strengths remains challenging, particularly in sparse settings where maintaining semantic precision is critical. We propose TRWH (Text-driven Random Walk Heterogeneous Graph Neural Network), a novel framework that fuses LLM-generated textual profiles with heterogeneous graph structures through strategic random walk augmentation. TRWH consists of three core components: (1) Embedding Creation, which produces user and item representations using both Word2Vec and LLM-based profiling; (2) a Heterogeneous Graph Neural Network (HeteroGNN) that propagates information across multi-relational edges; and (3) Random Walk-based Path Construction, which enriches sparse graphs with second-order user-user and item-item links. Experiments on the Amazon-2023 Fashion (2M users, 825K items) and Beauty (631K users, 112K items) datasets demonstrate that TRWH achieves substantial performance gains over state-of-the-art methods, including 80.0% RMSE and 52.6% MAE reductions on Fashion, and 25.7% and 10.8% improvements on Beauty. Notably, while random walks improve performance with traditional embeddings, they can dilute the nuanced representations learned by LLMs, underscoring the importance of adaptive integration strategies.

推荐系统异构图语义感知稀疏推荐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。