用图结构增强稀疏张量中高阶交互预测的表达能力
Tensor Convolutional Network for Higher-Order Interaction Prediction in Sparse Tensors
- 构建张量衍生图,通过关系感知编码器学习实体表示
- 与传统张量分解方法结合后,顶k交互预测性能显著提升
- 兼容多种张量分解和图神经网络,适用性广
现实世界中的许多数据(如推荐系统、时序图)可表示为缺失值众多的稀疏张量。在这些稀疏张量中,识别最可能发生但尚未观测到的top-k高阶交互至关重要。张量分解(TF)在各类张量应用中受到广泛关注,是发现这些潜在交互的有效方法。然而,现有方法主要聚焦于实体隐向量的融合,表达能力有限。由于稀疏张量中多数实体仅参与少量交互,其隐向量训练不足。本文提出TCN——一种准确且兼容的张量卷积网络,可无缝集成至现有张量分解方法中以预测高阶交互。设计了高效编码器生成更具表现力的实体隐向量:首先从稀疏张量构建图结构,再提出关系感知编码器TCN,利用图结构学习实体表示。由于TCN可补充传统张量分解方法,我们将其与多种已有方法无缝结合,显著提升顶k交互预测性能。大量实验表明,集成TCN的张量分解方法优于竞争对手,包括其他张量分解方法和超边预测方法。此外,TCN广泛兼容多种张量分解方法与图神经网络(GNN),具备高度通用性。
原文摘要 · Abstract (English)
Many real-world data, such as recommendation data and temporal graphs, can be represented as incomplete sparse tensors where most entries are unobserved. For such sparse tensors, identifying the top-k higher-order interactions that are most likely to occur among unobserved ones is crucial. Tensor factorization (TF) has gained significant attention in various tensor-based applications, serving as an effective method for finding these top-k potential interactions. However, existing TF methods primarily focus on effectively fusing latent vectors of entities, which limits their expressiveness. Since most entities in sparse tensors have only a few interactions, their latent representations are often insufficiently trained. In this paper, we propose TCN, an accurate and compatible tensor convolutional network that integrates seamlessly with existing TF methods for predicting higher-order interactions. We design a highly effective encoder to generate expressive latent vectors of entities. To achieve this, we propose to (1) construct a graph structure derived from a sparse tensor and (2) develop a relation-aware encoder, TCN, that learns latent representations of entities by leveraging the graph structure. Since TCN complements traditional TF methods, we seamlessly integrate TCN with existing TF methods, enhancing the performance of predicting top-k interactions. Extensive experiments show that TCN integrated with a TF method outperforms competitors, including TF methods and a hyperedge prediction method. Moreover, TCN is broadly compatible with various TF methods and GNNs (Graph Neural Networks), making it a versatile solution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。