将随机块模型与稀疏注意力结合,实现高效可解释的链接预测。
TGSBM: Transformer-Guided Stochastic Block Model for Link Prediction
- 用稀疏注意力和变分编码器建模社区结构与节点关系
- 在多种数据集上达到均排名1.6,训练速度提升6倍
- 适合需要可解释性的大规模网络分析场景
链接预测是网络生态系统的核心,支撑推荐、搜索、知识图谱补全等应用。然而大规模网络包含数十万节点与边,具有异质且重叠的社区结构并随时间演化。现有方法存在局限:传统图神经网络难以捕捉全局依赖,图变压器虽性能强但计算复杂度达二次方,且缺乏可解释性。本文提出TGSBM(Transformer-Guided Stochastic Block Model),融合重叠随机块模型的生成结构与稀疏图变压器的表征能力。该框架包含三部分:(i) 扩展器增强的稀疏注意力,实现近线性复杂度与高效全局混合;(ii) 神经变分编码器,推断社区归属与强度的结构化后验;(iii) 神经边解码器,通过OSBM生成过程重构链接,保持可解释性。在多个基准测试中,TGSBM表现优异(HeaRT协议下平均排名1.6),训练速度提升6倍,且能揭示可解释的社区结构。结果表明,TGSBM在精度、效率与透明性之间取得良好平衡,适用于大规模链接预测。
原文摘要 · Abstract (English)
Link prediction is a cornerstone of the Web ecosystem, powering applications from recommendation and search to knowledge graph completion and collaboration forecasting. However, large-scale networks present unique challenges: they contain hundreds of thousands of nodes and edges with heterogeneous and overlapping community structures that evolve over time. Existing approaches face notable limitations: traditional graph neural networks struggle to capture global structural dependencies, while recent graph transformers achieve strong performance but incur quadratic complexity and lack interpretable latent structure. We propose \textbf{TGSBM} (Transformer-Guided Stochastic Block Model), a framework that integrates the principled generative structure of Overlapping Stochastic Block Models with the representational power of sparse Graph Transformers. TGSBM comprises three main components: (i) \emph{expander-augmented sparse attention} that enables near-linear complexity and efficient global mixing, (ii) a \emph{neural variational encoder} that infers structured posteriors over community memberships and strengths, and (iii) a \emph{neural edge decoder} that reconstructs links via OSBM's generative process, preserving interpretability. Experiments across diverse benchmarks demonstrate competitive performance (mean rank 1.6 under HeaRT protocol), superior scalability (up to $6\times$ faster training), and interpretable community structures. These results position TGSBM as a practical approach that strikes a balance between accuracy, efficiency, and transparency for large-scale link prediction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。