提出可解释的网络与词嵌入统一框架,提升效率与可理解性。
From communities to interpretable network and word embedding: an unified approach
- 基于团或社区的二分投影降维,构建低维可解释向量空间。
- SINr-MF在经典图数据上表现优异,SINr-NR生成稳定高质量嵌入。
- 适合需要模型可解释性的图分析、自然语言处理研究者使用。
复杂系统如人类社交互动或语言中词汇共现关系的建模有助于理解其组织与运作机制。此类系统可表示为网络,网络理论提供了分析工具。图嵌入是将网络交互与拓扑结构压缩至向量空间的强大方法,在机器学习中用于链接预测、图匹配等任务。词嵌入则旨在从大规模文本语料中提取词义。尽管二者输入结构不同,许多图嵌入方法仍借鉴自NLP技术。现有方法存在训练耗时且资源密集、模型黑箱难以解释等问题。本文提出一种新型框架——低维二分图框架(LDBGF),利用团对网络进行二分投影以降低维度。同时引入两种实现:基于社区的SINr-NR与SINr-MF。实验表明,SINr-MF在经典图数据上表现良好,而SINr-NR能生成可解释且跨运行稳定的图与词嵌入。
原文摘要 · Abstract (English)
Modelling information from complex systems such as humans social interaction or words co-occurrences in our languages can help to understand how these systems are organized and function. Such systems can be modelled by networks, and network theory provides a useful set of methods to analyze them. Among these methods, graph embedding is a powerful tool to summarize the interactions and topology of a network in a vectorized feature space. When used in input of machine learning algorithms, embedding vectors help with common graph problems such as link prediction, graph matching, etc. Word embedding has the goal of representing the sense of words, extracting it from large text corpora. Despite differences in the structure of information in input of embedding algorithms, many graph embedding approaches are adapted and inspired from methods in NLP. Limits of these methods are observed in both domains. Most of these methods require long and resource greedy training. Another downside to most methods is that they are black-box, from which understanding how the information is structured is rather complex. Interpretability of a model allows understanding how the vector space is structured without the need for external information, and thus can be audited more easily. With both these limitations in mind, we propose a novel framework to efficiently embed network vertices in an interpretable vector space. Our Lower Dimension Bipartite Framework (LDBGF) leverages the bipartite projection of a network using cliques to reduce dimensionality. Along with LDBGF, we introduce two implementations of this framework that rely on communities instead of cliques: SINr-NR and SINr-MF. We show that SINr-MF can perform well on classical graphs and SINr-NR can produce high-quality graph and word embeddings that are interpretable and stable across runs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。