用最优传输理论提升超图神经网络的表示能力。
Wasserstein Hypergraph Neural Network
- 将节点与超边邻域视为分布,用切片沃尔什池化聚合信息。
- 在多个真实数据集上实现节点分类性能领先。
- 适合关注高阶关系建模与几何结构保留的研究者。
利用机器学习建模关系信息已推动医疗、社会科学等多个领域的发展。尽管图表示学习在过去十年中成为主流,但通过超图表示高阶关系正迅速兴起。近年来,众多超图神经网络涌现,大多遵循两阶段、基于集合的框架:信息从节点传至超边,再由超边传回节点。然而,多数进展仍借鉴图模型,常将聚合操作简化为均值或求和等基础池化方式。本文提出沃瑟斯坦超图神经网络(Wasserstein Hypergraph Neural Network),将节点与超边邻域视为分布,采用切片沃尔什池化进行信息聚合。与仅捕捉一阶统计量的均值、求和等传统聚合器不同,该方法能保留分布的几何特性,如形状与扩散程度。这使得学习到的嵌入可反映一个超边分布转化为另一个的难易程度,符合最优传输原理。实验表明,在超图设置下应用沃尔什池化显著提升了节点分类性能,在多个真实数据集上达到顶尖水平。
原文摘要 · Abstract (English)
The ability to model relational information using machine learning has driven advancements across various domains, from medicine to social science. While graph representation learning has become mainstream over the past decade, representing higher-order relationships through hypergraphs is rapidly gaining momentum. In the last few years, numerous hypergraph neural networks have emerged, most of them falling under a two-stage, set-based framework. The messages are sent from nodes to edges and then from edges to nodes. However, most of the advancement still takes inspiration from the graph counterpart, often simplifying the aggregations to basic pooling operations. In this paper we are introducing Wasserstein Hypergraph Neural Network, a model that treats the nodes and hyperedge neighbourhood as distributions and aggregate the information using Sliced Wasserstein Pooling. Unlike conventional aggregators such as mean or sum, which only capture first-order statistics, our approach has the ability to preserve geometric properties like the shape and spread of distributions. This enables the learned embeddings to reflect how easily one hyperedge distribution can be transformed into another, following principles of optimal transport. Experimental results demonstrate that applying Wasserstein pooling in a hypergraph setting significantly benefits node classification tasks, achieving top performance on several real-world datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。