基于最小描述长度的自适应图池化,能动态选择最优压缩深度。
MDL-Pool: Adaptive Multilevel Graph Pooling Based on Minimum Description Length
- 用最小描述长度原理建模多层级结构依赖关系
- 在多个标准数据集上表现优于现有基线方法
- 适合处理大小不一的图数据,自动选择最佳池化深度
图池化通过压缩图并生成向量表示来总结其拓扑结构与特征,是深度图表示学习的关键步骤,对图级别任务如分类或回归不可或缺。现有方法通过固定深度迭代应用浅层池化算子来压缩图的层次结构,但忽略了不同层级间的相互依赖性,且无法适应需不同池化深度的异构图数据集。为此,我们提出基于最小描述长度(MDL)原则的MDL-Pool池化算子,其损失函数显式建模了多层级之间的依赖关系,并支持对不同深度的池化方案进行直接比较。MDL-Pool基于地图方程(map equation),一种用于社区检测的信息论目标函数,天然实现奥卡姆剃刀原则,在模型复杂度与拟合度之间取得平衡。我们在多个标准图分类数据集上对MDL-Pool进行了实证评估,结果表明其性能具有竞争力。
原文摘要 · Abstract (English)
Graph pooling compresses graphs and summarises their topological properties and features in a vectorial representation. It is an essential part of deep graph representation learning and is indispensable in graph-level tasks like classification or regression. Current approaches pool hierarchical structures in graphs by iteratively applying shallow pooling operators up to a fixed depth. However, they disregard the interdependencies between structures at different hierarchical levels and do not adapt to datasets that contain graphs with different sizes that may require pooling with various depths. To address these issues, we propose MDL-Pool, a pooling operator based on the minimum description length (MDL) principle, whose loss formulation explicitly models the interdependencies between different hierarchical levels and facilitates a direct comparison between multiple pooling alternatives with different depths. MDP-Pool builds on the map equation, an information-theoretic objective function for community detection, which naturally implements Occam's razor and balances between model complexity and goodness-of-fit via the MDL. We demonstrate MDL-Pool's competitive performance in an empirical evaluation against various baselines across standard graph classification datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。