通过多尺度分块提升图表示学习,让模型同时捕捉局部、区域和全局结构。
HP-JEPA: Hierarchical Partitioning for Multi-Resolution Graph Joint-Embedding Predictive Learning

- 设计分层分区框架,在多个粒度上并行预测图结构特征。
- 在7个分类+1个回归任务中,6项超越基线模型,大图表现更优。
- 适合需要多尺度图分析的场景,如社交网络、生物分子建模。
图自监督学习旨在从大规模无标签图数据中学习可迁移的表示。联合嵌入预测架构(JEPAs)通过直接在隐空间预测被掩码目标,避免了显式的负样本构造和原始输入重建。然而,现有图JEPAs通常依赖单一预定义的图划分,使学习到的表示偏向某一结构粒度,限制了对不同尺度互补模式的捕捉能力。为此,我们提出HP-JEPA,一种用于多分辨率图联合嵌入预测的分层分区框架。HP-JEPA将每个图组织为由粗到细的有序分区层级,并在每个层级上使用在线编码器、指数移动平均目标编码器和隐空间预测器分别进行上下文-目标隐空间预测。所得各分辨率的图表示随后通过拼接或任务特定加权融合,使下游模型能整合局部、区域和全局结构信息。在7个图分类基准和1个图回归基准上的实验表明,HP-JEPA在8个任务中的6个上优于固定分辨率的Graph-JEPA基线,在多数评估数据集上表现更佳。按规模分层分析进一步显示,在三个代表性数据集上,HP-JEPA在多数图大小四分位区间均实现更高准确率。结果证明分层多分辨率分区对可迁移图表示学习的有效性。
原文摘要 · Abstract (English)
Graph self-supervised learning aims to learn transferable representations from large-scale unlabeled graph data. Joint-embedding predictive architectures (JEPAs) avoid explicit negative-pair construction and raw-input reconstruction by predicting masked targets directly in latent space. However, existing graph JEPAs typically rely on a single predefined graph partition, biasing the learned representations toward one structural granularity and limiting their ability to capture complementary patterns at different graph scales. To address this limitation, we propose HP-JEPA, a hierarchical partitioning framework for multi-resolution graph joint-embedding prediction. HP-JEPA organizes each graph into an ordered bank of coarse-to-fine partition resolutions and performs context-target latent prediction separately at each resolution using an online encoder, an exponential-moving-average target encoder, and a latent predictor. The resulting resolution-specific graph representations are subsequently integrated through concatenation or task-specific resolution weighting, allowing downstream models to combine complementary local, regional, and global structural information. Experiments on seven graph classification benchmarks and one graph regression benchmark show that HP-JEPA outperforms the fixed-resolution Graph-JEPA baseline on 6 of 8 tasks, improving upon Graph-JEPA on most evaluated benchmarks. Size-stratified analyses further show that HP-JEPA achieves higher accuracy than Graph-JEPA in most evaluated graph-size quartiles on three representative datasets. These results highlight the effectiveness of hierarchical multi-resolution partitioning for transferable graph representation learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。