arXiv:2605.11468cs.AI2026-05被引 1

提出CAMPA框架,让多模态图学习更高效且语义对齐。

CAMPA: Efficient and Aligned Multimodal Graph Learning via Decoupled Propagation and Aggregation

论文配图:CAMPA: Efficient and Aligned Multimodal Graph Learning via Decoupled Propagation and Aggregation
图 1 · 摘自论文原文
  • 分离传播与聚合阶段,提升大规模图学习效率。
  • 在多个数据集上性能超越主流基线模型。
  • 适合需要高效多模态图表示学习的场景。

多模态图神经网络(MGNNs)在多模态属性图学习中展现出强大潜力,但现有方法多采用紧密耦合架构,计算开销巨大。本文通过系统性实证分析发现,解耦式MGNNs在大规模图学习中显著更高效、可扩展。然而,我们识别出现有解耦流程中的关键瓶颈——模态冲突,它同时存在于传播和聚合阶段:独立的多跳扩散导致跨模态语义偏离,而简单融合无法对齐多跳特征轨迹,共同限制了有效表征学习。为此,我们提出CAMPA框架,即一种跨模态对齐的多模态传播与聚合机制。具体而言,CAMPA引入两阶段对齐策略:(1) 跨模态对齐传播,通过注入跨模态相似性先验到消息传递过程,在不增加参数负担的前提下保持语义一致性;(2) 轨迹对齐聚合,利用轨迹级自注意力与交叉注意力捕捉并对齐跨模态及多跳依赖关系。在多样基准数据集与任务上的大量实验表明,CAMPA持续优于强基线模型,同时保持了解耦范式的效率优势。

原文摘要 · Abstract (English)

Multimodal Graph Neural Networks (MGNNs) have shown strong potential for learning from multimodal attributed graphs, yet most existing approaches rely on tightly coupled architectures that suffer from prohibitive computational overhead. In this paper, we present a systematic empirical analysis showing that decoupled MGNNs are substantially more efficient and scalable for large-scale graph learning. However, we identify a critical bottleneck in existing decoupled pipelines, namely modal conflict, which arises in both the propagation and aggregation stages. Specifically, independent multi-hop diffusion causes cross-modal semantic divergence during propagation, while naive fusion fails to align multi-hop feature trajectories during aggregation, jointly limiting effective representation learning. To address this challenge, we propose CAMPA, a Cross-modal Aligned Multimodal Propagation & Aggregation framework for decoupled multimodal graph learning. Concretely, CAMPA introduces a two-stage alignment mechanism: (1) cross-modal aligned propagation, which injects cross-modal similarity priors into message passing to preserve semantic consistency without additional parameter overhead; (2) trajectory aligned aggregation, which leverages trajectory-level self-attention and cross-attention to capture and align long-range dependencies across modalities and hops. Extensive experiments on diverse benchmark datasets and tasks demonstrate that CAMPA consistently outperforms strong coupled and decoupled baselines while preserving the efficiency advantages of the decoupled paradigm.

图神经网络多模态学习高效模型语义对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。