arXiv:2511.20222cs.LG2025-11KDD被引 1

解决多模态图数据压缩中的梯度冲突问题,提升训练稳定性。

Decoupling and Damping: Structurally-Regularized Gradient Matching for Multimodal Graph Condensation

  • 通过梯度解耦减少不同模态间的语义偏差
  • 引入结构阻尼正则抑制梯度噪声传播
  • 在四个数据集上表现领先,适用于多架构场景

在多模态图学习中,融合视觉与文本等多源信息的图结构能更全面地建模复杂实体关系。然而,数据规模持续增长带来显著计算瓶颈。图压缩方法通过合成紧凑且具有代表性的数据集提供可行路径。现有方法在多模态场景下性能受限,主要源于两点:(1) 不同模态间语义不一致导致梯度冲突;(2) 图神经网络的消息传递机制进一步结构性放大梯度噪声。为此,本文提出结构化正则梯度匹配(SR-GM)框架,通过梯度解耦缓解模态间梯度冲突,并引入结构阻尼正则项抑制拓扑中梯度噪声传播,使图结构由噪声放大器转变为训练稳定器。在四个多模态图数据集上的大量实验表明,SR-GM具备最先进性能及跨架构泛化能力。

原文摘要 · Abstract (English)

In multimodal graph learning, graph structures that integrate information from multiple sources, such as vision and text, can more comprehensively model complex entity relationships. However, the continuous growth of their data scale poses a significant computational bottleneck for training. Graph condensation methods provide a feasible path forward by synthesizing compact and representative datasets. Nevertheless, existing condensation approaches generally suffer from performance limitations in multimodal scenarios, mainly due to two reasons: (1) semantic misalignment between different modalities leads to gradient conflicts; (2) the message-passing mechanism of graph neural networks further structurally amplifies such gradient noise. Based on this, we propose Structural Regularized Gradient Matching (SR-GM), a condensation framework for multimodal graphs. This method alleviates gradient conflicts between modalities through a gradient decoupling mechanism and introduces a structural damping regularizer to suppress the propagation of gradient noise in the topology, thereby transforming the graph structure from a noise amplifier into a training stabilizer. Extensive experiments on four multimodal graph datasets demonstrate the effectiveness of SR-GM, highlighting its state-of-the-art performance and cross-architecture generalization capabilities in multimodal graph dataset condensation.

图学习多模态数据压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。