arXiv:2601.22384cs.LGcs.AI2026-01中稿 · ICML被引 16

让图结构跨模态任务共享,提升模型泛化能力

Graph is a Substrate Across Data Modalities

  • 以共享图结构为基底,统一不同任务和模态的表示
  • 在多任务中重复使用同一图结构,性能超越孤立训练
  • 适合需要跨领域迁移的图学习场景

图能自然表达跨多个领域的关联结构。然而,现有方法通常在单一任务和模态中独立构建图表示,完成后即丢弃,导致跨模态和任务的结构规律被反复重建而非积累。为此,我们提出一种以图结构为中心的范式:将图作为可跨学习上下文持久存在的结构基底。G-Substrate 框架包含两个互补机制:统一的结构模式确保异构模态与任务间图表示兼容;交错的角色化训练策略使同一图结构在学习中承担多种功能角色。在多个领域、模态和任务上的实验表明,G-Substrate 显著优于任务孤立和简单多任务学习方法。

原文摘要 · Abstract (English)

Graphs provide a natural representation of relational structure that arises across diverse domains. Despite this ubiquity, graph structure is typically learned in a modality- and task-isolated manner, where graph representations are constructed within individual task contexts and discarded thereafter. As a result, structural regularities across modalities and tasks are repeatedly reconstructed rather than accumulated at the level of intermediate graph representations. This motivates a representation-learning question: how should graph structure be organized so that it can persist and accumulate across heterogeneous modalities and tasks? We adopt a representation-centric perspective in which graph structure is treated as a structural substrate that persists across learning contexts. To instantiate this perspective, we propose G-Substrate, a graph substrate framework that organizes learning around shared graph structures. G-Substrate comprises two complementary mechanisms: a unified structural schema that ensures compatibility among graph representations across heterogeneous modalities and tasks, and an interleaved role-based training strategy that exposes the same graph structure to multiple functional roles during learning. Experiments across multiple domains, modalities, and tasks show that G-Substrate outperforms task-isolated and naive multi-task learning methods. The codebase, model, and datasets are available at https://github.com/zmli6/G-Substrate.

图神经网络多任务学习结构基底

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。