arXiv:2603.13434cs.LGcs.AI2026-03中稿 · ICLR被引 1

无需模态信息,让图模型用少量样本快速适配新领域。

Modality-free Graph In-context Alignment

  • 通过梯度指纹捕捉领域特征,实现跨域图数据对齐。
  • 预训练时用双提示注意力机制学习少样本推理能力。
  • 推理时零参数更新,直接跨域预测,适合未知数据场景。

上下文学习(ICL)将静态编码器转化为任务自适应推理器,仅凭少量示例即可实现新数据的适配而无需更新预训练参数,这对图基础模型(GFMs)达到类似大语言模型的通用性至关重要。然而现有GFMs在跨域对齐上表现不佳,通常依赖特定模态编码器,在图数据已向量化或原始数据不可用时失效。本文提出无模态图上下文对齐(MF-GIA)框架,使预训练图编码器可在无模态假设下,对异构领域进行少样本预测。MF-GIA通过梯度指纹捕捉领域特性,参数化轻量级变换,将预编码特征与索引标签对齐至统一语义空间。预训练阶段,采用双提示感知注意力机制与情景目标,学习将查询与对齐的支持样本匹配,建立基于提示的推理能力。推理阶段,仅需少量支持集即可触发跨域对齐,实现零参数更新的即时预测。实验表明,MF-GIA在多种图领域均取得优异少样本性能,并具备强泛化能力,可有效应对未见领域。

原文摘要 · Abstract (English)

In-context learning (ICL) converts static encoders into task-conditioned reasoners, enabling adaptation to new data from just a few examples without updating pretrained parameters. This capability is essential for graph foundation models (GFMs) to approach LLM-level generality. Yet current GFMs struggle with cross-domain alignment, typically relying on modality-specific encoders that fail when graphs are pre-vectorized or raw data is inaccessible. In this paper, we introduce Modality-Free Graph In-context Alignment (MF-GIA), a framework that makes a pretrained graph encoder promptable for few-shot prediction across heterogeneous domains without modality assumptions. MF-GIA captures domain characteristics through gradient fingerprints, which parameterize lightweight transformations that align pre-encoded features and indexed labels into unified semantic spaces. During pretraining, a dual prompt-aware attention mechanism with episodic objective learns to match queries against aligned support examples to establish prompt-based reasoning capabilities. At inference, MF-GIA performs parameter-update-free adaptation using only a few-shot support set to trigger cross-domain alignment and enable immediate prediction on unseen domains. Experiments demonstrate that MF-GIA achieves superior few-shot performance across diverse graph domains and strong generalization to unseen domains.

图神经网络少样本学习跨域对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。