提出预算制图节点上下文构造方法,提升表格型图模型推理效率
LoGIC: Budgeted Context Construction for Node-Level Graph In-Context Learning with Tabular Foundation Models

- 按结构、特征和覆盖度三通道检索关键节点构建上下文
- 在有限预算下保持全上下文性能,内存占用降低显著
- 适用于百万节点图的冻结推理,适合资源受限场景
表格基础模型已成为强大的图学习工具。G2T-FM 和 GraphPFN 将每个节点编码为特征行,通过上下文学习(ICL)进行预测,其中标注行作为提示。现有方法使用完整训练表作为上下文,导致注意力复杂度随标注集规模平方增长,并引入预处理与内存瓶颈。本文研究节点级图ICL中的上下文构建:应选择哪些标注节点及辅助未标注节点构成查询提示。我们将其建模为两类资源:标注上下文预算(用于预测证据)与未标注光环预算(用于适配器消息传递,不占用标签容量)。提出LoGIC方法,通过结构、特征与覆盖度三通道检索标注节点,共享同一图局部簇内的上下文,引入未标注光环支持适配器骨干,并在无测试标签情况下选择最优通道与预算。在GraphLand上三种骨干配置下,预算上下文维持本地可运行的全上下文性能,媲美已发表的大数据集结果,且峰值内存显著低于全上下文与整图推理。进一步实现无需重训练的百万节点冻结图ICL。分析揭示各检索通道在不同图属性下的表现差异。
原文摘要 · Abstract (English)
Tabular foundation models have become powerful graph learners. Systems such as G2T-FM and GraphPFN encode each node as a feature row and make predictions through in-context learning (ICL), with labeled rows serving as the prompt. Current protocols employ the complete training table as context, causing attention to scale quadratically with the labeled pool and introducing preprocessing and memory bottlenecks. We investigate context construction for node-level graph ICL: which labeled nodes and auxiliary unlabeled nodes should constitute the prompt for specified queries. We formulate this allocation in terms of two resources: a labeled-context budget for predictive evidence and an unlabeled-halo budget for adapter message passing without using label capacity. We present LoGIC, which retrieves labeled nodes via structural, feature-based, and coverage channels, shares each context across the queries in a graph-local cluster, incorporates an unlabeled halo for adapter backbones, and chooses the channel and context budget without test labels. Across three backbone configurations drawn from two model families on GraphLand, budgeted contexts maintain locally runnable full-context performance, stay competitive with published large-dataset results, and markedly lower peak memory requirements compared with full-context and whole-graph inference. They further permit frozen graph ICL on million-node graphs without retraining. Our analysis identifies when retrieval channels work best and connects their behavior with graph properties.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。