arXiv:2606.11640cs.LGcs.AI2026-06KDD

通过动态构建与优化语义图,提升小样本表格学习的准确率。

TAROT: Task-Adaptive Refinement of LLM-prior Graphs for Few-shot Tabular Learning

论文配图:TAROT: Task-Adaptive Refinement of LLM-prior Graphs for Few-shot Tabular Learning
图 1 · 摘自论文原文
  • 基于统一编码器和LLM推理构建任务自适应语义图。
  • 引入图结构精修机制,减少大模型幻觉带来的噪声。
  • 适用于数据稀缺且需保护隐私的现实场景。

小样本表格学习为标注成本高、样本难获取的实际应用提供了高效方案。现有传统与基于大模型的方法虽有效,但传统方法需在无标签或生成数据上额外训练,计算开销大;而直接将原始表格输入大模型则存在隐私与合规风险。更重要的是,两类方法普遍忽视特征间的语义关系,而该关系是构建语义图的关键先验。本文提出TAROT,一种基于图神经网络的框架,通过构建并动态优化任务自适应的语义图,提升小样本表格学习的预测性能。TAROT首先使用统一语义表格节点编码器(USTNE)将异构表格数据转化为统一节点表示;接着利用大模型根据任务描述和特征名推断特征间语义关系,构建初始语义图;为缓解大模型幻觉引入的结构噪声,设计任务自适应语义图精修模块,剪除无关或虚假边,并补充缺失的任务相关边,使图结构更契合下游目标;最后,通过GNN在精修后的图上进行消息传递,捕捉任务相关的语义依赖关系完成预测。在多个小样本表格学习基准上的实验表明,TAROT性能显著优于现有方法,达到该领域的最先进水平。

原文摘要 · Abstract (English)

Few-shot tabular learning provides a cost-effective approach for real-world applications where annotation is costly and collecting sufficient samples for new tasks is difficult. Existing Traditional and LLM-based methods have demonstrated effectiveness in few-shot scenarios. However, traditional methods need additional training on unlabeled or generated data, which incur significant computational overhead. In addition, LLM-based methods that directly feed raw tabular data into LLMs raise privacy and compliance concerns. More importantly, both paradigms largely overlook the semantic relationships between features, which provide structural and semantic prior for constructing a semantic graph. Semantic graph is essential for modeling meaningful feature interactions in few-shot scenarios. In this paper, we propose TAROT, a GNN-based framework that encodes the structural and semantic prior by constructing and refining a task-adaptive semantic graph from this prior, thereby improving predictive performance in few-shot tabular learning. TAROT first encodes heterogeneous tabular data into unified node semantic representations via a Unified Semantic Tabular Node Encoder (USTNE). Then, it prompts LLMs to infer the semantic relationship between features based on the task description and feature names to construct a semantic graph. To mitigate structural noise introduced by the hallucination of LLMs, TAROT introduces Task-adaptive Semantic Graph Refinement that prunes spurious or task-unrelated edges and adds missing task-related ones, aligning the graph structure with the downstream objective. Finally, a GNN performs message passing over the refined graph to capture task-related semantic dependencies for prediction. Extensive experiments on various few-shot tabular learning benchmarks demonstrate the superior performance of TAROT, establishing it as a state-of-the-art approach in this domain.

小样本学习图神经网络大模型应用表格数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。