arXiv:2606.30336cs.LG2026-06

FlexTab用统一编码器+专用解码器,让表格模型通用化。

FlexTab: A Flexible Encoder-Decoder Architecture for In-Context Learning Across Diverse Tabular Tasks

  • 统一编码器生成无关任务的行嵌入,支持多任务适配。
  • 在6类表格任务中达顶尖性能,分类/回归/异常检测领先。
  • 适合需要快速适配新表格任务的研究者与工程师。

我们提出FlexTab,一种面向表格数据的灵活编码器-解码器架构,采用单一无任务特性的编码器搭配一系列任务专用解码器。与现有表格上下文学习方法不同,该设计将特征表示与特定预测目标解耦,生成目标无关的行嵌入,可在表内上下文学习框架下广泛应用于多种下游任务。我们在六类不同问题上验证其灵活性:分类、回归、异常检测、聚类、实体匹配和关系数据库中的实体分类。编码器与各任务解码器均在大规模真实世界未标注表格语料上训练。FlexTab在分类、回归、异常检测和实体匹配任务上达到当前最优性能,且在关系数据库实体分类任务中仍保持与专用模型相当的竞争力。结果表明,一个共享编码器配合任务特定解码器,可作为多样表格预测问题的有效通用骨干。推理代码与模型检查点将公开于 https://github.com/SAP-samples/flextab。

原文摘要 · Abstract (English)

We introduce FlexTab, a flexible encoder-decoder architecture for in-context learning on tabular data that pairs a single, task-agnostic encoder with a suite of task-specific decoders. Unlike existing tabular in-context learners, which entangle feature representations with a specific prediction target, our design produces target-agnostic row embeddings that can be leveraged across a wide range of downstream tasks within a table-native in-context learning setup. We demonstrate this flexibility on six distinct problems: classification, regression, anomaly detection, clustering, entity matching, and entity classification in relational databases. Both the encoder and the task-specific decoders are trained on a large corpus of real-world, unlabeled tables. FlexTab achieves state-of-the-art performance on classification, regression, anomaly detection and entity matching, while remaining competitive with specialized models on entity classification in a relational setting. These results demonstrate that a single shared encoder, paired with task-specific decoders, can serve as an effective general-purpose backbone for diverse tabular prediction problems. The inference code and checkpoints will be made publicly available at https://github.com/SAP-samples/flextab.

表格建模上下文学习通用架构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。