一种跨模态通用表格模型,95个数据集测试表现稳定且推理快
When Tabular Foundation Models Transfer Across Modalities: A Systematic Evaluation Across 95 Datasets, 7 Modalities, and Two Regimes
- 用ETF预处理+上下文学习,统一处理七类信号数据
- 速度比全模型微调快4到200倍,精度接近轻量级微调模型
- 自动校准置信度,适合需可信预测的部署场景
我们提出一种单一分类流程,结合等角紧框架(ETF)预处理与表格基础模型进行上下文推理,一旦数据映射为固定向量表示,该流程在各模态下保持一致。在覆盖视觉、音频、语音、文本、分子、时间序列和表格共95个数据集的七种信号模态上进行评估。方法核心是固定比较基准:全文性能均以同一冻结特征上的最强轻量级微调基线为参照,同时分别报告了理想选择、部署选择和专用微调的结果。该流程在相同冻结特征上与强轻量级微调基线广泛竞争。虽未在每项任务上超越最优专用模型或高度调优的流水线,但始终贴近表现,且运行速度快得多——通常比完整骨干网络微调快4至200倍,常保持相近质量。我们详细说明了实际部署方法:何时应用ETF预处理、如何在无验证集情况下停止训练、如何设置上下文分类器,以及如何校准结果概率。校准步骤非表面操作:TabICL本身构造即具良好校准性,而ETF预处理会破坏此特性,后续后验缩放可恢复,从而生成可用于信任阈值部署的每预测置信信号。我们还指出该流程不适用的场景,并提供提前识别方法。
原文摘要 · Abstract (English)
We present a single classification pipeline that combines an Equiangular Tight Frame (ETF) preprocessing stage with a tabular foundation model for in-context inference, applied identically across modalities once data is mapped to fixed vector representations. We evaluate it on 95 datasets spanning seven signal modalities -- vision, audio, speech, text, molecular, time-series, and tabular. The main methodological contribution is to fix the comparison object: throughout the paper, performance is judged against the strongest lightweight tuned baseline on the same frozen features, while oracle selection, deployed selection, and specialized fine-tuning are reported separately. The pipeline is broadly competitive with strong lightweight tuned baselines on the same frozen features. It does not match the very best specialized models or heavily tuned pipelines on every task, but it stays close, and it runs much faster -- typically 4 to 200 times faster than full backbone fine-tuning, often at comparable quality. We describe how to deploy the pipeline in practice: when to apply ETF preprocessing, how to stop its training without a validation split, how to set up the in-context classifier, and how to calibrate the resulting probabilities. The calibration step is non-cosmetic: TabICL produces well-calibrated probabilities by construction, ETF preprocessing initially disrupts that calibration, and the post-hoc rescaling restores it -- yielding a per-prediction confidence signal that practitioners can use as a trust threshold for confidence-gated deployment. We also report where the pipeline should not be expected to help, and how to identify those cases in advance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。