arXiv:2605.13986cs.LGstat.ML2026-05

TabPFN-3大幅提升表格数据预测速度与精度,支持百万级数据

TabPFN-3: Technical Report

论文配图:TabPFN-3: Technical Report
图 1 · 摘自论文原文
  • 用合成数据预训练,引入测试时计算扩展机制
  • 在百万行数据上推理速度提升20倍,性能超越8小时调优的梯度提升模型
  • 适合需要快速高精度表格预测的研究者与工业用户

表格数据支撑科学与工业中的多数高价值预测任务。基于用户反馈,TabPFN-3 在前代基础上实现突破:在100万训练样本的数据集上达到最先进性能,并显著降低训练与推理时间。其仅在合成数据上预训练,大幅拓展了表格预测边界,在时间序列、关系型及表格-文本数据上均取得显著提升。在标准基准TabArena上,一次前向传播即超越所有其他模型(包括调优与集成基线),且在速度与性能权衡上占据优势。在多样化数据集上,对多类别数据排名第一,对高达100万行、200特征的数据集仍优于8小时调优的梯度提升树基线。新引入的测试时计算扩展机制通过API TabPFN-3-Plus(Thinking)实现,使模型在TabArena上领先非TabPFN模型超200 Elo,最大子集达420 Elo,且比AutoGluon 1.5 extreme快10倍,不依赖大语言模型、真实数据或网络搜索。该模型在关系型数据(RelBenchV1新SOTA)、表格-文本数据(TabSTAR SOTA)上表现卓越,同时专门优化版本TabPFN-TS-3在fev-bench时间序列基准中位列第二,SHAP值计算提速最高达120倍。整体性能较TabPFN-2.5提升最高20倍,采用减少的键值缓存与行分块技术,单张H100卡即可高效处理百万行数据。

原文摘要 · Abstract (English)

Tabular data underpins most high-value prediction problems in science and industry, and TabPFN has driven the foundation model revolution for this modality. Designed with feedback from our users, TabPFN-3 builds on this foundation to scale state-of-the-art performance to datasets with 1M training rows and substantially reduce training and inference time. Pretrained exclusively on synthetic data from our prior, TabPFN-3 dramatically pushes the frontier of tabular prediction and brings substantial gains on time series, relational, and tabular-text data. On the standard tabular benchmark TabArena, a forward pass of TabPFN-3 outperforms all other models, including tuned and ensembled baselines, by a significant margin, and pareto-dominates the speed/performance frontier. On more diverse datasets, TabPFN-3 ranks first on datasets with many classes, and beats 8-hour-tuned gradient-boosted-tree baselines on datasets up to 1M training rows and 200 features. TabPFN-3 introduces test-time compute scaling to tabular foundation models. Our API offering TabPFN-3-Plus (Thinking) exploits this to beat all non-TabPFN models by over 200 Elo on TabArena, rising to 420 Elo on the largest data subset, and outperforms AutoGluon 1.5 extreme while being 10x faster, without using LLMs, real data, internet search or any other model besides TabPFN. TabPFN-3 extends the capabilities of our models, enabling SOTA prediction on relational data (new SOTA foundation model on RelBenchV1) and tabular-text data (SOTA on TabSTAR via TabPFN-3-Plus); and improves existing integrations: a specialized checkpoint, TabPFN-TS-3, ranks 2nd on the time-series benchmark fev-bench, and SHAP-value computation is up to 120x faster. TabPFN-3 achieves this performance while being up to 20x faster than TabPFN-2.5. In addition, a reduced KV cache and row-chunking scale to 1M rows on one H100 with fast inference speed.

表格预测基础模型高效推理合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。