arXiv:2511.08667cs.LGstat.ML2025-11被引 135

TabPFN-2.5大幅扩展了表格模型的规模与速度,性能超越主流方法。

TabPFN-2.5: Advancing the State of the Art in Tabular Foundation Models

  • 基于全新架构支持百万级数据点和两千维特征,处理能力提升20倍。
  • 默认设置下在小中型数据集上100%胜过XGBoost,大型数据集仍达87%胜率。
  • 新增轻量化蒸馏引擎,模型压缩后延迟降为毫秒级,适合生产部署。

首个表格基础模型TabPFN及其后续版本TabPFNv2已深刻影响表格人工智能领域,催生数十种衍生方法并在数百个应用场景中落地。本报告推出下一代模型TabPFN-2.5,支持最多5万条数据点、2000个特征,数据单元数较TabPFNv2提升20倍。该模型已成为行业标准基准TabArena(包含最多10万训练样本的数据集)的领先方法,显著优于调优后的树模型,性能媲美耗时四小时调优的AutoGluon 1.4集成系统,甚至包含前代TabPFNv2。值得注意的是,默认设置下的TabPFN-2.5在小型至中型分类数据集(≤10,000样本,500特征)上对默认XGBoost实现100%胜率,在更大数据集(最高10万样本,2000特征)上仍保持87%胜率(回归任务为85%)。针对生产环境,我们引入新型蒸馏引擎,可将TabPFN-2.5转化为紧凑的MLP或树集成模型,在保留大部分准确率的同时实现数量级降低的延迟,支持即插即用部署。此版本将立即增强现有基于TabPFN生态的应用与方法的性能。

原文摘要 · Abstract (English)

The first tabular foundation model, TabPFN, and its successor TabPFNv2 have impacted tabular AI substantially, with dozens of methods building on it and hundreds of applications across different use cases. This report introduces TabPFN-2.5, the next generation of our tabular foundation model, built for datasets with up to 50,000 data points and 2,000 features, a 20x increase in data cells compared to TabPFNv2. TabPFN-2.5 is now the leading method for the industry standard benchmark TabArena (which contains datasets with up to 100,000 training data points), substantially outperforming tuned tree-based models and matching the accuracy of AutoGluon 1.4, a complex four-hour tuned ensemble that even includes the previous TabPFNv2. Remarkably, default TabPFN-2.5 has a 100% win rate against default XGBoost on small to medium-sized classification datasets (<=10,000 data points, 500 features) and a 87% win rate on larger datasets up to 100K samples and 2K features (85% for regression). For production use cases, we introduce a new distillation engine that converts TabPFN-2.5 into a compact MLP or tree ensemble, preserving most of its accuracy while delivering orders-of-magnitude lower latency and plug-and-play deployment. This new release will immediately strengthen the performance of the many applications and methods already built on the TabPFN ecosystem.

表格模型XGBoost蒸馏生产部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。