arXiv:2508.17056cs.LGcs.AI2025-08被引 2

用可学习分段流模型提升表格回归的不确定性建模能力

TabResFlow: A Normalizing Spline Flow Model for Probabilistic Univariate Tabular Regression

  • 基于分段归一化流构建条件密度估计框架
  • 在9个数据集上比最强模型高9.64%对数似然,推理快5.6倍
  • 适合需要可信预测的工业场景,如二手车估价

表格回归是广泛应用的重要问题,但现有方法多聚焦点估计,导致预测过于自信。在工业自动化中,可靠决策尤为关键。概率回归模型通过建模预测不确定性来缓解此问题,但传统方法常假设固定形状分布(如高斯),仅估计参数,限制了对复杂真实分布的拟合能力。为此,我们提出专为单变量表格回归设计的TabResFlow——一种归一化分段流模型。其包含三个核心组件:(1) 每个数值特征的MLP编码器;(2) 全连接的ResNet主干用于表达性特征提取;(3) 条件分段归一化流实现灵活且可计算的概率密度估计。我们在9个公开基准数据集上评估,结果表明,TabResFlow在对数似然得分上持续优于现有概率回归模型,相比最强模型TreeFlow提升9.64%,同时在推理速度上相较最强深度学习模型NodeFlow平均快5.6倍。此外,在真实二手车价格预测任务中,我们引入新的风险覆盖率面积(AURC)指标,验证了其在选择性回归设置下的优越表现。

原文摘要 · Abstract (English)

Tabular regression is a well-studied problem with numerous industrial applications, yet most existing approaches focus on point estimation, often leading to overconfident predictions. This issue is particularly critical in industrial automation, where trustworthy decision-making is essential. Probabilistic regression models address this challenge by modeling prediction uncertainty. However, many conventional methods assume a fixed-shape distribution (typically Gaussian), and resort to estimating distribution parameters. This assumption is often restrictive, as real-world target distributions can be highly complex. To overcome this limitation, we introduce TabResFlow, a Normalizing Spline Flow model designed specifically for univariate tabular regression, where commonly used simple flow networks like RealNVP and Masked Autoregressive Flow (MAF) are unsuitable. TabResFlow consists of three key components: (1) An MLP encoder for each numerical feature. (2) A fully connected ResNet backbone for expressive feature extraction. (3) A conditional spline-based normalizing flow for flexible and tractable density estimation. We evaluate TabResFlow on nine public benchmark datasets, demonstrating that it consistently surpasses existing probabilistic regression models on likelihood scores. Our results demonstrate 9.64% improvement compared to the strongest probabilistic regression model (TreeFlow), and on average 5.6 times speed-up in inference time compared to the strongest deep learning alternative (NodeFlow). Additionally, we validate the practical applicability of TabResFlow in a real-world used car price prediction task under selective regression. To measure performance in this setting, we introduce a novel Area Under Risk Coverage (AURC) metric and show that TabResFlow achieves superior results across this metric.

概率回归归一化流表格数据不确定性建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。