arXiv:2606.19827cs.LGcs.AI2026-06中稿 · MICCAI 2026

自适应分箱让表格自监督学习更准,无需人工标注

When, Where, and How: Adaptive Binning for Tabular Self-Supervised Learning

论文配图:When, Where, and How: Adaptive Binning for Tabular Self-Supervised Learning
图 1 · 摘自论文原文
  • 按特征动态调整分箱策略,训练中逐步细化
  • 在多个医疗数据集上线性探测和微调均提升
  • 适合医疗表格数据,免调参且可复现

医疗表格数据在临床研究中广泛存在,但深度学习应用受限于标签获取成本高,尽管结构化变量通常以表格形式存在。自监督学习可利用这些无标签表格,现有基于分箱的预训练目标采用固定全局分位数离散化,且对所有特征使用相同监督方式。我们提出自适应分箱(Adaptive Binning),一种训练自适应的表格自监督学习预训练方法,通过特征级粗到精课程学习将离散化与学习过程耦合。基于神经网络的谱偏差与课程学习原则,该方法在检测到性能停滞后逐特征精细重构,并选择表征感知的划分点,以同时提升值空间聚类度与表征空间一致性。一个异质性感知目标统一了分类重建与有序监督,适用于数值型特征。在多个公开医疗表格数据集上,采用统一评估协议验证,该方法在线性探测与微调任务中均取得一致提升,且无需针对数据集调整分箱策略。我们进一步构建了一个标准化医疗表格自监督学习基准,推动该未充分探索领域的可复现进展。代码已开源。

原文摘要 · Abstract (English)

Medical tabular data are ubiquitous in clinical research, but deep learning for tables remains underexplored because reliable labels often require costly expert adjudication, even though structured clinical variables are routinely available in tabular form. Self-supervised learning can leverage these unlabeled tables, and recent binning-based pretexts offer a promising inductive bias, but existing objectives fix a single global quantile discretization and apply feature-agnostic supervision. We propose Adaptive Binning, a training-adaptive discretization pretext for tabular SSL that couples discretization to learning through a feature-wise coarse-to-fine curriculum. Motivated by the spectral bias of neural networks and the principles of curriculum learning, our method progressively refines discretization per feature upon plateau detection and selects representation-aware splits to jointly improve value-space concentration and representation-space coherence. A heterogeneity-aware objective unifies categorical reconstruction with ordinal supervision for numerical features, and experiments on public medical tabular datasets under unified evaluation protocols show consistent gains for linear probing and fine-tuning without dataset-specific discretization tuning. We further introduce a medical tabular SSL benchmark with standardized protocols to support reproducible progress in this underexplored domain. Our code is available at https://github.com/labhai/Adaptive-Binning.

表格自监督医疗数据自适应分箱无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。