arXiv:2507.08280stat.MLcs.LG2025-07被引 2

让表格模型在未知缺失模式下仍保持稳定预测能力。

MIRRAMS: Learning Robust Tabular Models under Unseen Missingness Shifts

  • 基于互信息设计鲁棒性条件,聚焦与标签相关的信息。
  • 在多种缺失模式下均优于现有方法,甚至在无缺失时也表现更优。
  • 无需假设缺失机制,适合真实场景中的表格数据建模。

缺失值的存在常反映数据收集策略的变化,这些策略可能随时间或地点变化,即使特征分布保持不变。训练与测试数据间缺失模式的分布偏移,对实现鲁棒预测构成重大挑战。本文提出一种新型深度学习框架MIRRAMS,专门应对测试时未知缺失模式的问题。我们引入一组基于互信息的鲁棒性条件(MI robustness conditions),指导模型提取与标签相关的有效信息,从而增强对测试阶段缺失分布偏移的鲁棒性。通过设计简洁有效的损失项,构建最终目标函数。该方法不依赖MCAR、MAR或MNAR等特定缺失假设,适用范围广;还可自然扩展至训练数据中标签也缺失的情形,支持半监督学习。在多个基准表格数据集上的大量实验表明,MIRRAMS始终优于现有最优方法,在多种缺失条件下表现稳定。此外,其在完全观测设置下亦具优越性能,证明其作为通用表格学习即插即用框架的强大潜力。

原文摘要 · Abstract (English)

The presence of missing values often reflects variations in data collection policies, which may shift across time or locations, even when the underlying feature distribution remains stable. Such shifts in the missingness distribution between training and test inputs pose a significant challenge to achieving robust predictive performance. In this study, we propose a novel deep learning framework designed to address this challenge, particularly in the common yet challenging scenario where the test-time dataset is unseen. We begin by introducing a set of mutual information-based conditions, called MI robustness conditions, which guide the prediction model to extract label-relevant information. This promotes robustness against distributional shifts in missingness at test-time. To enforce these conditions, we design simple yet effective loss terms that collectively define our final objective, called MIRRAMS. Importantly, our method does not rely on any specific missingness assumption such as MCAR, MAR, or MNAR, making it applicable to a broad range of scenarios. Furthermore, it can naturally extend to cases where labels are also missing in training data, by generalizing the framework to a semi-supervised learning setting. Extensive experiments across multiple benchmark tabular datasets demonstrate that MIRRAMS consistently outperforms existing state-of-the-art baselines and maintains stable performance under diverse missingness conditions. Moreover, it achieves superior performance even in fully observed settings, highlighting MIRRAMS as a powerful, off-the-shelf framework for general-purpose tabular learning.

表格建模缺失数据鲁棒学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。