arXiv:2608.07795stat.MLcs.LG2026-08

解决多模态回归中缺失数据时预测区间不准的问题。

Conformal Calibration for Multi-Modal Regression with Missing Modalities

  • 按模态分别预测,用分歧度动态调整置信区间宽度。
  • 在60次测试中,95%覆盖率下区间平均更窄,性能优于基线。
  • 适合需要可靠预测的医疗、自动驾驶等多源数据场景。

针对包含表格、文本、图像等多模态输入的回归任务,当模态间不一致或部分缺失时,传统全局分位数方法难以校准预测区间。本文提出一种模态感知的合规定性校准层:为每种模态训练或复用一个预测器,基于其预测差异计算分歧度,并在严格分割协议下使用该分数进行分段合规定性校准。采用两种互补策略:连续分歧加权法在保持边际合规定性前提下动态分配区间宽度;蒙德里安(分层)法在事前定义的分歧或模态可用性组内校准,满足联合交换性下的组级保证。在四个多模态数据集上,分歧加权层在59/60次对比中优于或持平基线的区间连续概率评分(CRPS),52/60次优于基线的区间宽度,同时维持接近95%的实测覆盖率。在模态缺失的极端测试中,掩码匹配重校准可恢复高达19.5个百分点的覆盖率,尤其在固定掩码最难情形下表现突出。该方法为多模态回归系统提供了一个简单、模型无关的可靠性增强层。

原文摘要 · Abstract (English)

Prediction intervals for multi-modal regression with tabular variables, text, images, or other input sources are difficult to calibrate when those sources disagree or one is missing. A single global quantile averages these regimes together instead of calibrating to the modality pattern observed at test time. We address this through a modality-aware conformal calibration layer. The layer trains or reuses one predictor per modality, computes a disagreement score from their predictions, and uses that score in split conformal calibration under a strict split protocol. We use the score in two complementary ways. First, a continuous disagreement-scaled method reallocates interval width across examples while preserving the usual marginal split-conformal guarantee. Second, a Mondrian (stratified) method calibrates within groups defined by disagreement or modality availability fixed before calibration, giving group guarantees under joint exchangeability of the calibration and test examples. Across four multi-modal datasets, the disagreement-scaled layer matches or improves the marginal conformal baseline in 59 of 60 paired runs for interval continuous ranked probability score (CRPS) and in 52 of 60 for interval width, while keeping empirical coverage near the 95% target. In stress tests with missing modalities, mask-matched recalibration recovers up to 19.5 percentage points of coverage in the hardest fixed-mask regime. The result is a simple, model-agnostic reliability layer for multi-modal regression systems. A project page is available at https://unco3892.github.io/modality-aware-conformal.

多模态置信区间合规定性缺失数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。