arXiv:2607.18763cs.CV2026-07

用后验采样重建缺失的医学影像模态,无需重新训练

Posterior Samplings are Missing Modalities Generators for Medical Image Translation

论文配图:Posterior Samplings are Missing Modalities Generators for Medical Image Translation
图 1 · 摘自论文原文
  • 将缺失模态生成建模为联合分布下的线性逆问题,通过流匹配采样求解
  • 在BraTS和IXI数据集上优于基线方法,多目标生成时误差传播更小
  • 适合临床真实场景中模态缺失的医学图像修复,尤其对肿瘤分割有益

磁共振成像包含多种提供互补解剖与病理信息的模态,但因时间与协议限制,完整多模态采集常不可行,导致真实数据集中存在缺失模态。传统医学图像翻译方法通常局限于固定源-目标设定,或需为每对模态重新训练。本文提出统一框架,将缺失模态生成建模为联合分布下的线性逆问题,并通过流匹配模型的后验采样求解。通过学习完整模态集的联合先验,该方法可在推理时重建任意缺失模态,引导采样轨迹以满足观测模态的一致性约束。进一步采用多对一采样策略缓解多目标生成中的模态间误差传播。在BraTS和IXI数据集上的实验表明,本方法在多数缺失模态场景下性能超越基线;下游肿瘤分割任务中,合成图像带来的分割精度更高,表明临床相关结构得到更好保留。

原文摘要 · Abstract (English)

Magnetic resonance imaging comes in various modality contrasts that provide complementary anatomical and pathological information. Complete multimodal acquisitions are often unavailable due to time and protocol constraints. This leads to real-world datasets with missing modalities, where conventional medical image translation methods are typically limited to fixed source-target settings or require retraining for each observed source-target pair. We propose a unified framework that formulates missing-modality generation as a linear inverse problem under a joint distribution and solves it via posterior sampling with a flow matching model. By learning a joint prior over the complete modality set, our method can reconstruct arbitrary missing modalities at inference time by guiding the sampling trajectory to enforce measurement consistency with observed modalities. We further mitigate inter-modality error propagation in multi-target generation by adopting a many-to-one sampling strategy. Experiments on BraTS and IXI datasets show that our method achieves the best performance over baselines across most missing-modality scenarios. In downstream tumor segmentation, synthesized images from our method result in higher segmentation performance, indicating better preservation of clinically relevant structures.

医学图像生成模型多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。