统一修复多模态医学影像,用三步解耦提升效果
MARR: Decoupling Policy, Execution, and Calibration for All-in-One Medical Image Restoration

- 通过策略路由、私有残差执行与图像域校准解耦不同模态差异
- 在PET/CT/MRI上分别达37.34/33.85/32.09 dB,平均34.43 dB领先
- 无需标签或专用模型,适合临床部署的轻量级统一框架
全模态医学图像修复旨在用单一模型恢复异构临床影像,但PET、CT和MRI在退化统计、解剖对比度和输出偏差上差异显著。完全共享网络会纠缠模态特异性残差误差,而独立模态专用网络则牺牲统一部署优势。因此,我们重新将全模态修复视为适应位置的选择问题:策略选择、特征执行或输出校准。提出MARR框架,将多模态适应限制在退化感知策略路由、模态私有残差执行和无退化标签的图像域残差校正中,无需模态专用模型。策略分支从输入统计、潜在内容和模态身份生成路由提示,仅作为控制信号;提示门控的模态私有适配器在中间解码阶段进行轻量残差优化;零初始化的模态专用输出头在最终阶段校正残差而不扰动初始共享预测。在包含PET、CT和MRI的全模态修复基准上,MARR超越13种方法,分别达到37.34 dB、33.85 dB、32.09 dB的PSNR,平均34.43 dB最优。代码已公开于https://github.com/CHB-learner/MARR。
原文摘要 · Abstract (English)
All-in-one medical image restoration seeks to recover heterogeneous clinical images with a single model, but PET, CT, and MRI differ substantially in degradation statistics, anatomical contrast, and output-space bias. A fully shared network can entangle modality-specific residual errors, whereas separate modality-specific networks sacrifice the practical advantages of unified deployment. We therefore recast all-in-one restoration as a question of where limited adaptation should be placed: policy selection, feature execution, or output calibration. We propose MARR, a compact restoration framework that constrains multi-modality adaptation into degradation-aware policy routing, modality-private residual execution, and image-domain residual correction without requiring degradation labels or separate modality-specific models. The policy branch forms a routing prompt from input statistics, latent content, and modality identity, and uses it only as a control signal. Prompt-gated modality-private adapters then perform lightweight residual refinement at intermediate decoder stages, while zero-initialized modality-specific output heads calibrate the final image-domain residual without perturbing the initial shared prediction. On an all-in-one PET, CT, and MRI restoration benchmark, MARR outperforms thirteen methods re-trained under the same protocol, achieving PSNR values of 37.34 dB, 33.85 dB, and 32.09 dB on PET, CT, and MRI, respectively, and the best modality-average PSNR of 34.43 dB. The code is publicly available at https://github.com/CHB-learner/MARR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。