提出可解释的脑部MRI图像域适配方法,兼顾去域偏与医学信息保留。
Acquisition of interpretable domain information during brain MR image harmonization for content-based image retrieval
- 双编码器分离不变特征与域特异性特征,通过重建损失增强可解释性
- 在多个数据集上实现与先进方法相当的图像重建和疾病分类性能
- 可视化域无关与域相关特征,适合需可解释性的医疗影像分析场景
医学影像如脑部MR扫描因设备和协议差异存在域偏移,影响疾病分类等任务的模型性能。域适配成为研究重点。现有方法将脑部图像映射到低维隐空间,解耦出域不变(z_u)与域特定(z_d)成分,效果良好,但缺乏可解释性,难以满足医疗应用需求。本文提出伪线性风格编码器对抗域适应(PL-SE-ADA)框架,包含两个编码器f_E、f_SE分别提取z_u与z_d,一个解码器f_D用于重构,以及一个域预测器g_D。除编码器与域预测器间的对抗训练外,模型通过叠加z_u与z_d的重构结果来还原输入图像,确保适配效果与信息完整性。相比已有方法,PL-SE-ADA在图像重建、疾病分类和域识别任务上表现相当或更优,同时支持对域无关与域相关特征的可视化,提供全链路可解释性。
原文摘要 · Abstract (English)
Medical images like MR scans often show domain shifts across imaging sites due to scanner and protocol differences, which degrade machine learning performance in tasks such as disease classification. Domain harmonization is thus a critical research focus. Recent approaches encode brain images $\boldsymbol{x}$ into a low-dimensional latent space $\boldsymbol{z}$, then disentangle it into $\boldsymbol{z_u}$ (domain-invariant) and $\boldsymbol{z_d}$ (domain-specific), achieving strong results. However, these methods often lack interpretability$-$an essential requirement in medical applications$-$leaving practical issues unresolved. We propose Pseudo-Linear-Style Encoder Adversarial Domain Adaptation (PL-SE-ADA), a general framework for domain harmonization and interpretable representation learning that preserves disease-relevant information in brain MR images. PL-SE-ADA includes two encoders $f_E$ and $f_{SE}$ to extract $\boldsymbol{z_u}$ and $\boldsymbol{z_d}$, a decoder to reconstruct the image $f_D$, and a domain predictor $g_D$. Beyond adversarial training between the encoder and domain predictor, the model learns to reconstruct the input image $\boldsymbol{x}$ by summing reconstructions from $\boldsymbol{z_u}$ and $\boldsymbol{z_d}$, ensuring both harmonization and informativeness. Compared to prior methods, PL-SE-ADA achieves equal or better performance in image reconstruction, disease classification, and domain recognition. It also enables visualization of both domain-independent brain features and domain-specific components, offering high interpretability across the entire framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。