针对医学影像细节重建不足问题,提出聚焦解剖结构的损失函数。
Anatomical feature-prioritized loss for enhanced MR to CT translation

- 用预训练分割模型提取解剖特征,指导图像生成
- 在肺部与骨盆场景中显著提升支气管和器官结构精度
- 适合需要高精度局部结构分析的临床影像合成任务
在医学图像合成中,局部结构细节的精确度至关重要,尤其在识别和测量细微结构时。传统图像转换方法通常以全局重建优化为目标,难以满足精细局部分析的需求。本文引入一种新型解剖特征优先(AFP)损失函数,通过利用特定下游任务(如解剖区域分割)的预训练模型特征,增强对临床关键结构的重建能力。该损失可替代或补充全局重建方法,实现全局保真度与局部细节之间的平衡。研究在两种场景中验证:基于私有数据集的肺部MR到CT转换,关注支气管结构高质量重建;以及基于Synthrad2023公开数据集的骨盆MR到CT合成,强调器官与肌肉的准确表征。实验采用特定解剖区域的预训练分割模型嵌入,证明了AFP损失在优先重建关键解剖特征方面的有效性,展现出提升医学图像合成特异性和临床实用性的潜力。
原文摘要 · Abstract (English)
In medical image synthesis, the precision of localized structural details is crucial, particularly when addressing specific clinical requirements such as the identification and measurement of fine structures. Traditional methods for image translation and synthesis are generally optimized for global image reconstruction but often fall short in providing the finesse required for detailed local analysis. This study represents a step toward addressing this challenge by introducing a novel anatomical feature-prioritized (AFP) loss function into the synthesis process. This method enhances reconstruction by focusing on clinically significant structures, utilizing features from a pre-trained model designed for a specific downstream task, such as the segmentation of particular anatomical regions. The AFP loss function can replace or complement global reconstruction methods, ensuring a balanced emphasis on both global image fidelity and local structural details. Various implementations of this loss function are explored, including its integration into different synthesis networks such as GAN-based and CNN-based models. Our approach is applied and evaluated in two contexts: lung MR to CT translation, focusing on high-quality reconstruction of bronchial structures, using a private dataset; and pelvis MR to CT synthesis, targeting the accurate representation of organs and muscles, utilizing a public dataset from the Synthrad2023 challenge. We leverage embeddings from pre-trained segmentation models specific to these anatomical regions to demonstrate the capability of the AFP loss to prioritize and accurately reconstruct essential features. This tailored approach shows promising potential for enhancing the specificity and practicality of medical image synthesis in clinical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。