提出多尺度融合网络,精准评估PET/CT图像质量
MS-IQA: A Multi-Scale Feature Fusion Network for PET/CT Image Quality Assessment
- 融合ResNet与Swin Transformer多尺度特征,兼顾局部与全局信息
- 在2700张图像上实现超越现有方法的评估精度
- 适合医学影像质量评估、AI辅助诊断研究者使用
正电子发射断层扫描/计算机断层扫描(PET/CT)在医学影像中至关重要,结合功能与解剖信息以辅助精确诊断。然而,噪声、压缩等因素导致图像质量下降,可能引发诊断不确定性甚至误诊。图像质量评估需同时考虑低层特征(如失真)与高层特征(如器官结构)。现有医学图像质量评估(IQA)方法难以兼顾两者。本文提出MS-IQA,一种基于ResNet与Swin Transformer多尺度特征融合的PET/CT IQA新模型,通过动态加权通道注意力机制有效融合高低层信息。此外,构建了包含2,700张不同质量PET/CT图像的PET-CT-IQA-DS数据集,由放射科医生标注质量评分。在自建数据集与公开的LDCTIQAC2023数据集上的实验表明,该模型在多项IQA指标上均优于当前最优方法。代码与数据集已开源。
原文摘要 · Abstract (English)
Positron Emission Tomography / Computed Tomography (PET/CT) plays a critical role in medical imaging, combining functional and anatomical information to aid in accurate diagnosis. However, image quality degradation due to noise, compression and other factors could potentially lead to diagnostic uncertainty and increase the risk of misdiagnosis. When evaluating the quality of a PET/CT image, both low-level features like distortions and high-level features like organ anatomical structures affect the diagnostic value of the image. However, existing medical image quality assessment (IQA) methods are unable to account for both feature types simultaneously. In this work, we propose MS-IQA, a novel multi-scale feature fusion network for PET/CT IQA, which utilizes multi-scale features from various intermediate layers of ResNet and Swin Transformer, enhancing its ability of perceiving both local and global information. In addition, a multi-scale feature fusion module is also introduced to effectively combine high-level and low-level information through a dynamically weighted channel attention mechanism. Finally, to fill the blank of PET/CT IQA dataset, we construct PET-CT-IQA-DS, a dataset containing 2,700 varying-quality PET/CT images with quality scores assigned by radiologists. Experiments on our dataset and the publicly available LDCTIQAC2023 dataset demonstrate that our proposed model has achieved superior performance against existing state-of-the-art methods in various IQA metrics. This work provides an accurate and efficient IQA method for PET/CT. Our code and dataset are available at https://github.com/MS-IQA/MS-IQA/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。