用图模型同时分析多视角医学影像中的病灶关系与变化,提升诊断准确率。
GIIM: Graph-based Learning of Inter- and Intra-view Dependencies for Multi-view Medical Image Diagnosis
- 构建图结构,联合建模单视角内病灶关联与跨视角动态变化
- 在CT/MRI/乳腺X光上均显著提升诊断准确率,对缺失数据也更鲁棒
- 适合需要融合多源医学影像的临床辅助诊断系统开发者
计算机辅助诊断(CADx)在医学影像中日益重要,但自动化系统难以复现临床诊断的精细过程。专家诊断需综合分析异常在不同视角和时间点间的关联,而现有方法常忽略单视角内病灶关系及病灶跨视角的动态变化。这一局限性叠加常见数据不完整问题,严重影响预测可靠性。为此,我们重新将诊断任务定义为关系建模,并提出GIIM——一种新型图基方法。该框架可同时捕捉病灶间的内部依赖与跨视角动态变化,且通过特定技术有效处理缺失数据,增强诊断鲁棒性。我们在多种成像模态(包括CT、MRI和乳腺摄影)上进行了广泛评估,结果表明GIIM显著优于现有方法,在诊断准确性和鲁棒性方面均实现提升,为未来CADx系统提供了更有效的范式。
原文摘要 · Abstract (English)
Computer-aided diagnosis (CADx) has become vital in medical imaging, but automated systems often struggle to replicate the nuanced process of clinical interpretation. Expert diagnosis requires a comprehensive analysis of how abnormalities relate to each other across various views and time points, but current multi-view CADx methods frequently overlook these complex dependencies. Specifically, they fail to model the crucial relationships within a single view and the dynamic changes lesions exhibit across different views. This limitation, combined with the common challenge of incomplete data, greatly reduces their predictive reliability. To address these gaps, we reframe the diagnostic task as one of relationship modeling and propose GIIM, a novel graph-based approach. Our framework is uniquely designed to simultaneously capture both critical intra-view dependencies between abnormalities and inter-view dynamics. Furthermore, it ensures diagnostic robustness by incorporating specific techniques to effectively handle missing data, a common clinical issue. We demonstrate the generality of this approach through extensive evaluations on diverse imaging modalities, including CT, MRI, and mammography. The results confirm that our GIIM model significantly enhances diagnostic accuracy and robustness over existing methods, establishing a more effective framework for future CADx systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。