arXiv:2504.00191cs.CV2025-04

用扩散模型生成冠脉造影合成数据,提升3D重建匹配精度

Leveraging Diffusion Model and Image Foundation Model for Improved Correspondence Matching in Coronary Angiography

  • 用CCTA三维模型生成真实感冠脉造影配对图像作为训练数据
  • 在合成与真实数据上均实现更高匹配准确率,优于传统方法
  • 验证了视觉基础模型在医学图像匹配中的潜力,适合医疗影像研究者

冠脉造影图像中精准的对应匹配对于重建3D冠状动脉结构至关重要,是精准诊断和治疗规划的基础。传统自然图像匹配方法难以泛化到缺乏纹理、对比度低且结构重叠的X射线图像,加之训练数据不足,导致性能受限。为此,本文提出一种新流程:利用扩散模型,基于冠脉计算机断层扫描血管造影(CCTA)重建的3D网格2D投影,生成高质量的配对冠脉造影图像,用于训练;同时引入大规模图像基础模型引导特征聚合,聚焦语义相关区域与关键点,显著提升匹配精度。实验表明,该方法在合成数据集上表现优异,并有效泛化至真实数据集,为该任务提供了实用解决方案。此外,研究还评估了不同基础模型在对应匹配中的效果,为先进视觉基础模型在医学影像中的应用提供了新见解。

原文摘要 · Abstract (English)

Accurate correspondence matching in coronary angiography images is crucial for reconstructing 3D coronary artery structures, which is essential for precise diagnosis and treatment planning of coronary artery disease (CAD). Traditional matching methods for natural images often fail to generalize to X-ray images due to inherent differences such as lack of texture, lower contrast, and overlapping structures, compounded by insufficient training data. To address these challenges, we propose a novel pipeline that generates realistic paired coronary angiography images using a diffusion model conditioned on 2D projections of 3D reconstructed meshes from Coronary Computed Tomography Angiography (CCTA), providing high-quality synthetic data for training. Additionally, we employ large-scale image foundation models to guide feature aggregation, enhancing correspondence matching accuracy by focusing on semantically relevant regions and keypoints. Our approach demonstrates superior matching performance on synthetic datasets and effectively generalizes to real-world datasets, offering a practical solution for this task. Furthermore, our work investigates the efficacy of different foundation models in correspondence matching, providing novel insights into leveraging advanced image foundation models for medical imaging applications.

医学影像扩散模型图像匹配冠脉重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。