系统梳理医学影像转三维网格的深度学习方法,助力疾病研究与诊疗模拟。
From Pixels to Polygons: A Survey of Deep Learning Approaches for Medical Image-to-Mesh Reconstruction
- 按模板、统计、生成、隐式四类归纳现有方法
- 覆盖心脑等多器官,定量评估不同模型性能
- 适合医学图像分析与计算医学领域的研究者
基于深度学习的医学图像到网格重建技术迅速发展,可将医学影像数据转化为三维网格模型,对计算医学和虚拟临床试验至关重要,有助于深化对疾病机制及诊断治疗手段的理解。本综述将现有方法系统分类为四类:模板模型、统计模型、生成模型和隐式模型。详细分析各类方法的理论基础、优缺点及其在不同解剖结构和成像模态下的适用性。通过标准评价指标对多种解剖应用(从心脏成像到神经科学研究)中的方法进行广泛评估,并整理分析主流公开数据集、常用评价指标与损失函数。识别当前挑战,包括拓扑正确性、几何精度和多模态融合需求。最后提出该领域未来有前景的研究方向。本综述旨在为医学图像分析与计算医学研究者提供全面参考。
原文摘要 · Abstract (English)
Deep learning-based medical image-to-mesh reconstruction has rapidly evolved, enabling the transformation of medical imaging data into three-dimensional mesh models that are critical in computational medicine and in silico trials for advancing our understanding of disease mechanisms, and diagnostic and therapeutic techniques in modern medicine. This survey systematically categorizes existing approaches into four main categories: template models, statistical models, generative models, and implicit models. Each category is analysed in detail, examining their methodological foundations, strengths, limitations, and applicability to different anatomical structures and imaging modalities. We provide an extensive evaluation of these methods across various anatomical applications, from cardiac imaging to neurological studies, supported by quantitative comparisons using standard metrics. Additionally, we compile and analyze major public datasets available for medical mesh reconstruction tasks and discuss commonly used evaluation metrics and loss functions. The survey identifies current challenges in the field, including requirements for topological correctness, geometric accuracy, and multi-modality integration. Finally, we present promising future research directions in this domain. This systematic review aims to serve as a comprehensive reference for researchers and practitioners in medical image analysis and computational medicine.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。