arXiv:2501.16716cs.CV2025-01被引 1

用大模型学习解剖先验,从稀疏点云重建高保真骨盆3D模型。

Med-PU: Point Cloud Upsampling for High-Fidelity 3D Medical Shape Reconstruction

  • 从医学图像分割生成点云,用深度网络实现稠密补全
  • 在骨盆CT数据上提升表面质量,减少伪影,精度优于现有方法
  • 不依赖特定结构,可推广至其他骨骼与器官建模

高保真3D解剖结构重建是术前规划、放疗靶区勾画和骨科植入物设计等临床任务的基础。本文提出Med-PU,一种融合体素医学图像分割与点云上采样的知识驱动框架,用于精准重建骨盆形态。不同于基于关键点或PCA的统计形状模型,Med-PU直接从大规模3D形状数据中学习隐式解剖先验,能够从稀疏的分割点集实现稠密补全与精细化重构。该流程结合SAM-Med3D的体素分割、点提取、深度上采样与表面重建,生成平滑且拓扑一致的网格。我们在骨盆CT数据集(训练用MedShapePelvic,验证用Pelvic1k)上评估,采用全面的几何与表面指标对比了当前最优的上采样方法。Med-PU在不同输入密度下均显著提升表面质量与解剖保真度,同时减少伪影,展现出良好鲁棒性。尽管验证集中为骨盆,但该方法具有解剖无关性,适用于其他骨骼区域与器官。结果表明,Med-PU是连接分割输出与临床可用3D模型的实用、可泛化的工具。

原文摘要 · Abstract (English)

High-fidelity 3D anatomical reconstruction is a prerequisite for downstream clinical tasks such as preoperative planning, radiotherapy target delineation, and orthopedic implant design. We present Med-PU, a knowledge-driven framework that integrates volumetric medical image segmentation with point cloud upsampling for accurate pelvic shape reconstruction. Unlike landmark- or PCA-based statistical shape models, Med-PU learns an implicit anatomical prior directly from large-scale 3D shape data, enabling dense completion and refinement from sparse segmentation-derived point sets. The pipeline couples SAM-Med3D-based voxel segmentation, point extraction, deep upsampling, and surface reconstruction, yielding smooth and topologically consistent meshes. We evaluate Med-PU on pelvic CT datasets (MedShapePelvic for training and Pelvic1k for validation), benchmarking against state-of-the-art upsampling methods using comprehensive geometry and surface metrics. Med-PU consistently improves surface quality and anatomical fidelity while reducing artifacts, demonstrating robustness across input densities. Although validated on the pelvis, the approach is anatomy-agnostic and applicable to other skeletal regions and organs. These results suggest Med-PU as a practical, generalizable tool to bridge segmentation outputs and clinically usable 3D models.

3D重建点云上采样医学影像深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。