arXiv:2510.13540cs.CV2025-10中稿 · publication at the…

用单目视频重建高精度乳房3D模型,误差小于2毫米。

Learning Neural Parametric 3D Breast Shape Models for Metrical Surface Reconstruction From Monocular RGB Videos

  • 将乳房区域分解为多个局部区域,每个区域用神经SDF建模。
  • 在真实数据上实现低于2毫米的重建误差,优于全局模型。
  • 无需专业设备,开源可复现,适合医疗与健康应用。

我们提出一种神经参数化3D乳房形状模型,并基于此构建了一种低成本、易获取的3D表面重建流程,能够从单目RGB视频中恢复精确的乳房几何结构。相比昂贵的商业3D扫描方案和现有低成本替代方法,该方法无需专用硬件或专有软件,仅需能录制RGB视频的任意设备即可运行。核心组件为先进的现成运动恢复结构(Structure-from-motion)流程,搭配参数化乳房模型以实现鲁棒且度量准确的表面重建。我们的模型(liRBSM,即局部隐式乳房模型)受最新人脸模型启发,将隐式乳房域分解为多个局部区域,每个区域由锚定在解剖标志点上的本地神经SDF表示。与近期提出的隐式雷根斯堡乳房模型(iRBSM)相比,后者采用单一全局神经符号距离函数(SDF),而liRBSM通过分区域建模显著提升了重建质量,生成更精细的表面细节。整体上,该流程能在不足6分钟内完成重建,误差小于2毫米,全程透明、开源,相关代码与模型已公开发布于https://rbsm.re-mic.de/local-implicit。

原文摘要 · Abstract (English)

We present a neural parametric 3D breast shape model and, based on this model, introduce a low-cost and accessible 3D surface reconstruction pipeline capable of recovering accurate breast geometry from a monocular RGB video. In contrast to widely used, commercially available yet prohibitively expensive 3D breast scanning solutions and existing low-cost alternatives, our method requires neither specialized hardware nor proprietary software and can be used with any device that is able to record RGB videos. The key building blocks of our pipeline are a state-of-the-art, off-the-shelf Structure-from-motion pipeline, paired with a parametric breast model for robust and metrically correct surface reconstruction. Our model, similarly to the recently proposed implicit Regensburg Breast Shape Model (iRBSM), leverages implicit neural representations to model breast shapes. However, unlike the iRBSM, which employs a single global neural signed distance function (SDF), our approach -- inspired by recent state-of-the-art face models -- decomposes the implicit breast domain into multiple smaller regions, each represented by a local neural SDF anchored at anatomical landmark positions. When incorporated into our surface reconstruction pipeline, the proposed model, dubbed liRBSM (short for localized iRBSM), significantly outperforms the iRBSM in terms of reconstruction quality, yielding more detailed surface reconstruction than its global counterpart. Overall, we find that the introduced pipeline is able to recover high-quality 3D breast geometry within an error margin of less than 2 mm. Our method is fast (requires less than six minutes), fully transparent and open-source, and -- together with the model -- publicly available at https://rbsm.re-mic.de/local-implicit.

3D重建神经建模医学影像单目视频

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。