首个多视角单目度量3D重建模型,助力皮肤病变精准测量
DermDepth: Toward Monocular Metric Scale 3D Reconstruction Models for Dermatology

- 基于单张图像实现毫米级精度3D重建与表面纹理估计
- 在真实皮肤数据上将尺度误差从16倍降至1.1倍以内
- 适用于不同肤色、伤口及肿瘤场景,临床适用性强
皮肤病学实践中,病变大小、形态和纹理的测量与追踪是伤口或皮肤癌筛查、监测和诊断的关键。临床常使用普通摄像头拍摄皮肤表面,但研究多聚焦2D方法,而3D信息更优。本文提出DermDepth,首个面向皮肤科的单视图度量尺度3D模型,以及首个具有像素级3D标注的合成皮肤镜数据集D-Synth。实验表明,在D-Synth上训练后,DermDepth将真实皮肤镜数据的尺度误差从超过16倍降至1.1倍以下,同时保持几何质量并增强纹理表现。仅需少量真实临床样本微调,即可在三个真实基准上跨毫米至百厘米尺度、多种肤色及慢性创面场景中稳定应用,测量结果与医学文献报道的病灶尺寸高度一致。代码、数据与模型已开源。
原文摘要 · Abstract (English)
Dermatological practice routinely involves measuring and tracking lesion size, morphology and texture, as critical components of wound or skin cancer screening, monitoring and diagnosis. To accomplish this task, practitioners often image the skin surface with commonly available off-the-shelf camera sensors. This has led to an overwhelming research focus on 2D methods while these objectives naturally benefit from 3D information. In this paper, we demonstrate that dense monocular 3D reconstructions, metric scale measurements and rich surface normal texture estimates are achievable for both dermoscopic and macroscopic cases without the need for additional hardware or multiple captures. We present DermDepth, the first single-view metric scale 3D model for the dermatological domain and D-Synth, the first synthetic dermoscopic dataset with pixel-perfect 3D information. Our experiments show training DermDepth on D-Synth corrects metric scale error from over 16x to under 1.1x for real dermoscopic data, while preserving geometric quality and increasing texture richness. Fine-tuning on a small amount of real clinical samples generalizes our method across three real-world benchmarks spanning the few mm to hundred cm range, diverse skin-tones, chronic wound cases and produces measurements broadly consistent with disease size reported in medical literature. All code, data and models are available at https://github.com/hectorcarrion/dermdepth.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。