arXiv:2605.01746cs.CV2026-05中稿 · CVPR

从单张侧脸图重建3D人脸,助力无辐射正畸分析

Profile-Specific 3DMM Regression from a Single Lateral Face Image

论文配图:Profile-Specific 3DMM Regression from a Single Lateral Face Image
图 1 · 摘自论文原文
  • 用扩散模型生成极端侧视的逼真人脸图像,模拟真实侧脸数据
  • 提出可见性感知的下颌线正则化方法,提升侧脸轮廓重建精度
  • 专为侧脸设计的3DMM回归基线,适合临床正畸等医学应用

单图像3D人脸重建是计算机视觉的核心问题,在正畸学中用于头影测量点分析具有重要临床价值。传统方法依赖侧位X光片,但频繁辐射暴露不切实际。现有基于侧视RGB图像的方法多依赖2D特征(如眼睛、嘴巴、耳朵和轮廓),未能充分利用面部轮廓与下颌线所蕴含的深层3D几何信息,影响诊断准确性。尽管正面视角的3D重建已有显著进展,但多数学习型3D可变形模型(3DMM)回归器基于近正面图像训练与评估,而在极端侧视(偏航角≈90°)时,面部大部被遮挡,有效信号以边界线索为主,重建难度高。本文通过几何条件化合成数据与简单侧脸专用的FLAME回归基线填补该空白。我们构建了ProfileSynth数据集,通过在极端偏航范围内采样FLAME形状与姿态参数,并利用以深度图和法向图条件化的扩散模型生成逼真侧脸图像。此外,我们提出一种可见性感知的下颌线正则化策略。本框架为“侧脸×3DMM”重建提供了实用基线,为从侧视RGB图像实现更准确、无创的头影测量分析奠定了基础。

原文摘要 · Abstract (English)

Single-image 3D face reconstruction is a core problem in computer vision, with important clinical applications such as cephalometric landmark analysis in orthodontics. Traditionally, this analysis relies on lateral X-ray imaging; however, frequent X-ray exposure is impractical due to radiation concerns. While recent research has explored detecting landmarks from lateral RGB images as an alternative, existing methods typically rely on 2D features such as the eyes, mouth, ears, and boundary silhouettes, failing to fully exploit the underlying 3D facial geometry spanning the facial profile and jawline, which is essential for accurate diagnosis. Meanwhile, although 3D face reconstruction from frontal views has seen significant progress, most learning-based 3D morphable model (3DMM) regressors are developed and benchmarked on near-frontal images, where appearance cues are abundant. In extreme profile views (yaw $\approx 90^\circ$), much of the face is occluded, and the available signal is dominated by boundary cues, making accurate 3D reconstruction challenging. In this paper, we bridge this gap with geometry-conditioned synthetic data and a simple profile-specific FLAME regression baseline for single lateral images. We introduce ProfileSynth, a dataset created by sampling FLAME shape and pose parameters in extreme yaw ranges and generating photorealistic profile images using a diffusion model conditioned on depth and normal maps. We further study a profile-specific baseline with visibility-aware jawline regularization. Our framework provides a practical baseline for "profile $\times$ 3DMM" reconstruction and a promising foundation for more accurate, non-invasive cephalometric analysis from lateral RGB images.

3D人脸重建侧脸分析医学影像扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。