arXiv:2412.11045cs.CVcs.HC2024-12被引 4

用AI自动生成正颌手术后脸型预览,无需额外拍片。

Facial Surgery Preview Based on the Orthognathic Treatment Prediction

  • 基于FLAME模型和潜码优化,自动重建术后面部三维形态。
  • 引入嘴部凸度与对称性损失,提升预测准确性,细节更逼真。
  • 医生和普通人难分辨生成结果与真实术后效果,适合临床咨询。

正颌手术咨询对帮助患者理解术后面部变化至关重要。但现有可视化方法因术前术后数据有限且治疗复杂,常效率低、不准确。本研究提出全自动流程,无需额外医学影像即可生成精准高效的3D术后面容预览。引入新型美学损失(如嘴部凸度、对称性损失)以提升预测精度;设计专用参数化模型进行3D重建,结合医疗相关损失指导潜码预测网络优化,并采用数据增强缓解数据不足问题。利用FLAME参数化模型提取面部潜码,建立术前术后几何的密集对应关系,显著提升预览质量。定量对比验证算法有效性,定性结果显示面部轮廓与细节预测准确。用户研究表明,医生与公众难以区分机器生成结果与真实术后图像。本研究为正颌手术咨询提供实用高效解决方案,惠及医患双方。

原文摘要 · Abstract (English)

Orthognathic surgery consultation is essential to help patients understand the changes to their facial appearance after surgery. However, current visualization methods are often inefficient and inaccurate due to limited pre- and post-treatment data and the complexity of the treatment. To overcome these challenges, this study aims to develop a fully automated pipeline that generates accurate and efficient 3D previews of postsurgical facial appearances for patients with orthognathic treatment without requiring additional medical images. The study introduces novel aesthetic losses, such as mouth-convexity and asymmetry losses, to improve the accuracy of facial surgery prediction. Additionally, it proposes a specialized parametric model for 3D reconstruction of the patient, medical-related losses to guide latent code prediction network optimization, and a data augmentation scheme to address insufficient data. The study additionally employs FLAME, a parametric model, to enhance the quality of facial appearance previews by extracting facial latent codes and establishing dense correspondences between pre- and post-surgery geometries. Quantitative comparisons showed the algorithm's effectiveness, and qualitative results highlighted accurate facial contour and detail predictions. A user study confirmed that doctors and the public could not distinguish between machine learning predictions and actual postoperative results. This study aims to offer a practical, effective solution for orthognathic surgery consultations, benefiting doctors and patients.

正颌手术3D重建AI预测面部生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。