arXiv:2411.01508cs.CVcs.AI2024-11被引 3

FaceDig用AI自动标记人脸特征点,精度媲美专家,提升研究可重复性。

FaceDig: Automated tool for placing landmarks on facial portraits for geometric morphometrics users

  • 基于大规模多元族裔人脸数据训练,自动化定位解剖学特征点
  • 输出坐标与人工标注一致,兼容TpsDig2等主流分析工具
  • 适合需要标准化人脸形态分析的研究者,尤其适用于2D照片研究

地标数字化是几何形态测量学的核心环节,用于量化生物形态(如面部结构)以进行深入分析。传统地标法依赖特定解剖点,当精确位置难以界定时可辅以半地标。然而,大量地标的人工标记耗时且易出错,导致研究间不一致。为此,我们推出开源工具FaceDig,利用AI实现高精度自动地标定位,聚焦于解剖学合理的面部点位。该工具基于目前最大且最多样化的面部数据集训练,采用针对2D正面照片优化的地标配置。结果显示,FaceDig生成的坐标与专家手动标注结果相当可靠。其输出兼容广泛使用的TpsDig2软件,便于集成并确保跨研究一致性。建议用户使用标准面部图像,并对结果进行视觉检查以修正潜在偏差。尽管3D形态测量日益流行,2D面部照片仍具文化和实践价值。未来将扩展至侧视图支持,进一步提升实用性。通过提供标准化地标定位方案,FaceDig推动面部形态研究的可重复性,为现有2D工具提供有力替代。

原文摘要 · Abstract (English)

Landmark digitization is essential in geometric morphometrics, enabling the quantification of biological shapes, such as facial structures, for in-depth morphological analysis. Traditional landmarking, which identifies specific anatomical points, can be complemented by semilandmarks when precise locations are challenging to define. However, manual placement of numerous landmarks is time-consuming and prone to human error, leading to inconsistencies across studies. To address this, we introduce FaceDig, an AI-powered tool designed to automate landmark placement with human-level precision, focusing on anatomically sound facial points. FaceDig is open-source and integrates seamlessly with analytical platforms like R and Python. It was trained using one of the largest and most ethnically diverse face datasets, applying a landmark configuration optimized for 2D enface photographs. Our results demonstrate that FaceDig provides reliable landmark coordinates, comparable to those placed manually by experts. The tool's output is compatible with the widely-used TpsDig2 software, facilitating adoption and ensuring consistency across studies. Users are advised to work with standardized facial images and visually inspect the results for potential corrections. Despite the growing preference for 3D morphometrics, 2D facial photographs remain valuable due to their cultural and practical significance. Future enhancements to FaceDig will include support for profile views, further expanding its utility. By offering a standardized approach to landmark placement, FaceDig promotes reproducibility in facial morphology research and provides a robust alternative to existing 2D tools.

形态测量人脸识别AI工具自动化标注

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。