用生成模型从2D X光片重建人脸,提升法医颅面识别效率。
FCR: Investigating Generative AI models for Forensic Craniofacial Reconstruction
- 基于CycleGAN等生成模型,跨域融合颅骨与面部特征。
- 生成人脸在FID、IS、SSIM指标上表现良好,具备可辨识性。
- 首次将2D X光片用于颅面重建,适合法医与图像分析领域。
法医颅面重建是通过遗骸识别受害者的重要手段,尤其在其他方法失效时至关重要。传统黏土建模依赖专家且耗时,而现有统计形状模型难以捕捉颅骨与面部的跨域关联。本文提出一种通用框架,利用2D X光片作为颅骨表征,采用CycleGAN、cGAN等生成模型,微调生成器与判别器以实现颅骨与人脸间的跨域生成。这是首次将2D X光片用于生成式颅面重建。通过FID、IS和SSIM评估生成人脸质量,并构建以生成图像为查询、真实人脸库为候选集的检索系统。实验表明,该方法可作为法医识别的有效辅助工具。
原文摘要 · Abstract (English)
Craniofacial reconstruction in forensics is one of the processes to identify victims of crime and natural disasters. Identifying an individual from their remains plays a crucial role when all other identification methods fail. Traditional methods for this task, such as clay-based craniofacial reconstruction, require expert domain knowledge and are a time-consuming process. At the same time, other probabilistic generative models like the statistical shape model or the Basel face model fail to capture the skull and face cross-domain attributes. Looking at these limitations, we propose a generic framework for craniofacial reconstruction from 2D X-ray images. Here, we used various generative models (i.e., CycleGANs, cGANs, etc) and fine-tune the generator and discriminator parts to generate more realistic images in two distinct domains, which are the skull and face of an individual. This is the first time where 2D X-rays are being used as a representation of the skull by generative models for craniofacial reconstruction. We have evaluated the quality of generated faces using FID, IS, and SSIM scores. Finally, we have proposed a retrieval framework where the query is the generated face image and the gallery is the database of real faces. By experimental results, we have found that these generative models can be used as an assisting tool for craniofacial identifications in forensic science.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。