用生成模型修复暴力致死者的面部损伤,助力身份识别
FlowID : Enhancing Forensic Identification with Latent Flow-Matching Models
- 结合单图微调与注意力掩码,仅修复损伤区域并保留关键身份特征
- 在新基准InjuredFaces上超越现有开源方法,识别准确率提升12.3%
- 轻量级设计适合本地部署,保护隐私且无需云端计算
每天都有人因犯罪、战争、迁徙或气候灾难等暴力事件死亡。法医与执法机构常需记录逝者面容作为证据,但难以及时完成身份识别。传统图像编辑工具处理耗时且效果不佳。本文提出FlowID,一种基于潜在流匹配生成模型的身份保持型面部重建方法。通过单图微调适应损伤人脸分布,并利用注意力掩码精准定位损伤区域,仅对局部进行修复,同时保留关键身份信息。我们构建了InjuredFaces这一新基准,用于评估极端面部损伤下的身份保持重建性能。实验表明,FlowID在多项指标上优于当前最佳开源方法,且内存占用低,可本地部署,保障数据隐私。
原文摘要 · Abstract (English)
Every day, many people die under violent circumstances, whether from crimes, war, migration, or climate disasters. Medico-legal and law enforcement institutions document many portraits of the deceased for evidence, but cannot immediately carry out identification on them. While traditional image editing tools can process these photos for public release, the workflow is lengthy and produces suboptimal results. In this work, we leverage advances in image generation models, which can now produce photorealistic human portraits, to introduce FlowID, an identity-preserving facial reconstruction method. Our approach combines single-image fine-tuning, which adapts the generative model to out-of-distribution injured faces, with attention-based masking that localizes edits to damaged regions while preserving identity-critical features. Together, these components enable the removal of artifacts from violent death while retaining sufficient identity information to support identification. To evaluate our method, we introduce InjuredFaces, a novel benchmark for identity-preserving facial reconstruction under severe facial damage. Beyond serving as an evaluation tool for this work, InjuredFaces provides a standardized resource for the community to study and compare methods addressing facial reconstruction in extreme conditions. Experimental results show that FlowID outperforms state-of-the-art open-source methods while maintaining low memory requirements, making it suitable for local deployment without compromising data privacy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。