通过拓扑对齐提升人脸识别泛化能力,解决隐空间结构坍缩问题。
TopoFR: A Closer Look at Topology Alignment on Face Recognition
- 用持久同调对齐输入与隐空间的拓扑结构,保留数据内在关系。
- 在多个主流人脸数据集上超越现有最优方法,显著提升识别准确率。
- 适合关注模型泛化性与结构信息利用的研究者或工业应用开发者。
深度学习推动了人脸识别(FR)的重大进展。近期无监督学习与图神经网络的成功表明数据结构信息具有重要价值。鉴于人脸识别可利用大规模训练数据,其本身蕴含丰富结构信息,我们旨在探索如何将此类关键结构信息编码至隐空间。观察发现,直接对齐输入与隐空间的结构信息易引发过拟合,导致隐空间出现结构坍缩。为此,本文提出TopoFR,采用一种名为PTSA的拓扑结构对齐策略和名为SDE的困难样本挖掘策略。具体而言,PTSA利用持久同调对齐输入与隐空间的拓扑结构,有效保留结构信息并提升模型泛化性能;SDE通过自动计算每一样本的结构损伤度(SDS),精准识别困难样本,并引导模型优先优化这些样本。在多个主流人脸基准测试中,实验结果证明TopoFR优于当前最优方法。代码与模型已公开于:https://github.com/modelscope/facechain/tree/main/face_module/TopoFR。
原文摘要 · Abstract (English)
The field of face recognition (FR) has undergone significant advancements with the rise of deep learning. Recently, the success of unsupervised learning and graph neural networks has demonstrated the effectiveness of data structure information. Considering that the FR task can leverage large-scale training data, which intrinsically contains significant structure information, we aim to investigate how to encode such critical structure information into the latent space. As revealed from our observations, directly aligning the structure information between the input and latent spaces inevitably suffers from an overfitting problem, leading to a structure collapse phenomenon in the latent space. To address this problem, we propose TopoFR, a novel FR model that leverages a topological structure alignment strategy called PTSA and a hard sample mining strategy named SDE. Concretely, PTSA uses persistent homology to align the topological structures of the input and latent spaces, effectively preserving the structure information and improving the generalization performance of FR model. To mitigate the impact of hard samples on the latent space structure, SDE accurately identifies hard samples by automatically computing structure damage score (SDS) for each sample, and directs the model to prioritize optimizing these samples. Experimental results on popular face benchmarks demonstrate the superiority of our TopoFR over the state-of-the-art methods. Code and models are available at: https://github.com/modelscope/facechain/tree/main/face_module/TopoFR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。