通过挖掘潜在关系提升面部年龄估计精度
LRA-GNN: Latent Relation-Aware Graph Neural Network with Initial and Dynamic Residual for Facial Age Estimation
- 基于关键点构建初始图,用随机游走捕捉全局结构
- 多注意力机制发现缺失的潜在关系,生成完整连接图
- 动态残差设计避免过平滑,适合高精度年龄预测场景
面部信息主要集中在关键点区域,前沿研究已开始使用图神经网络将人脸划分为块作为节点以建模复杂表征。然而,现有方法依赖相似性阈值构建节点间关系,导致部分潜在关系丢失,而这些关系对深层面部老化语义表示至关重要。为此,本文提出一种带初始与动态残差的潜在关系感知图神经网络(LRA-GNN),实现鲁棒且全面的人脸表征。首先利用关键点作为先验知识构建初始图,并通过随机游走获取全局结构,共同引导后续有效探索与完整表征。随后,LRA-GNN采用多注意力机制捕捉潜在关系,生成包含丰富面部信息和完整结构的全连接图。为避免在全连接图上进行深度特征提取时出现过平滑问题,精心设计了融合自适应初始残差与动态发展残差的深度残差图卷积网络,确保信息的一致性与多样性。最后,引入渐进式强化学习优化集成分类回归器,显著提升估计精度与泛化能力。该框架在多个年龄估计基准上超越现有最优方法,验证了其有效性。
原文摘要 · Abstract (English)
Face information is mainly concentrated among facial key points, and frontier research has begun to use graph neural networks to segment faces into patches as nodes to model complex face representations. However, these methods construct node-to-node relations based on similarity thresholds, so there is a problem that some latent relations are missing. These latent relations are crucial for deep semantic representation of face aging. In this novel, we propose a new Latent Relation-Aware Graph Neural Network with Initial and Dynamic Residual (LRA-GNN) to achieve robust and comprehensive facial representation. Specifically, we first construct an initial graph utilizing facial key points as prior knowledge, and then a random walk strategy is employed to the initial graph for obtaining the global structure, both of which together guide the subsequent effective exploration and comprehensive representation. Then LRA-GNN leverages the multi-attention mechanism to capture the latent relations and generates a set of fully connected graphs containing rich facial information and complete structure based on the aforementioned guidance. To avoid over-smoothing issues for deep feature extraction on the fully connected graphs, the deep residual graph convolutional networks are carefully designed, which fuse adaptive initial residuals and dynamic developmental residuals to ensure the consistency and diversity of information. Finally, to improve the estimation accuracy and generalization ability, progressive reinforcement learning is proposed to optimize the ensemble classification regressor. Our proposed framework surpasses the state-of-the-art baselines on several age estimation benchmarks, demonstrating its strength and effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。