将卷积与注意力机制结合,提升人脸年龄估计精度。
Integrating ConvNeXt and Vision Transformers for Enhancing Facial Age Estimation
- 融合ConvNeXt局部特征提取与ViT全局注意力优势。
- 在MORPH II等数据集上MAE显著低于传统方法。
- 适合关注模型融合与视觉任务优化的研究者。
从人脸图像中进行年龄估计是计算机视觉中的复杂挑战。本文提出一种新型混合架构,将ConvNeXt(CNN的最新进展)与视觉变换器(ViT)相结合。尽管两者各自在多种任务上表现优异,其融合可互补利用CNN的局部特征提取能力与ViT的全局注意力机制。所提出的ConvNeXt-ViT混合模型在MORPH II、CACD和AFAD等基准数据集上进行了全面评估,以平均绝对误差(MAE)为指标表现出更优性能。为应对计算约束,采用预训练模型并系统探索不同配置,使用线性层与先进正则化技术优化架构。消融实验表明各组件及训练策略的关键作用,尤其强调在CNN框架中适配注意力机制对聚焦年龄相关面部特征的重要性。结果表明,该混合模型不仅超越传统方法,还为年龄估计及相关视觉任务提供了稳健基础。本工作凸显了混合架构的变革潜力,代表了CNN与Transformer无缝集成应对复杂视觉挑战的有前景方向。
原文摘要 · Abstract (English)
Age estimation from facial images is a complex and multifaceted challenge in computer vision. In this study, we present a novel hybrid architecture that combines ConvNeXt, a state-of-the-art advancement of convolutional neural networks (CNNs), with Vision Transformers (ViT). While each model independently delivers excellent performance on a variety of tasks, their integration leverages the complementary strengths of the CNNs localized feature extraction capabilities and the Transformers global attention mechanisms. Our proposed ConvNeXt-ViT hybrid solution was thoroughly evaluated on benchmark age estimation datasets, including MORPH II, CACD, and AFAD, and achieved superior performance in terms of mean absolute error (MAE). To address computational constraints, we leverage pre-trained models and systematically explore different configurations, using linear layers and advanced regularization techniques to optimize the architecture. Comprehensive ablation studies highlight the critical role of individual components and training strategies, and in particular emphasize the importance of adapted attention mechanisms within the CNN framework to improve the model focus on age-relevant facial features. The results show that the ConvNeXt-ViT hybrid not only outperforms traditional methods, but also provides a robust foundation for future advances in age estimation and related visual tasks. This work underscores the transformative potential of hybrid architectures and represents a promising direction for the seamless integration of CNNs and transformers to address complex computer vision challenges.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。