arXiv:2505.09256cs.CV2025-05被引 1

测试时通过生成侧脸图像提升人脸识别准确率,无需重新训练。

Test-Time Augmentation for Pose-invariant Face Recognition

  • 测试时用驱动图像姿态生成对应侧脸,避免正面化带来的失真。
  • 在多个数据集上提升识别性能,最高增益达3.2%(LFW)。
  • 可无缝集成到现有系统,不需微调或重训练模型。

本文旨在通过测试阶段的姿态增强来提升人脸识别性能。现有方法通常依赖于正面化图像训练或学习姿态不变表征,但这些方法往往需要为每个数据集重新训练和测试,耗时耗力。为此,本文提出Pose-TTA,一种在推理时对齐人脸姿态而无需额外训练的新方法。该方法采用肖像动画器,将源图像身份迁移至驱动图像的姿态。与将侧脸正面化不同,Pose-TTA生成匹配的侧脸图像用于对比,从而减少身份信息丢失。此外,提出加权特征融合策略,缓解合成数据可能引入的失真或偏差,提高增强图像的可靠性。大量实验在多种数据集及预训练模型上验证了其有效性,证明Pose-TTA能持续提升推理性能。本方法易于集成到现有人脸识别流程中,无需对底层识别模型进行重训练或微调。

原文摘要 · Abstract (English)

The goal of this paper is to enhance face recognition performance by augmenting head poses during the testing phase. Existing methods often rely on training on frontalised images or learning pose-invariant representations, yet both approaches typically require re-training and testing for each dataset, involving a substantial amount of effort. In contrast, this study proposes Pose-TTA, a novel approach that aligns faces at inference time without additional training. To achieve this, we employ a portrait animator that transfers the source image identity into the pose of a driving image. Instead of frontalising a side-profile face -- which can introduce distortion -- Pose-TTA generates matching side-profile images for comparison, thereby reducing identity information loss. Furthermore, we propose a weighted feature aggregation strategy to address any distortions or biases arising from the synthetic data, thus enhancing the reliability of the augmented images. Extensive experiments on diverse datasets and with various pre-trained face recognition models demonstrate that Pose-TTA consistently improves inference performance. Moreover, our method is straightforward to integrate into existing face recognition pipelines, as it requires no retraining or fine-tuning of the underlying recognition models.

人脸识别姿态不变测试增强无重训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。