arXiv:2601.12863cs.CV2026-01被引 2

通过频域引导与任务平衡,提升复杂场景下人脸关键点检测精度。

FGTBT: Frequency-Guided Task-Balancing Transformer for Unified Facial Landmark Detection

  • 基于频域建模和关键点级任务平衡,增强面部结构感知。
  • 在300W、AFW等数据集上达到领先性能,显著降低大姿态下的误差。
  • 适合需要高鲁棒性的人脸对齐、表情识别等应用。

近年来,基于深度学习的人脸关键点检测(FLD)方法取得了显著进展。然而,在大姿态变化、光照差异和表情波动等挑战性场景下,现有方法仍难以准确捕捉面部几何结构,导致性能下降。此外,现有FLD数据集规模有限且多样性不足,制约了模型的鲁棒性训练。为此,本文提出频率引导的任务平衡变压器(FGTBT),通过频域建模和多数据集统一训练提升面部结构感知能力。具体地,提出细粒度多任务平衡损失(FMB-loss),根据关键点在不同数据集中的出现频率动态分配权重,实现个体关键点级的梯度平衡,有效缓解梯度不一致问题。同时设计频率引导的结构感知模块(FGSA),利用频域引导的结构注入与正则化,强化面部结构约束学习。在300W、AFW、IBUG等主流基准数据集上的大量实验表明,FGTBT框架结合FMB-loss与FGSA模型,性能媲美当前最先进方法。代码已公开于https://github.com/Xi0ngxinyu/FGTBT。

原文摘要 · Abstract (English)

Recently, deep learning based facial landmark detection (FLD) methods have achieved considerable success. However, in challenging scenarios such as large pose variations, illumination changes, and facial expression variations, they still struggle to accurately capture the geometric structure of the face, resulting in performance degradation. Moreover, the limited size and diversity of existing FLD datasets hinder robust model training, leading to reduced detection accuracy. To address these challenges, we propose a Frequency-Guided Task-Balancing Transformer (FGTBT), which enhances facial structure perception through frequency-domain modeling and multi-dataset unified training. Specifically, we propose a novel Fine-Grained Multi-Task Balancing loss (FMB-loss), which moves beyond coarse task-level balancing by assigning weights to individual landmarks based on their occurrence across datasets. This enables more effective unified training and mitigates the issue of inconsistent gradient magnitudes. Additionally, a Frequency-Guided Structure-Aware (FGSA) model is designed to utilize frequency-guided structure injection and regularization to help learn facial structure constraints. Extensive experimental results on popular benchmark datasets demonstrate that the integration of the proposed FMB-loss and FGSA model into our FGTBT framework achieves performance comparable to state-of-the-art methods. The code is available at https://github.com/Xi0ngxinyu/FGTBT.

人脸检测结构感知任务平衡频域建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。