arXiv:2607.21004cs.CV2026-07

用面部动作单元建模跨域少样本表情识别,提升迁移能力

AUCH-Net: Action Unit-Based Consistency-Aware Hypergraph Network for Cross-Domain Few-Shot Facial Expression Recognition

论文配图:AUCH-Net: Action Unit-Based Consistency-Aware Hypergraph Network for Cross-Domain Few-Shot Facial Expression Recognition
图 1 · 摘自论文原文
  • 基于动作单元构建一致性超图,学习跨域一致特征
  • 在多个数据集上优于现有方法,显著提升少样本识别率
  • 适合研究跨域迁移与细粒度表情分析的学者使用

近期,跨域少样本人脸表情识别(CF-FER)受到广泛关注。然而,现有方法在大规模域差异和目标样本有限的情况下,仍存在可迁移特征学习不足的问题。动作单元(AUs)作为不同面部肌肉运动的标识,为表达在域内和域间提供了稳定的概念语义。受此启发,本文提出一种基于动作单元的一致性感知超图网络(AUCH-Net),通过在动作单元上构建一致性感知超图来解决CF-FER问题。具体地,AUCH-Net设计了新的动作单元特征学习(AFL)模块和视觉特征学习(VFL)模块。AFL模块在新型关系一致性损失和动作单元正则化损失的指导下学习动作单元特征;VFL模块则在关系一致性损失和分类损失的监督下学习视觉特征。通过学习一致的动作单元特征,AUCH-Net有效建模了动作单元与表情类别之间的关联,从而弥合细微面部变化与高层表情类别间的差距,显著促进可迁移特征表示的学习。在实验室与野外数据集上的大量实验表明,本方法持续优于多个最先进方法。结果明确显示,在跨域少样本场景下,建模动作单元间关系具有重要潜力。

原文摘要 · Abstract (English)

Recently, cross-domain few-shot facial expression recognition (CF-FER) has received considerable attention. However, the performance of existing CF-FER methods is still unsatisfactory due to inferior transferable feature learning under large domain discrepancy and limited target samples. Fortunately, the action units (AUs), which indicate the movements of different facial muscles, provide consistent conceptual semantics for describing expressions within and across domains. Inspired by this, we propose a novel Action Unit-based Consistency-aware Hypergraph Network (AUCH-Net), which constructs consistency-aware hypergraphs on AUs, for CF-FER. Specifically, AUCH-Net presents a new AU feature learning (AFL) module and a new visual feature learning (VFL) module. The AFL module learns AU features under the guidance of a novel relation consistency loss and an AU regularization loss, while the VFL module learns visual features supervised by a relation consistency loss and a classification loss. By learning consistent AU features, AUCH-Net effectively models the connections between AUs and expression categories. As a result, we can bridge the gap between fine-grained facial variations and high-level expression categories, greatly facilitating the learning of transferable feature representations.Extensive experiments on both in-the-lab and in-the-wild datasets show that our method consistently outperforms several state-of-the-art methods. Our results clearly show that modeling the relationships among AUs holds significant potential for FER under cross-domain few-shot scenarios.

表情识别少样本学习跨域迁移动作单元

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。