arXiv:2503.08974cs.CV2025-03被引 5

提出双自适应丢弃机制,提升面部动作单元检测的跨域泛化能力。

Beyond Overfitting: Doubly Adaptive Dropout for Generalizable AU Detection

  • 通过通道与令牌两级自适应丢弃,抑制域特异性噪声。
  • 在多个跨域数据集上超越现有方法,提升检测鲁棒性。
  • 适合需要高泛化能力的表情识别研究者使用。

面部动作单元(AUs)是表达心理状态和情感的关键。尽管基于深度学习的自动AU检测系统已取得进展,但通常会过拟合特定数据集和个体特征,限制了跨域适用性。为此,我们提出一种用于跨域AU检测的双重自适应丢弃方法,增强卷积特征图和空间标记对域偏移的鲁棒性。该方法包含通道丢弃单元(CD-Unit)和令牌丢弃单元(TD-Unit),分别在通道与标记层级减少域特异性噪声。CD-Unit保留特征图中域无关的局部模式,TD-Unit帮助模型识别跨域通用的AU关系。每层集成辅助域分类器,引导选择性剔除域敏感特征。采用渐进式训练策略,防止过度特征丢弃,实现任意层的选择性排除。大量实验验证了该方法在跨域AU检测中的持续优越性。注意力图可视化显示了与单个及组合AU相关的清晰、有意义的模式,进一步证实其有效性。

原文摘要 · Abstract (English)

Facial Action Units (AUs) are essential for conveying psychological states and emotional expressions. While automatic AU detection systems leveraging deep learning have progressed, they often overfit to specific datasets and individual features, limiting their cross-domain applicability. To overcome these limitations, we propose a doubly adaptive dropout approach for cross-domain AU detection, which enhances the robustness of convolutional feature maps and spatial tokens against domain shifts. This approach includes a Channel Drop Unit (CD-Unit) and a Token Drop Unit (TD-Unit), which work together to reduce domain-specific noise at both the channel and token levels. The CD-Unit preserves domain-agnostic local patterns in feature maps, while the TD-Unit helps the model identify AU relationships generalizable across domains. An auxiliary domain classifier, integrated at each layer, guides the selective omission of domain-sensitive features. To prevent excessive feature dropout, a progressive training strategy is used, allowing for selective exclusion of sensitive features at any model layer. Our method consistently outperforms existing techniques in cross-domain AU detection, as demonstrated by extensive experimental evaluations. Visualizations of attention maps also highlight clear and meaningful patterns related to both individual and combined AUs, further validating the approach's effectiveness.

表情识别跨域检测自适应丢弃深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。