针对人脸表情识别中的多源域适应难题,提出渐进式融合策略提升个性化建模效果。
Progressive Multi-Source Domain Adaptation for Personalized Facial Expression Recognition
- 按相似度逐步引入源域数据,避免不相关源域导致的负迁移
- 在多个数据集上实现比现有方法最高提升6.2%的准确率
- 适合需要个性化表情识别的智能交互与医疗诊断场景
个性化人脸表情识别(FER)需利用标注源域和未标注目标域样本适配模型。由于表情细微且个体差异大,当前最先进的无监督域适应(UDA)方法采用多源域适应(MSDA)设置,每个源域对应特定个体,以提升模型精度与鲁棒性。然而,当适配特定目标时,多个源域间的多样性带来显著的源-目标分布偏移。现有方法通常同时整合所有源域,但可能因分布差异过大引发负迁移,并增加计算开销及对齐偏差。为此,本文提出一种渐进式多源域适应方法:根据源域与目标域的相似度,逐步引入信息,仅保留最相关的源域,有效减少分布偏移。首先利用最相似的源域降低初始偏移,再逐步扩展至较远源域,基于预设阈值筛选。此外,为缓解增量引入带来的灾难性遗忘,设计了一种基于密度的记忆机制,保存关键历史源样本用于持续适配。在Biovid、UNBC-McMaster、Aff-Wild2、BAH及跨数据集设置下的大量实验表明,该方法在多个指标上优于现有方法,最高提升达6.2%。
原文摘要 · Abstract (English)
Personalized facial expression recognition (FER) involves adapting a machine learning model using samples from labeled sources and unlabeled target domains. Given the challenges of recognizing subtle expressions with considerable interpersonal variability, state-of-the-art unsupervised domain adaptation (UDA) methods focus on the multi-source UDA (MSDA) setting, where each domain corresponds to a specific subject, and improve model accuracy and robustness. However, when adapting to a specific target, the diverse nature of multiple source domains translates to a large shift between source and target data. State-of-the-art MSDA methods for FER address this domain shift by considering all the sources to adapt to the target representations. Nevertheless, adapting to a target subject presents significant challenges due to large distributional differences between source and target domains, often resulting in negative transfer. In addition, integrating all sources simultaneously increases computational costs and causes misalignment with the target. To address these issues, we propose a progressive MSDA approach that gradually introduces information from subjects based on their similarity to the target subject. This will ensure that only the most relevant sources from the target are selected, which helps avoid the negative transfer caused by dissimilar sources. We first exploit the closest sources to reduce the distribution shift with the target and then move towards the furthest while only considering the most relevant sources based on the predetermined threshold. Furthermore, to mitigate catastrophic forgetting caused by the incremental introduction of source subjects, we implemented a density-based memory mechanism that preserves the most relevant historical source samples for adaptation. Our extensive experiments on Biovid, UNBC-McMaster, Aff-Wild2, BAH, and in a cross-dataset setting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。