无需源数据,通过中间模型迁移实现情绪识别适应
Bridge then Begin Anew: Generating Target-relevant Intermediate Model for Source-free Visual Emotion Adaptation
- 先生成跨域中间模型,再在目标域重新训练,避免源域干扰
- 在6个设置下显著优于现有无源域自适应方法
- 适合隐私敏感场景下的情绪识别模型迁移
视觉情绪识别(VER)旨在理解人类对不同视觉刺激的情绪反应,因其主观性和模糊性,构建大规模可靠标注数据集困难。为减少对标注数据的依赖,领域自适应可通过将已标注源数据训练的模型适配到无标注目标数据来解决。传统方法需访问源数据,但受隐私限制,源情绪数据可能不可用。为此,本文提出一个新任务:源无关视觉情绪自适应(SFDA),即在适配过程中不访问源数据。为此,提出新型框架“桥接再启程”(BBA),包含两步:域桥接模型生成(DMG)与目标相关模型适配(TMA)。DMG通过生成中间模型弥合跨域差异,避免直接对齐差异显著的两个VER数据集;TMA则从头开始训练目标模型,以适应目标结构,规避源域特定知识影响。在六个SFDA设置下进行大量实验,结果表明BBA有效,相比最先进的SFDA方法取得显著性能提升,并超越典型无监督领域自适应方法。
原文摘要 · Abstract (English)
Visual emotion recognition (VER), which aims at understanding humans' emotional reactions toward different visual stimuli, has attracted increasing attention. Given the subjective and ambiguous characteristics of emotion, annotating a reliable large-scale dataset is hard. For reducing reliance on data labeling, domain adaptation offers an alternative solution by adapting models trained on labeled source data to unlabeled target data. Conventional domain adaptation methods require access to source data. However, due to privacy concerns, source emotional data may be inaccessible. To address this issue, we propose an unexplored task: source-free domain adaptation (SFDA) for VER, which does not have access to source data during the adaptation process. To achieve this, we propose a novel framework termed Bridge then Begin Anew (BBA), which consists of two steps: domain-bridged model generation (DMG) and target-related model adaptation (TMA). First, the DMG bridges cross-domain gaps by generating an intermediate model, avoiding direct alignment between two VER datasets with significant differences. Then, the TMA begins training the target model anew to fit the target structure, avoiding the influence of source-specific knowledge. Extensive experiments are conducted on six SFDA settings for VER. The results demonstrate the effectiveness of BBA, which achieves remarkable performance gains compared with state-of-the-art SFDA methods and outperforms representative unsupervised domain adaptation approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。