arXiv:2412.08965cs.CVcs.AI2024-12中稿 · AAAI被引 5

用表情数据提升视频骗术检测,通过知识迁移让模型更准

AFFAKT: A Hierarchical Optimal Transport based Method for Affective Facial Knowledge Transfer in Video Deception Detection

  • 基于分层最优传输,量化表情与骗术的关联性并转移知识
  • 在两个数据集上显著提升骗术检测准确率,关键依赖负向情绪关联
  • 适合关注情感分析与安全检测交叉应用的研究者

由于高质量大规模标注数据集稀缺,深度学习在视频骗术检测中面临挑战。受欺骗与表情关系的心理学理论启发,本文提出AFFAKT方法,通过从大型表情数据集迁移相关知识来增强分类性能。知识迁移面临两大难题:一是应转移多少表情知识,二是如何在推理时有效利用这些知识。为此,我们设计了H-OTKT模块,量化表情类别与骗术样本之间的最优映射关系,并据此进行知识转移;同时引入SRKB模块,通过动量更新保留表情类别与骗术类别间的不变关联。推理阶段,通过样本特定重加权策略对转移知识进行微调。在两个骗术检测数据集上的实验表明,该方法表现优异。可解释性分析揭示骗术与负面情绪高度相关,符合心理学理论。

原文摘要 · Abstract (English)

The scarcity of high-quality large-scale labeled datasets poses a huge challenge for employing deep learning models in video deception detection. To address this issue, inspired by the psychological theory on the relation between deception and expressions, we propose a novel method called AFFAKT in this paper, which enhances the classification performance by transferring useful and correlated knowledge from a large facial expression dataset. Two key challenges in knowledge transfer arise: 1) \textit{how much} knowledge of facial expression data should be transferred and 2) \textit{how to} effectively leverage transferred knowledge for the deception classification model during inference. Specifically, the optimal relation mapping between facial expression classes and deception samples is firstly quantified using proposed H-OTKT module and then transfers knowledge from the facial expression dataset to deception samples. Moreover, a correlation prototype within another proposed module SRKB is well designed to retain the invariant correlations between facial expression classes and deception classes through momentum updating. During inference, the transferred knowledge is fine-tuned with the correlation prototype using a sample-specific re-weighting strategy. Experimental results on two deception detection datasets demonstrate the superior performance of our proposed method. The interpretability study reveals high associations between deception and negative affections, which coincides with the theory in psychology.

骗术检测情感知识迁移最优传输

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。