arXiv:2603.26064cs.CVcs.AI2026-03

用生理信号指导非接触欺骗检测,提升准确率。

MuDD: A Multimodal Deception Detection Dataset and GSR-Guided Progressive Distillation for Non-Contact Deception Detection

  • 利用GSR信号引导视频音频特征学习,实现跨模态知识迁移。
  • 在130人、690分钟数据上验证,识别准确率领先现有方法。
  • 适合研究欺骗检测、多模态学习与可解释性的人参考。

非接触式自动欺骗检测因视觉和听觉线索缺乏跨被试稳定性而困难。相比之下,皮肤电反应(GSR)提供更可靠的生理线索,常用于有接触的欺骗检测。本文利用GSR中稳定的欺骗相关知识,通过跨模态知识蒸馏指导非接触模态的表征学习。为解决该场景下缺乏合适数据集的问题,我们构建了大型多模态欺骗检测数据集MuDD,包含130名参与者、总计690分钟的视频、音频、GSR、光电容积脉搏波、心率及人格特质数据,支持更广泛的欺骗研究。基于此数据集,提出GSR引导的渐进式蒸馏(GPD)框架,缓解GSR与非接触信号间大模态差异导致的负迁移问题。GPD核心创新在于结合渐进式特征级与数值级蒸馏及动态路由机制,使模型可自适应决定教师知识传递方式,实现更稳定的跨模态知识迁移。大量实验与可视化表明,GPD优于现有方法,在欺骗检测与隐秘数字识别任务上均达当前最优性能。

原文摘要 · Abstract (English)

Non-contact automatic deception detection remains challenging because visual and auditory deception cues often lack stable cross-subject patterns. In contrast, galvanic skin response (GSR) provides more reliable physiological cues and has been widely used in contact-based deception detection. In this work, we leverage stable deception-related knowledge in GSR to guide representation learning in non-contact modalities through cross-modal knowledge distillation. A key obstacle, however, is the lack of a suitable dataset for this setting. To address this, we introduce MuDD, a large-scale Multimodal Deception Detection dataset containing recordings from 130 participants over 690 minutes. In addition to video, audio, and GSR, MuDD also provides Photoplethysmography, heart rate, and personality traits, supporting broader scientific studies of deception. Based on this dataset, we propose GSR-guided Progressive Distillation (GPD), a cross-modal distillation framework for mitigating the negative transfer caused by the large modality mismatch between GSR and non-contact signals. The core innovation of GPD is the integration of progressive feature-level and digit-level distillation with dynamic routing, which allows the model to adaptively determine how teacher knowledge should be transferred during training, leading to more stable cross-modal knowledge transfer. Extensive experiments and visualizations show that GPD outperforms existing methods and achieves state-of-the-art performance on both deception detection and concealed-digit identification.

欺骗检测多模态知识蒸馏生理信号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。