用运动提示微调大模型,提升微表情识别准确率
MPT: Motion Prompt Tuning for Micro-Expression Recognition
- 通过运动放大和高斯分词生成细微动作提示
- 在三个数据集上均超越现有最佳方法
- 适合需要精准情绪分析的医疗与安防场景
微表情识别(MER)在情感计算中至关重要,广泛应用于医学诊断、说谎检测和刑事侦查。然而,由于需心理学专家标注,微表情数据集普遍样本稀缺,严重制约模型学习。尽管大型预训练模型具备通用且区分性强的表征能力,但难以捕捉转瞬即逝的细微面部动作,影响MER效果。本文提出运动提示微调(MPT),开创性地通过运动放大与高斯分词生成微动作提示,输入大模型;同时引入分组适配器,增强模型在微表情领域的表征能力。在三个主流MER数据集上的大量实验表明,MPT持续优于当前最先进方法,验证了其有效性。
原文摘要 · Abstract (English)
Micro-expression recognition (MER) is crucial in the affective computing field due to its wide application in medical diagnosis, lie detection, and criminal investigation. Despite its significance, obtaining micro-expression (ME) annotations is challenging due to the expertise required from psychological professionals. Consequently, ME datasets often suffer from a scarcity of training samples, severely constraining the learning of MER models. While current large pre-training models (LMs) offer general and discriminative representations, their direct application to MER is hindered by an inability to capture transitory and subtle facial movements-essential elements for effective MER. This paper introduces Motion Prompt Tuning (MPT) as a novel approach to adapting LMs for MER, representing a pioneering method for subtle motion prompt tuning. Particularly, we introduce motion prompt generation, including motion magnification and Gaussian tokenization, to extract subtle motions as prompts for LMs. Additionally, a group adapter is carefully designed and inserted into the LM to enhance it in the target MER domain, facilitating a more nuanced distinction of ME representation. Furthermore, extensive experiments conducted on three widely used MER datasets demonstrate that our proposed MPT consistently surpasses state-of-the-art approaches and verifies its effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。