提出新方法抑制放大伪影,提升微表情中动作单元检测精度
Infused Suppression Of Magnification Artefacts For Micro-AU Detection
- 分层融合运动上下文信息,约束模型聚焦真实面部运动区域
- 用放大隐空间特征替代重建放大样本,减少投影误差引入的伪影
- 在跨数据库测试中超越现有最优结果,适合微表情分析研究者
面部微表情是自发、短暂且细微的面部运动,能揭示被压抑的情绪。检测微表情中的动作单元(AUs)至关重要,因其可提供比分类情绪更精细的面部运动表征,有效缓解不同表情间的歧义。微表情分析的难点在于面部运动极其细微且短暂,导致难以建立运动特征与AU出现之间的关联。为解决这一问题,常用光流特征和运动放大技术分别提取运动变化与增强运动幅度。然而运动放大会放大光照变化和投影误差,产生混淆模型学习的运动伪影,尤其在多类别AU跨数据库任务中更为严重。为此,我们提出InfuseNet,一种分层单位特征注入框架,利用运动上下文约束AU学习局限于有信息量的面部运动区域,从而缓解放大伪影的影响。此外,我们采用放大后的隐空间特征而非重建放大样本,以减少运动重建中因投影不准确造成的失真与伪影。通过抑制放大伪影,InfuseNet在CD6ME协议上超越当前最先进水平。定量实验进一步验证了伪影抑制的有效性。
原文摘要 · Abstract (English)
Facial micro-expressions are spontaneous, brief and subtle facial motions that unveil the underlying, suppressed emotions. Detecting Action Units (AUs) in micro-expressions is crucial because it yields a finer representation of facial motions than categorical emotions, effectively resolving the ambiguity among different expressions. One of the difficulties in micro-expression analysis is that facial motions are subtle and brief, thereby increasing the difficulty in correlating facial motion features to AU occurrence. To bridge the subtlety issue, flow-related features and motion magnification are a few common approaches as they can yield descriptive motion changes and increased motion amplitude respectively. While motion magnification can amplify the motion changes, it also accounts for illumination changes and projection errors during the amplification process, thereby creating motion artefacts that confuse the model to learn inauthentic magnified motion features. The problem is further aggravated in the context of a more complicated task where more AU classes are analyzed in cross-database settings. To address this issue, we propose InfuseNet, a layer-wise unitary feature infusion framework that leverages motion context to constrain the Action Unit (AU) learning within an informative facial movement region, thereby alleviating the influence of magnification artefacts. On top of that, we propose leveraging magnified latent features instead of reconstructing magnified samples to limit the distortion and artefacts caused by the projection inaccuracy in the motion reconstruction process. Via alleviating the magnification artefacts, InfuseNet has surpassed the state-of-the-art results in the CD6ME protocol. Further quantitative studies have also demonstrated the efficacy of motion artefacts alleviation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。