arXiv:2603.07043cs.CV2026-03被引 1

提出细粒度3D微表情重建方法,解决微表情难捕捉难题。

Fine-Grained 3D Facial Reconstruction for Micro-Expressions

  • 融合全局动态特征与局部多源信息,提升微表情建模能力。
  • 在多个数据集上几何精度与感知细节均优于现有方法。
  • 适合表情分析、医疗诊断等需要精细面部动作识别场景。

近年来的3D面部表情重建在捕捉宏表情方面表现优异,但微表情重建仍处于空白。由于微表情具有细微、短暂、强度低的特点,难以提取稳定且有区分性的特征,给准确重建带来挑战。本文提出一种细粒度微表情重建方法,结合全局动态特征以捕捉稳定的面部运动模式,同时引入局部丰富特征,融合2D运动、面部先验和3D面部几何等多种信息。具体地,设计了一个即插即用的动态编码模块,从大量宏表情数据中学习先验知识,缓解微表情数据稀缺问题;随后构建动态引导的网格变形模块,从密集光流、稀疏关键点和面部网格几何中提取聚合局部特征,自适应精修细粒度微表情,同时保持整体3D结构。在多个微表情数据集上的实验表明,该方法在几何精度和感知细节上均持续优于当前最优方法。

原文摘要 · Abstract (English)

Recent advances in 3D facial expression reconstruction have demonstrated remarkable performance in capturing macro-expressions, yet the reconstruction of micro-expressions remains unexplored. This novel task is particularly challenging due to the subtle, transient, and low-intensity nature of micro-expressions, which complicate the extraction of stable and discriminative features essential for accurate reconstruction. In this paper, we propose a fine-grained micro-expression reconstruction method that integrates a global dynamic feature capturing stable facial motion patterns with a locally-enriched feature incorporating multiple informative cues from 2D motions, facial priors and 3D facial geometry. Specifically, we devise a plug-and-play dynamic-encoded module to extract micro-expression feature for global facial action, allowing it to leverage prior knowledge from abundant macro-expression data to mitigate the scarcity of micro-expression data. Subsequently, a dynamic-guided mesh deformation module is designed for extracting aggregated local features from dense optical flow, sparse landmark cues and facial mesh geometry, which adaptively refines fine-grained facial micro-expression without compromising global 3D geometry. Extensive experiments on micro-expression datasets demonstrate that our method consistently outperforms state-of-the-art methods in both geometric accuracy and perceptual detail.

3D重建微表情面部动作动态建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。