arXiv:2606.08612cs.CV2026-06综述

全面梳理深度学习时代面部表情识别的进展与挑战

Facial Expression Recognition in the Deep Learning Era: A Systematic Multi-Criteria Review of Methods, Models, Datasets, Performance, Challenges, and Future Research Directions

论文配图:Facial Expression Recognition in the Deep Learning Era: A Systematic Multi-Criteria Review of Methods, Models, Datasets, Performance, Challenges, and Future Research Directions
图 1 · 摘自论文原文
  • 按五个阶段系统梳理从传统方法到大模型的演进路径
  • 从任务、数据、模型等七方面构建多维度分类体系
  • 总结主流数据集与性能对比,指明未来研究方向

过去十年,面部表情识别(FER)在深度学习推动下迅猛发展,从手工特征和浅层分类器转向基于卷积、注意力、视觉-语言及基础模型的架构,并伴随大规模真实场景基准数据集的兴起,涵盖分类、维度、复合表情、微表情、动作单元(AU)及强度估计等多种任务。然而现有综述多局限于特定任务、架构或应用,缺乏系统性整合。本文通过五阶段演化分析、七维度多准则分类体系、各维度对比评估、数据集任务化梳理、代表性方法在主流基准上的量化对比,以及对当前挑战与未来方向的讨论,首次提供了一套全面、系统的深度学习时代FER综述,明确其在真实环境下的优势与局限。

原文摘要 · Abstract (English)

Facial Expression Recognition (FER) has advanced rapidly over the last decade, driven by the shift from handcrafted descriptors and shallow classifiers to deep convolutional, attention-based, vision-language, and foundation-model architectures, and by the parallel growth of large-scale in-the-wild benchmarks spanning categorical, dimensional, compound, micro-expression, Action Unit (AU), and intensity-estimation tasks. Yet the deep learning-based FER landscape has so far been reviewed only along narrow task-, architecture-, or application-specific axes, leaving a holistic, systematically organized account of its recent advances missing. This survey addresses that gap with a comprehensive review of recent deep learning-based FER, explicitly linked to the wider Facial Affect Recognition (FAR) domain. Its main contributions are: a) A description of FER's evolution into five distinct phases, from handcrafted features and classical machine learning to attention-based, vision-language, and foundation-model approaches, with the key milestone works of each, b) A multi-criteria taxonomy analyzing the literature along seven complementary axes: recognition task, input modality, face pre-processing pipeline, network architecture, learning strategy, acquisition setting, and application domain, c) A per-criterion comparative analysis, with critical insights into the strengths and limitations of each category under in-the-wild conditions, d) A task-organized review of public FER datasets, with their annotation schemes, modalities, and evaluation protocols, e) A compilation of performance metrics and a per-task quantitative comparison of representative state-of-the-art methods on widely adopted benchmarks, and f) A discussion of current challenges and promising future directions.

面部识别深度学习综述情感分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。