一站式人脸行为分析工具，跨数据集表现更准更公平。
Behaviour4All: in-the-wild Facial Behaviour Analysis Toolkit
- 统一框架整合定位、情绪、表情、动作单元检测
- 在超500万张野外图像上训练，性能超越现有工具
- 速度快、泛化强，适合真实场景与多任务研究
本文介绍Behavior4All，一个面向野外环境的人脸行为分析开源工具包，集成人脸定位、愉悦度-唤醒度估计、基本表情识别和动作单元检测四大功能。该工具包基于12个大规模野外数据集（总计超过500万张图像）构建，涵盖多样人群。通过引入分布匹配与标签共标注机制，有效处理标注不重叠的任务，编码其内在关联性先验知识。在同类研究中规模最大的实验中，Behavior4All在所有数据库与任务上均优于当前最优模型及现有工具包，展现出更强的公平性与跨数据集泛化能力，尤其在未见数据集和复合表情识别任务中表现突出。同时，其速度远超其他同类工具。
原文摘要 · Abstract (English)
In this paper, we introduce Behavior4All, a comprehensive, open-source toolkit for in-the-wild facial behavior analysis, integrating Face Localization, Valence-Arousal Estimation, Basic Expression Recognition and Action Unit Detection, all within a single framework. Available in both CPU-only and GPU-accelerated versions, Behavior4All leverages 12 large-scale, in-the-wild datasets consisting of over 5 million images from diverse demographic groups. It introduces a novel framework that leverages distribution matching and label co-annotation to address tasks with non-overlapping annotations, encoding prior knowledge of their relatedness. In the largest study of its kind, Behavior4All outperforms both state-of-the-art and toolkits in overall performance as well as fairness across all databases and tasks. It also demonstrates superior generalizability on unseen databases and on compound expression recognition. Finally, Behavior4All is way times faster than other toolkits.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。