arXiv:2606.07935cs.CV2026-06

2026年面部反应生成挑战:结合人格与脑电数据,生成个性化、多样的真实面部反应。

REACT 2026: The Fourth Multiple Appropriate Facial Reaction Generation Challenge: Personalised MAFRG and Appropriate EEG Reaction Prediction

论文配图:REACT 2026: The Fourth Multiple Appropriate Facial Reaction Generation Challenge: Personalised MAFRG and Appropriate EEG Reaction Prediction
图 1 · 摘自论文原文
  • 融合人格特质与脑电数据,实现个性化面部反应生成
  • 提出四类子任务,支持离线与在线场景下的多反应生成
  • 公开新基线模型和数据集,推动人机互动研究

在双人交互中,针对同一说话行为可存在多种合适的面部反应。继2023、2024、2025年成功举办该挑战赛后,已有大量生成式深度学习模型用于多合适面部反应生成(MAFRG)问题。2026年挑战赛旨在推动机器学习模型的发展与评测,使其能为特定听众生成多个个性化、合适、多样、逼真且同步的人类风格面部反应,以响应给定的说话行为。作为核心部分,本挑战持续提供由2025年提出的MARS数据集,并新增个体层面的大五人格标签和脑电记录(EEG),引入一种结合行为、情感与神经生理信号的新的一对多个性化面部反应生成范式,该方向在当前双人交互建模中仍属空白。本文还公布了挑战指南及四项子任务的基线模型:离线通用与个性化MAFRG,以及在线通用与个性化MAFRG,所有内容均开源于https://github.com/reactmultimodalchallenge/baseline_react2026。

原文摘要 · Abstract (English)

In dyadic interactions, various human facial reactions could be appropriate for responding to each human speaker behaviour. Following the successful organisation of the REACT 2023, 2024 and 2025 challenge series, a body of generative deep learning (DL) models have been developed for the problem of multiple appropriate facial reaction generation (MAFRG). This year, we propose the REACT 2026 challenge encouraging the development and benchmarking of Machine Learning (ML) models that can generate multiple personalised, appropriate, diverse, realistic and synchronised human-style facial reactions expressed by a specific human listener for responding to each given speaker behaviour. As a key of the challenge, we continuously provide challenge participants with MARS dataset introduced by REACT 2025 but additionally provide individual-level Big-Five personality labels and EEG recordings. This introduces a new one-to-many personalised facial reaction generation setting combining human expressive behavioural, affective and neurophysiological signals, which remains largely unexplored in current dyadic interaction modelling. This paper also presents the challenge guidelines and new baselines on the four proposed sub-challenges: Offline generic and personalised MAFRG as well as Online generic and personalised MAFRG, respectively, which are publicly available at https://github.com/reactmultimodalchallenge/baseline_react2026.

面部生成人格建模脑电分析人机交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。