arXiv:2606.14096cs.CV2026-06

构建82类微动作数据集,推动真实场景下行为意图识别研究

A New Multi-Domain Benchmark for Micro-Action Recognition and Detection

论文配图:A New Multi-Domain Benchmark for Micro-Action Recognition and Detection
图 1 · 摘自论文原文
  • 扩展原有数据集至82类微动作,覆盖4类真实场景
  • 包含77,856个标注实例,支持跨域、少样本与零样本任务
  • 揭示微动作与情绪关联,助力情感计算与人机交互

微动作是全身范围内的短时、低幅细微身体动作,可揭示潜在意图、无意识反应及精细情绪变化。现有MA-52基准在规模、场景多样性、任务覆盖和评估协议上仍有限。为推动微动作分析向更真实、全面的设置发展,本文提出MMA-82,作为MA-52的大规模多领域扩展。MMA-82将标签空间从52类扩展至82类,涵盖实验室访谈、街头访谈、精神科患者访谈和情感丰富的电视视频四类场景,共包含来自454名受试者的77,856个标注实例。基于MMA-82,我们设立微动作识别与多标签检测两个核心任务。针对识别任务,进一步定义了域内与跨域协议,包括少样本与零样本设置,以评估模型鲁棒性、迁移能力与泛化性能。大量实验表明,当前方法在真实场景下的微动作理解仍面临挑战,尤其在域偏移、长尾类别分布和复杂时间定位条件下。此外,我们探究了微动作与情绪的关系,发现微动作与情绪状态强相关,并为面部微表情提供互补线索,提升情绪识别效果。结果表明,MMA-82是真实微动作分析的综合性且具有挑战性的基准,也是以人为本的人工智能研究的重要资源。MMA-82数据集可在 https://lpynow.github.io/MMA-82-AIM/ 获取。

原文摘要 · Abstract (English)

Micro-actions are short-duration, low-amplitude subtle body movements at the whole-body level that can reveal latent intentions, involuntary reactions, and fine-grained affective changes. Our previous MA-52 benchmark has provided an important foundation for micro-action recognition, but it remains limited in scale, scene diversity, task coverage, and evaluation protocols. To advance micro-action analysis toward more realistic and comprehensive settings, we introduce MMA-82, a large-scale multi-domain extension of MA-52. MMA-82 expands the label space from 52 to 82 fine-grained micro-action categories and covers four distinct domains, including laboratory interviews, street interviews, psychiatric patient interviews, and emotion-rich television videos, resulting in 77,856 annotated instances from 454 subjects. Built upon MMA-82, we establish two core tasks: Micro-Action Recognition and Multi-label Micro-Action Detection. For recognition, we further define in-domain and cross-domain protocols, including few-shot and zero-shot settings, to evaluate model robustness, transferability, and generalization. Extensive experiments show that current methods still struggle with realistic micro-action understanding, especially under domain shift, long-tailed category distributions, and complex temporal localization. Beyond benchmarking, we investigate the relationship between micro-actions and emotion, showing that micro-actions are strongly associated with emotional states and provide complementary cues to facial micro-expressions for improved emotion recognition. These results demonstrate that MMA-82 serves as a comprehensive and challenging benchmark for realistic micro-action analysis and a valuable resource for human-centered AI. MMA-82 is available at https://lpynow.github.io/MMA-82-AIM/.

微动作识别多域数据集情绪分析行为理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。