arXiv:2604.03050cs.HCcs.AI2026-04

面向老年人情绪与认知理解的多模态数据集,助力老龄化研究。

MECO: A Multimodal Dataset for Emotion and Cognitive Understanding in Older Adults

  • 构建42人、38小时的多模态数据集,涵盖视频、音频、EEG、ECG。
  • 提供30,592个同步样本,含情绪与认知评分标注。
  • 适合做老年情感计算、轻度认知障碍早期检测的研究者。

尽管情感计算已取得显著进展,针对老年人群的多模态情绪预测仍缺乏系统研究,主要受限于专用数据集的缺失。现有基准大多聚焦年轻、认知健康群体,忽略了认知衰退对情绪表达和生理反应的影响。为此,我们提出MECO——面向老年人情绪与认知理解的多模态数据集。该数据集包含42名参与者,采集约38小时多模态信号,生成30,592个同步样本。数据采集遵循标准化流程,采用社区化场景以提升生态效度。模态包括视频、音频、脑电(EEG)和心电(ECG)。同时提供全面的情绪与认知状态标注,涵盖自评效价、唤醒度、六种基本情绪及迷你精神状态检查(MMSE)得分。我们还建立了情绪与认知预测的基线模型。MECO为老龄化人群的情感与认知建模提供基础资源,支持个性化情绪识别与轻度认知障碍(MCI)的现实场景早期检测。完整数据集及补充材料可访问 https://maitrechen.github.io/meco-page/。

原文摘要 · Abstract (English)

While affective computing has advanced considerably, multimodal emotion prediction in aging populations remains underexplored, largely due to the scarcity of dedicated datasets. Existing multimodal benchmarks predominantly target young, cognitively healthy subjects, neglecting the influence of cognitive decline on emotional expression and physiological responses. To bridge this gap, we present MECO, a Multimodal dataset for Emotion and Cognitive understanding in Older adults. MECO includes 42 participants and provides approximately 38 hours of multimodal signals, yielding 30,592 synchronized samples. To maximize ecological validity, data collection followed standardized protocols within community-based settings. The modalities cover video, audio, electroencephalography (EEG), and electrocardiography (ECG). In addition, the dataset offers comprehensive annotations of emotional and cognitive states, including self-assessed valence, arousal, six basic emotions, and Mini-Mental State Examination cognitive scores. We further establish baseline benchmarks for both emotion and cognitive prediction. MECO serves as a foundational resource for multimodal modeling of affect and cognition in aging populations, facilitating downstream applications such as personalized emotion recognition and early detection of mild cognitive impairment (MCI) in real-world settings. The complete dataset and supplementary materials are available at https://maitrechen.github.io/meco-page/.

多模态老年人情感计算认知评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。