构建首个面向老年患者的虚拟康复参与度数据集,助力智能评估
OPEN: A Benchmark Dataset and Baseline for Older Adult Patient Engagement Recognition in Virtual Rehabilitation Learning Environments
- 采集11位老年人6周每周互动数据,获超35小时多模态特征
- 基于关节点与行为特征,模型识别参与度准确率达81%
- 专为老年群体设计,适合远程医疗与老龄化研究者使用
虚拟学习中的参与度对用户满意度、表现和依从性至关重要,尤其在在线教育和虚拟康复中,交互沟通作用关键。然而,在虚拟团体环境中精准衡量参与度仍具挑战。人工智能在大规模、真实世界中的自动化参与度识别方面日益受到关注。尽管参与度在年轻学术群体中已有广泛研究,针对老年患者在虚拟及远程医疗学习环境中的研究与数据集仍十分有限。现有方法常忽略情境相关性及跨会话的参与度动态变化。本文提出OPEN(Older adult Patient ENgagement)数据集,支持人工智能驱动的参与度识别。数据来自11位老年人参与为期六周的心脏康复虚拟小组课程,共产生超过35小时数据,是同类研究中规模最大的数据集。为保护隐私,未公开原始视频,而是提供面部、手部及身体关节点轨迹,以及从视频中提取的情感与行为特征。标注包含二值参与状态、情感与行为标签,以及情境类型标识(如讲师面向群体或个体)。数据集提供5秒、10秒、30秒及可变长度样本版本。为验证实用性,训练了多种机器学习与深度学习模型,参与度识别准确率最高达81%。OPEN为老年群体个性化参与建模提供了可扩展基础,并推动更广泛的参与度识别研究。
原文摘要 · Abstract (English)
Engagement in virtual learning is essential for participant satisfaction, performance, and adherence, particularly in online education and virtual rehabilitation, where interactive communication plays a key role. Yet, accurately measuring engagement in virtual group settings remains a challenge. There is increasing interest in using artificial intelligence (AI) for large-scale, real-world, automated engagement recognition. While engagement has been widely studied in younger academic populations, research and datasets focused on older adults in virtual and telehealth learning settings remain limited. Existing methods often neglect contextual relevance and the longitudinal nature of engagement across sessions. This paper introduces OPEN (Older adult Patient ENgagement), a novel dataset supporting AI-driven engagement recognition. It was collected from eleven older adults participating in weekly virtual group learning sessions over six weeks as part of cardiac rehabilitation, producing over 35 hours of data, making it the largest dataset of its kind. To protect privacy, raw video is withheld; instead, the released data include facial, hand, and body joint landmarks, along with affective and behavioral features extracted from video. Annotations include binary engagement states, affective and behavioral labels, and context-type indicators, such as whether the instructor addressed the group or an individual. The dataset offers versions with 5-, 10-, 30-second, and variable-length samples. To demonstrate utility, multiple machine learning and deep learning models were trained, achieving engagement recognition accuracy of up to 81 percent. OPEN provides a scalable foundation for personalized engagement modeling in aging populations and contributes to broader engagement recognition research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。