为智力障碍人群设计更包容的交互AI,提升眼神交流识别准确率。
Inclusive AI for Group Interactions: Predicting Gaze-Direction Behaviors in People with Intellectual and Developmental Disabilities
- 构建MIDD数据集,捕捉非典型注视与参与模式。
- 在MIDD上微调模型,性能提升但仍有局限。
- 结合治疗师反馈,强调特征选择对包容性AI的重要性。
支持人类群体互动的智能体在促进福祉和治疗干预等敏感场景中前景广阔,但现有系统难以应对非神经典型人群的互动。原因在于多数AI检测模型(如轮流发言)仅基于神经典型人群数据训练。本文迈向包容性AI,聚焦于眼神交流这一非语言沟通核心,面向智力与发育障碍人群展开研究。首先,我们引入新数据集MIDD,记录该群体特有的注视与参与模式;其次,通过与神经典型数据集对比,揭示类别不平衡、说话活动、注视分布及互动动态等方面的差异;随后评估从SVM到FSFNet的多种分类器,发现基于MIDD微调可提升性能,但仍存明显不足;最后,通过六位治疗师的焦点小组讨论,解读量化结果并理解非典型注视行为的实际意义。基于此,我们提出数据驱动策略,强调特征选择对构建更包容的人本工具的关键作用。
原文摘要 · Abstract (English)
Artificial agents that support human group interactions hold great promise, especially in sensitive contexts such as well-being promotion and therapeutic interventions. However, current systems struggle to mediate group interactions involving people who are not neurotypical. This limitation arises because most AI detection models (e.g., for turn-taking) are trained on data from neurotypical populations. This work takes a step toward inclusive AI by addressing the challenge of eye contact detection, a core component of non-verbal communication, with and for people with Intellectual and Developmental Disabilities. First, we introduce a new dataset, Multi-party Interaction with Intellectual and Developmental Disabilities (MIDD), capturing atypical gaze and engagement patterns. Second, we present the results of a comparative analysis with neurotypical datasets, highlighting differences in class imbalance, speaking activity, gaze distribution, and interaction dynamics. Then, we evaluate classifiers ranging from SVMs to FSFNet, showing that fine-tuning on MIDD improves performance, though notable limitations remain. Finally, we present the insights gathered through a focus group with six therapists to interpret our quantitative findings and understand the practical implications of atypical gaze and engagement patterns. Based on these results, we discuss data-driven strategies and emphasize the importance of feature choice for building more inclusive human-centered tools.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。