首个面向视障者运动行为的多模态数据集,用于提升自动驾驶等系统对特殊人群的感知能力。
Text to Blind Motion
- 基于可穿戴设备采集11位视障者在8条真实城市路线上的3D运动数据
- 发现现有3D运动模型在视障者行为预测上表现差,准确率不足40%
- 提供带文本描述的多模态数据,适合研究公平性与包容性智能系统的人群
视障者感知世界的方式与常人不同,导致其运动模式也存在差异,如过街时路径偏移更明显或依赖手杖、导盲犬探索障碍物。这些行为对自动驾驶等系统的运动预测模型而言可能显得难以预料。然而,现有3D人体运动数据集缺乏多样性,普遍偏向视力正常人群。本文提出BlindWays,首个针对视障行人的多模态运动基准数据集。通过可穿戴传感器,收集了11位视障参与者在8个真实城市路线上行走的3D运动数据,并配套提供丰富的文本描述,涵盖视障者独特的运动特征及其与导航工具(如白手杖、导盲犬)及环境的交互信息。我们评估了主流3D人体运动预测模型,发现现成方法和基于预训练的方法在该任务上表现不佳。为推动更安全、可靠的智能系统实现对多样化人类行为的无缝理解,相关数据已公开于https://blindways.github.io。
原文摘要 · Abstract (English)
People who are blind perceive the world differently than those who are sighted, which can result in distinct motion characteristics. For instance, when crossing at an intersection, blind individuals may have different patterns of movement, such as veering more from a straight path or using touch-based exploration around curbs and obstacles. These behaviors may appear less predictable to motion models embedded in technologies such as autonomous vehicles. Yet, the ability of 3D motion models to capture such behavior has not been previously studied, as existing datasets for 3D human motion currently lack diversity and are biased toward people who are sighted. In this work, we introduce BlindWays, the first multimodal motion benchmark for pedestrians who are blind. We collect 3D motion data using wearable sensors with 11 blind participants navigating eight different routes in a real-world urban setting. Additionally, we provide rich textual descriptions that capture the distinctive movement characteristics of blind pedestrians and their interactions with both the navigation aid (e.g., a white cane or a guide dog) and the environment. We benchmark state-of-the-art 3D human prediction models, finding poor performance with off-the-shelf and pre-training-based methods for our novel task. To contribute toward safer and more reliable systems that can seamlessly reason over diverse human movements in their environments, our text-and-motion benchmark is available at https://blindways.github.io.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。