首个头戴式第一人称视角数据集,助力视障者避障轨迹预测。
HEADS-UP: Head-Mounted Egocentric Dataset for Trajectory Prediction in Blind Assistance Systems
- 基于头戴相机构建半局部坐标系,提升避障轨迹预测效率。
- 在HEADS-UP数据集上验证,实时测试在Jetson GPU上运行稳定。
- 适合开发智能视障辅助系统,尤其关注动态障碍物预警。
本文提出HEADS-UP,首个从头戴式摄像头采集的第一人称视角数据集,专为视障辅助系统中的轨迹预测设计。随着视障人群增长,实时预警动态障碍物碰撞的智能工具需求日益迫切。现有数据集无法反映视障者的实际视觉视角。为此,HEADS-UP聚焦该场景,支持轨迹预测研究。基于此数据集,我们提出一种半局部轨迹预测方法,通过旋转相机坐标系构建半局部参考系,实现对视障者与行人之间碰撞风险的高效评估。不同于传统分别预测双方轨迹的方法,本方法在半局部坐标下统一建模。我们在HEADS-UP数据集上验证了该方法,并在ROS中实现,通过NVIDIA Jetson GPU进行实时测试,结合用户研究评估性能。实验结果表明,该方法在数据集和真实环境测试中均具备鲁棒性与实时性。
原文摘要 · Abstract (English)
In this paper, we introduce HEADS-UP, the first egocentric dataset collected from head-mounted cameras, designed specifically for trajectory prediction in blind assistance systems. With the growing population of blind and visually impaired individuals, the need for intelligent assistive tools that provide real-time warnings about potential collisions with dynamic obstacles is becoming critical. These systems rely on algorithms capable of predicting the trajectories of moving objects, such as pedestrians, to issue timely hazard alerts. However, existing datasets fail to capture the necessary information from the perspective of a blind individual. To address this gap, HEADS-UP offers a novel dataset focused on trajectory prediction in this context. Leveraging this dataset, we propose a semi-local trajectory prediction approach to assess collision risks between blind individuals and pedestrians in dynamic environments. Unlike conventional methods that separately predict the trajectories of both the blind individual (ego agent) and pedestrians, our approach operates within a semi-local coordinate system, a rotated version of the camera's coordinate system, facilitating the prediction process. We validate our method on the HEADS-UP dataset and implement the proposed solution in ROS, performing real-time tests on an NVIDIA Jetson GPU through a user study. Results from both dataset evaluations and live tests demonstrate the robustness and efficiency of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。