构建360度司机注意力数据集,提升自动驾驶场景下的环境感知能力。
DriverGaze360: OmniDirectional Driver Attention with Object-Level Guidance
- 基于全景视角采集百万级注视标签帧,覆盖多驾驶场景。
- 提出联合预测注意力图与关注物体的网络架构,精度领先。
- 适合自动驾驶交互、人机共驾等研究者使用。
预测驾驶员注意力是开发可解释自动驾驶系统、理解人机混合交通中驾驶行为的关键。尽管已有大规模驾驶员注意力数据集和深度学习模型取得进展,但现有方法受限于狭窄的前向视野和有限的驾驶多样性,难以捕捉车道变换、转弯及行人、骑行者等周边物体交互时的完整空间上下文。本文提出DriverGaze360,一个包含约100万帧标注注视点的大规模360°视野驾驶员注意力数据集,由19名人类驾驶员采集,支持全方位驾驶行为建模。同时,我们设计了全景注意力预测模型DriverGaze360-Net,通过引入辅助语义分割头,联合学习注意力图与被关注物体,增强对宽视角输入的空间感知能力。大量实验表明,该方法在多个指标上达到当前最优性能。数据集与代码已公开:https://dfki-av.github.io/drivergaze360。
原文摘要 · Abstract (English)
Predicting driver attention is a critical problem for developing explainable autonomous driving systems and understanding driver behavior in mixed human-autonomous vehicle traffic scenarios. Although significant progress has been made through large-scale driver attention datasets and deep learning architectures, existing works are constrained by narrow frontal field-of-view and limited driving diversity. Consequently, they fail to capture the full spatial context of driving environments, especially during lane changes, turns, and interactions involving peripheral objects such as pedestrians or cyclists. In this paper, we introduce DriverGaze360, a large-scale 360$^\circ$ field of view driver attention dataset, containing $\sim$1 million gaze-labeled frames collected from 19 human drivers, enabling comprehensive omnidirectional modeling of driver gaze behavior. Moreover, our panoramic attention prediction approach, DriverGaze360-Net, jointly learns attention maps and attended objects by employing an auxiliary semantic segmentation head. This improves spatial awareness and attention prediction across wide panoramic inputs. Extensive experiments demonstrate that DriverGaze360-Net achieves state-of-the-art attention prediction performance on multiple metrics on panoramic driving images. Dataset and method available at https://dfki-av.github.io/drivergaze360.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。