构建首个车载注意力数据集,助力自动驾驶模型可解释性研究
The LAIA Dataset: Labelled Attention for Intelligent Automobiles

- 基于CARLA仿真生成15小时驾驶数据,融合眼动追踪与多模态传感器信息
- 首次实现人类注意力与模型感知注意力的直接对比分析
- 适合自动驾驶可解释性、人机协同设计及行为预测方向的研究者
自动驾驶发展依赖大规模带标注的传感器数据。尽管模块化架构广泛应用,端到端驾驶范式因能直接从感知输入映射到控制输出而展现出潜力,但其推广受限于可解释性不足。为此,我们提出LAIA(Labelled Attention for Intelligent Automobiles)——一个新型合成数据集,旨在通过引入人类注意力数据丰富端到端驾驶研究。该数据集在闭环环境中利用CARLA模拟器收集了44名参与者超过15小时的驾驶数据,涵盖六种天气条件下的RGB图像、语义与实例分割、深度图、光流、CAN总线信号以及同步眼动追踪数据。这些数据支持训练注意力感知的端到端智能驾驶模型、预测驾驶员行为、检测异常注意力模式,并提升模型可解释性。本文利用LAIA比较人类注意力与端到端模型中涌现的感知注意力,揭示其内在行为机制。
原文摘要 · Abstract (English)
The development of autonomous vehicles (AVs) usually relies heavily on data-driven artificial intelligence (AI) models that require large volumes of sensor data with ground-truth annotations. While modular architectures are widely used, end-to-end driving paradigms offer a promising alternative by directly mapping sensor inputs to control actions. However, their adoption is limited by challenges in interpretability and explainability. To address this, we present LAIA (Labelled Attention for Intelligent Automobiles), a novel synthetic dataset designed to enrich end-to-end driving research with human attention data. Collected using the CARLA simulator in closed-loop environments, LAIA comprises over 15 hours of driving from 44 participants across carefully crafted scenarios designed to evoke natural responses. Each sequence includes RGB images under six weather conditions, semantic and instance segmentation, depth, optical flow, CAN bus signals, and synchronized eye-tracking data. LAIA enables applications including training attention-aware end-to-end AI drivers, predicting driver behavior, developing methods to detect anomalous driver-attention patterns, and improving model explainability. In this work, we use LAIA to compare human attention with the perceptual attention emerging in our end-to-end driving models, thereby providing insight into their behavior.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。