arXiv:2510.15673cs.CVcs.AI2025-10ICCV被引 2

构建了用于行人意图检测的多模态近场数据集,助力智能驾驶感知升级。

Valeo Near-Field: a novel dataset for pedestrian intent detection

  • 融合鱼眼相机、激光雷达等多传感器数据,同步标注3D身体姿态与位置
  • 包含真实场景下遮挡、动态环境等挑战,支持嵌入式系统性能评估
  • 适合自动驾驶、人机交互领域研究者,推动近场行人行为预测发展

本文提出一个面向行人在接近自车时意图检测的新数据集。数据集包含同步的多模态信息,涵盖鱼眼相机图像、激光雷达扫描、超声波传感器读数以及基于动作捕捉的3D人体姿态,采集于多种真实场景。关键贡献包括与鱼眼图像同步的3D关节位置标注,以及从激光雷达数据中提取的精确3D行人位置,支持感知算法的鲁棒基准测试。我们发布部分数据集及完整基准套件,包含针对嵌入式系统准确率、效率和可扩展性的评估指标。该数据集应对传感器遮挡、动态环境和硬件约束等现实挑战,为行人检测、3D姿态估计及4D轨迹与意图预测算法的研发与评估提供独特资源。此外,我们使用定制神经网络架构提供了基线性能,并指明未来研究方向,以促进数据集的采用与改进。本工作旨在为提升智能车辆在近场场景下的能力奠定基础。

原文摘要 · Abstract (English)

This paper presents a novel dataset aimed at detecting pedestrians' intentions as they approach an ego-vehicle. The dataset comprises synchronized multi-modal data, including fisheye camera feeds, lidar laser scans, ultrasonic sensor readings, and motion capture-based 3D body poses, collected across diverse real-world scenarios. Key contributions include detailed annotations of 3D body joint positions synchronized with fisheye camera images, as well as accurate 3D pedestrian positions extracted from lidar data, facilitating robust benchmarking for perception algorithms. We release a portion of the dataset along with a comprehensive benchmark suite, featuring evaluation metrics for accuracy, efficiency, and scalability on embedded systems. By addressing real-world challenges such as sensor occlusions, dynamic environments, and hardware constraints, this dataset offers a unique resource for developing and evaluating state-of-the-art algorithms in pedestrian detection, 3D pose estimation and 4D trajectory and intention prediction. Additionally, we provide baseline performance metrics using custom neural network architectures and suggest future research directions to encourage the adoption and enhancement of the dataset. This work aims to serve as a foundation for researchers seeking to advance the capabilities of intelligent vehicles in near-field scenarios.

行人检测多模态数据自动驾驶意图预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。