用预训练模型实现高效可解释的动态避障,无需大量训练数据。
Time-to-Collision Based Dynamic Obstacle Avoidance Using Pretrained Vision Models for Robots in Unstructured Environments

- 基于预训练深度模型和特征追踪,实时计算障碍物碰撞时间。
- 在真实数据上检测到20个障碍物中19个的短时碰撞风险,准确率84%。
- 无需训练,仅需74秒数据调参,适合复杂室外环境应用。
在非结构化户外环境中,动态障碍物避让对自主移动机器人仍是重大挑战,尤其当大规模机器人专用数据集和基于仿真的策略不切实际时。本文提出一种数据高效、可解释的视觉避障方法,完全依赖真实世界数据运行,避免了仿真训练策略固有的“仿真到现实”迁移问题。该方法利用UniDepth这一大型预训练单目深度估计模型,从RGB视频生成密集深度图,无需推理时使用双目相机或激光雷达。通过扩展SuperPoint与SuperGlue特征匹配流程,实现长序列帧间关键点追踪,结合相机内参与预测深度将二维像素位置投影至三维空间,以这些三维关键点初始化捆绑调整,并计算每个关键点的时至碰撞(TTC)。随后选择地面平面中的2D运动基元,使机器人远离最小TTC关键点的最近接近点。在M3ED数据集的真实数据上评估,该方法在识别真值TTC低于1秒的帧时,精度为0.49,召回率为0.38;在真正阳性检测中,84%能正确生成规避方向。关键的是,对于测试序列中22个独特物理障碍物,该方法成功检测到至少一个低于1秒的碰撞风险帧,共20个。与需要数千小时机器人专属训练数据的端到端学习方法不同,本方法完全无需模型训练,仅需74秒数据用于超参数调优,展现出极高的数据效率,同时保持行为的可解释性与跨多种障碍物的泛化能力。
原文摘要 · Abstract (English)
Dynamic obstacle avoidance in unstructured outdoor environments remains a critical challenge for autonomous mobile robots, particularly when large-scale robot-specific training data and simulation-based policies are impractical. We present a data-efficient, interpretable method for vision-based dynamic obstacle avoidance that operates entirely on real-world data, avoiding the sim-to-real transfer problem inherent in simulation-trained policies. Our approach leverages UniDepth, a large pretrained monocular depth estimation model, to produce dense depth maps from RGB video without requiring stereo cameras or LiDAR at inference time. Dynamic obstacle avoidance is achieved by extending the SuperPoint and SuperGlue feature correspondence pipeline to track keypoints across long frame sequences, projecting their 2D pixel-space positions into 3D using camera intrinsics and predicted depth, running bundle adjustment initialized from these 3D keypoints, and computing per-keypoint time-to-collision (TTC). A 2D motion primitive in the ground plane is then selected to move the robot away from the closest point of approach of the minimum-TTC keypoint. Evaluated on real-world data from the M3ED dataset, our pipeline achieves a precision of 0.49 and a recall of 0.38 in identifying frames with a ground truth TTC below 1 second, and correctly generates the evasive motion direction in 84\% of true positive detections. Crucially, it detects at least one frame with TTC less than 1 second for 20 out of 22 unique physical obstacles present in our test sequences. Unlike end-to-end learned methods that demand thousands of hours of robot-specific training data, our approach eliminates model training entirely, requiring only 74 seconds of data for hyperparameter tuning. This demonstrates exceptional data efficiency while preserving interpretable and generalizable behavior across diverse obstacle types.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。