用单目视频生成精准距离估计,助力盲人导航无人机避障
NeoARCADE: Robust Calibration for Distance Estimation to Support Assistive Drones for the Visually Impaired
- 通过深度图归一化与系数估计实现相对距离到绝对距离的鲁棒校准
- 对盲人距离预测误差小于30cm,对车辆等障碍物误差不超过60cm
- 动态重校准适应复杂场景,适合盲人辅助无人机系统研发者
利用机载传感器结合深度学习与计算机视觉算法,无人机自主导航正影响多个领域。本文研究无人机在城市环境中自主跟随并协助视障人士(VIP)导航的应用。准确估计无人机与视障人士及周围物体之间的绝对距离,是设计避障算法的关键。本文提出NeoARCADE(Neo),利用消费级无人机常见的单目视频流生成的深度图,估算与VIP及障碍物的绝对距离。Neo采用基于深度得分归一化和系数估计的鲁棒校准技术,将深度图中的相对距离转换为绝对距离,并引入动态重校准方法以适应变化环境。我们还构建了回归与几何两个基线模型,并与当前最优的深度图方法进行对比。基于校园环境采集的数据集,进行了详细评估,验证了其在多样化动态条件下的鲁棒性与泛化能力。Neo对视障人士的距离预测误差小于30cm,对车辆、自行车等障碍物的最大误差为60cm,优于所有基线模型;相比SOTA深度图方法,误差降低达5.3至14.6倍。
原文摘要 · Abstract (English)
Autonomous navigation by drones using onboard sensors, combined with deep learning and computer vision algorithms, is impacting a number of domains. We examine the use of drones to autonomously follow and assist Visually Impaired People (VIPs) in navigating urban environments. Estimating the absolute distance between the drone and the VIP, and to nearby objects, is essential to design obstacle avoidance algorithms. Here, we present NeoARCADE (Neo), which uses depth maps over monocular video feeds, common in consumer drones, to estimate absolute distances to the VIP and obstacles. Neo proposes robust calibration technique based on depth score normalization and coefficient estimations to translate relative distances from depth map to absolute ones. It further develops a dynamic recalibration method that can adapt to changing scenarios. We also develop two baseline models, Regression and Geometric, and compare Neo with SOTA depth map approaches and the baselines. We provide detailed evaluations to validate their robustness and generalizability for distance estimation to VIPs and other obstacles in diverse and dynamic conditions, using datasets collected in a campus environment. Neo predicts distances to VIP with an error <30cm, and to different obstacles like cars and bicycles within a maximum error of 60cm, which are better than the baselines. Neo also clearly out-performs SOTA depth map methods, reporting errors up to 5.3-14.6x lower.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。