arXiv:2607.03818cs.CV2026-07

仅用单目摄像头实现微型无人机室内搜救自主导航与爬楼

TRISTAR: Triple-Signal Stair Recognition and Vision-Only Indoor Navigation for Search-and-Rescue Micro-UAVs

论文配图:TRISTAR: Triple-Signal Stair Recognition and Vision-Only Indoor Navigation for Search-and-Rescue Micro-UAVs
图 1 · 摘自论文原文
  • 融合边缘、纹理和深度信息,实现无硬件依赖的楼梯识别
  • 真实楼宇飞行测试中深度误差低于10%,门检测F1达0.91
  • 适合低成本搜救无人机,尤其适用于无信号建筑内作业

室内搜救常需快速获取环境信息,但此时卫星信号不可用且人工进入危险。现有自主飞行系统多依赖激光雷达或立体视觉,增加成本与复杂性。本文提出基于单目视觉的完整自主导航框架,部署于DJI Tello平台,结合Depth Anything V2进行单目深度估计,并融合经典计算机视觉与轻量级深度学习模型,实现场景理解、遇险者检测与危险识别。系统包含两项独立行为:(i) 走廊探索,含自动门检测、入室、基于OCR的房间识别与遇险者检查;(ii) 自主爬楼,采用新方法TRISTAR(三信号楼梯识别),融合结构线索(Sobel滤波)、纹理分析(多尺度Gabor滤波)与单目深度几何信息。在大学楼宇实飞测试中,深度校准使相对深度误差从27.4%降至10%以下,门检测精度达0.93,F1得分为0.91。消融实验表明,多传感器融合显著提升楼梯识别鲁棒性;故障案例分析揭示了在复杂光照与反光表面下单目感知的局限性。结果证明,无需专用测距硬件,资源受限平台亦可实现可靠室内探索与楼梯穿越,为快速搜救部署提供实用、低成本方案。

原文摘要 · Abstract (English)

Indoor search-and-rescue (SAR) operations often require rapid situational awareness where GNSS signals are unavailable and human access is difficult or hazardous. While most autonomous aerial systems rely on LiDAR, stereo vision, or specialized depth cameras, such solutions increase both hardware complexity and deployment costs. This paper presents a complete autonomous indoor navigation framework for low-cost unmanned aerial vehicles based exclusively on monocular vision. Implemented on a DJI Tello platform, the system combines monocular depth estimation using Depth Anything V2 with classical computer vision and lightweight deep learning models for scene understanding, victim detection, and hazard recognition. The framework consists of two independent behaviors: (i) corridor exploration with automatic door detection, room entry, OCR-based room identification, and victim inspection; and (ii) autonomous stair ascent based on TRISTAR (TRI-Signal STair Ascent Recognition), a novel triple-sensor fusion method that integrates structural cues (Sobel filtering), texture analysis (multi-scale Gabor filtering), and geometric depth from monocular depth estimation. Evaluation used real indoor flights in a university building. Depth calibration reduced relative depth error from 27.4% to below 10%, while the door detection algorithm reached a precision of 0.93 and an F1-score of 0.91. A dedicated ablation study shows that multi-sensor fusion significantly improves stair-recognition robustness compared to individual sensing modalities, and a failure-case analysis delineates the limits of monocular perception under challenging lighting and reflective surfaces. The results demonstrate that reliable indoor exploration and stair traversal are achievable on resource-constrained platforms without specialized ranging hardware, a practical, cost-effective solution for rapid SAR deployment.

无人机室内导航单目视觉搜救机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。