arXiv:2511.16262cs.ROcs.CV2025-11被引 1

让机器人像昆虫一样侧头看,突破遮挡障碍,看清被挡住的环境。

How Robot Dogs See the Unseeable: Improving Visual Interpretability via Peering for Exploratory Robots

  • 模仿昆虫侧头动作,用光学合成孔径提升视觉感知。
  • 在遮挡环境下实现高分辨率、实时、全波段感知,优于现有3D视觉技术。
  • 低成本可部署,适用于各类移动机器人,尤其适合复杂环境探索。

在森林等植被密集环境中,探索型机器人需在人类难以进入且传统设备失效的复杂场景中导航。障碍物(如枝叶)造成的视觉遮挡会严重干扰传感器,影响场景理解。本文表明,模仿昆虫克服视觉局限的“侧头观察”行为,可显著提升机器人在部分遮挡下的视觉推理能力。该方法结合光学合成孔径传感原理与现代大型多模态模型的视觉推理能力,实现实时、高分辨率、波长无关的感知,对基于视觉的场景理解至关重要。该方案成本低,可直接部署于任何带摄像头的机器人。实验在工业级四足机器人上进行,验证了不同侧头运动和遮挡掩码策略的有效性;结果显示,相较于侧头观察,当前主流多视角三维视觉技术因高度易受遮挡影响而失效。该能力不仅限于四足平台,还可推广至双足、六足、轮式或爬行机器人。能有效穿透局部遮挡的机器人将获得更优的感知能力,包括增强的场景理解、态势感知、伪装识别及复杂环境下的高级导航。

原文摘要 · Abstract (English)

In vegetated environments, such as forests, exploratory robots play a vital role in navigating complex, cluttered environments where human access is limited and traditional equipment struggles. Visual occlusion from obstacles, such as foliage, can severely obstruct a robot's sensors, impairing scene understanding. We show that "peering", a characteristic side-to-side movement used by insects to overcome their visual limitations, can also allow robots to markedly improve visual reasoning under partial occlusion. This is accomplished by applying core signal processing principles, specifically optical synthetic aperture sensing, together with the vision reasoning capabilities of modern large multimodal models. Peering enables real-time, high-resolution, and wavelength-independent perception, which is crucial for vision-based scene understanding across a wide range of applications. The approach is low-cost and immediately deployable on any camera-equipped robot. We investigated different peering motions and occlusion masking strategies, demonstrating that, unlike peering, state-of-the-art multi-view 3D vision techniques fail in these conditions due to their high susceptibility to occlusion. Our experiments were carried out on an industrial-grade quadrupedal robot. However, the ability to peer is not limited to such platforms, but potentially also applicable to bipedal, hexapod, wheeled, or crawling platforms. Robots that can effectively see through partial occlusion will gain superior perception abilities - including enhanced scene understanding, situational awareness, camouflage breaking, and advanced navigation in complex environments.

机器人感知视觉遮挡仿生视觉四足机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。