arXiv:2505.19026cs.RO2025-05

用偏振视觉提升楼梯识别精度,助力机器人和残障人士安全通行。

Staircase Recognition and Location Based on Polarization Vision

  • 融合偏振与亮度信息增强对比度,提升楼梯检测能力。
  • 通过融合双目偏振与TOF深度数据实现高精度3D重建。
  • 提出联合标定算法,降低环境光与表面材质干扰影响。

楼梯是人工场景中常见的结构,但对人形机器人及下肢残疾或视觉障碍者而言,跨越楼梯仍需传感器与智能算法辅助。楼梯感知技术是实现识别与定位的前提,对机器人模式切换及足位计算以适应不连续地形具有重要意义。然而当前技术受限于识别精度低、传感器初始噪声大、输出信号不稳定及计算开销高等问题。传统双目与飞行时间(TOF)重建易受环境光和物体表面材质影响。相比之下,偏振成像利用偏振器选择性透射特定方向的偏振光,依赖表面偏振信息,受环境光干扰小,且不依赖纹理。本文提出一种融合偏振与光强信息的对比度增强算法,并结合基于YOLOv11的点云分割实现楼梯检测。为实现高质量3D重建,提出融合偏振双目与TOF深度信息的方法。此外,设计了基于ICP配准与改进灰狼优化算法的单目相机与TOF相机联合标定方法。

原文摘要 · Abstract (English)

Staircase is one of the most common structures in artificial scenes. However, it is difficult for humanoid robots and people with lower limb disabilities or visual impairment to cross the scene without the help of sensors and intelligent algorithms. Staircase scene perception technology is a prerequisite for recognition and localization. This technology is of great significance for the mode switching of the robot and the calculation of the footprint position to adapt to the discontinuous terrain. However, there are still many problems that constrain the application of this technology, such as low recognition accuracy, high initial noise from sensors, unstable output signals and high computational requirements. In terms of scene reconstruction, the binocular and time of flight (TOF) reconstruction of the scene can be easily affected by environmental light and the surface material of the target object. In contrast, due to the special structure of the polarizer, the polarization can selectively transmit polarized light in a specific direction and this reconstruction method relies on the polarization information of the object surface. So the advantages of polarization reconstruction are reflected, which are less affected by environmental light and not dependent on the texture information of the object surface. In this paper, in order to achieve the detection of staircase, this paper proposes a contrast enhancement algorithm that integrates polarization and light intensity information, and integrates point cloud segmentation based on YOLOv11. To realize the high-quality reconstruction, we proposed a method of fusing polarized binocular and TOF depth information to realize the three-dimensional (3D) reconstruction of the staircase. Besides, it also proposes a joint calibration algorithm of monocular camera and TOF camera based on ICP registration and improved gray wolf optimization algorithm.

偏振视觉楼梯识别3D重建机器人导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。