用视觉识别透明试管边界,实现机器人实时避障。
From Transparent Labware Segmentation to Collision Avoidance: A Real-Time Edge-Aware Perception Pipeline

- 融合边缘检测与注意力机制,提升透明容器分割精度。
- 边界分数达97.80,比基线高18.93点,推理仅需7.1毫秒。
- 适合做实验室机器人避障,尤其处理易碎透明器皿。
本文提出一种边缘感知的实例分割框架,仅通过视觉感知实现机器人对透明实验器皿的实时避障。由于折射、镜面反射及内部纹理缺失,传统分割方法难以应对透明容器,但其轮廓边界仍具较高可靠性。基于此,我们改进单阶段实时实例分割主干网络,加入轻量级边缘检测分支、边缘引导注意力融合模块及无参数的SimAM模块,并构建了包含3485张图像、21个类别的真实实验玻璃器皿数据集LabGlass-IS。所提模型在边界F分数上达到97.80,较YOLO提示的FastSAM高出18.93分,推理速度为每帧7.1毫秒,参数量仅为最接近性能对手的2.85%。通过多视角掩码质心三角化,可获取三维位置信息,用于保守包围体积碰撞约束。真实机器人测试中碰撞避障成功率达93.3%,验证了从感知到动作全流程的可行性。代码与视频见GitHub。
原文摘要 · Abstract (English)
This paper presents an edge-aware instance segmentation framework that enables real-time robotic collision avoidance with transparent laboratory glassware using purely visual perception. Transparent vessels defy conventional segmentation due to refraction, specular reflection, and the absence of stable interior texture, yet their boundary contours remain comparatively reliable visual cues. Exploiting this observation, we augment a one-stage real-time instance segmentation backbone with a lightweight edge-detection branch, edge-guided attention fusion, and a parameter-free SimAM module, and further construct LabGlass-IS, a 3485-image, 21-category instance segmentation dataset of real laboratory glassware. The enhanced model achieves the highest Boundary F-score of 97.80 among compared methods, outperforming the YOLO-prompted FastSAM framework by 18.93 BF points. Furthermore, it maintains an inference speed of 7.1ms per frame and requires only 2.85% of the parameters of the closest accuracy competitor. Multi-view triangulation of mask centroids further provides 3D positions for conservative bounding-volume collision constraints. Real-robot trials achieve a 93.3% collision avoidance success rate, indicating the feasibility of the proposed perception-to-action pipeline for robot collision avoidance among fragile transparent objects. Our code is available at https://github.com/havishamy/TransYOLO_3D. Our video is available at https://havishamy.github.io/paper-videos/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。