用高光谱成像提升机器人抓取精度,识别更准、成功率更高
A Hyperspectral Imaging Guided Robotic Grasping System
- 结合高光谱图像的空间与光谱信息生成抓取策略
- 纺织品识别准确率超越人类,分拣成功率显著高于传统RGB方法
- 系统低成本易集成,适合复杂动态环境下的智能抓取任务
高光谱成像是精确识别和分析材料或物体的先进技术,但其与机器人抓取系统的结合因部署复杂性和高昂成本而受限。本文提出一种新型高光谱成像引导的机器人抓取系统,包含PRISM(多面体反射成像扫描机构)和SpectralGrasp框架。PRISM实现高精度、无畸变的高光谱成像,简化系统集成并降低成本;SpectralGrasp通过有效利用高光谱图像中的空间与光谱信息生成抓取策略。实验表明,该系统在纺织品识别方面优于人类表现,在分拣成功率上显著高于基于RGB的方法。一系列对比实验进一步验证了系统有效性。研究展示了将高光谱成像与机器人抓取结合的潜力,提升了复杂动态环境中的识别与抓取能力。项目主页:https://zainzh.github.io/PRISM。
原文摘要 · Abstract (English)
Hyperspectral imaging is an advanced technique for precisely identifying and analyzing materials or objects. However, its integration with robotic grasping systems has so far been explored due to the deployment complexities and prohibitive costs. Within this paper, we introduce a novel hyperspectral imaging-guided robotic grasping system. The system consists of PRISM (Polyhedral Reflective Imaging Scanning Mechanism) and the SpectralGrasp framework. PRISM is designed to enable high-precision, distortion-free hyperspectral imaging while simplifying system integration and costs. SpectralGrasp generates robotic grasping strategies by effectively leveraging both the spatial and spectral information from hyperspectral images. The proposed system demonstrates substantial improvements in both textile recognition compared to human performance and sorting success rate compared to RGB-based methods. Additionally, a series of comparative experiments further validates the effectiveness of our system. The study highlights the potential benefits of integrating hyperspectral imaging with robotic grasping systems, showcasing enhanced recognition and grasping capabilities in complex and dynamic environments. The project is available at: https://zainzh.github.io/PRISM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。