用高光谱成像+深度学习实现像素级材料分类,准确率达99.94%。
A Deep Learning Approach for Pixel-level Material Classification via Hyperspectral Imaging
- 结合高光谱成像与深度学习,实现像素级材料识别
- 模型在多种材质重叠下仍达99.94%准确率,抗形变干扰强
- 适合垃圾分拣、制药等需精准材质识别的工业场景
近年来,计算机视觉在检测、分割和分类方面取得显著进展,但主要依赖于基于RGB的系统,难以满足废物分拣、制药及国防等领域对物体表征的更高要求。高光谱(HS)成像可同时获取光谱与空间信息,克服了传统技术如X射线荧光和拉曼光谱在速度、成本与安全性上的局限。本研究评估了将高光谱成像与深度学习结合用于材料表征的潜力:首先设计包含高光谱相机、传送带与可控光源的实验装置;其次构建包含多种塑料(HDPE、PET、PP、PS)的多目标数据集,通过半自动掩码生成与拉曼光谱标注;最后训练深度学习模型对高光谱图像进行像素级材料分类。模型达到99.94%的分类准确率,展现出对颜色、尺寸、形状的强鲁棒性,并能有效处理材料重叠问题。黑体材料识别仍存在挑战。结果表明,将计算机视觉拓展至高光谱成像可行,显著优于传统方法,具有广阔应用前景。
原文摘要 · Abstract (English)
Recent advancements in computer vision, particularly in detection, segmentation, and classification, have significantly impacted various domains. However, these advancements are tied to RGB-based systems, which are insufficient for applications in industries like waste sorting, pharmaceuticals, and defense, where advanced object characterization beyond shape or color is necessary. Hyperspectral (HS) imaging, capturing both spectral and spatial information, addresses these limitations and offers advantages over conventional technologies such as X-ray fluorescence and Raman spectroscopy, particularly in terms of speed, cost, and safety. This study evaluates the potential of combining HS imaging with deep learning for material characterization. The research involves: i) designing an experimental setup with HS camera, conveyor, and controlled lighting; ii) generating a multi-object dataset of various plastics (HDPE, PET, PP, PS) with semi-automated mask generation and Raman spectroscopy-based labeling; and iii) developing a deep learning model trained on HS images for pixel-level material classification. The model achieved 99.94\% classification accuracy, demonstrating robustness in color, size, and shape invariance, and effectively handling material overlap. Limitations, such as challenges with black objects, are also discussed. Extending computer vision beyond RGB to HS imaging proves feasible, overcoming major limitations of traditional methods and showing strong potential for future applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。