用生成模型扩充垃圾分拣数据,仅需100张标注图就提升识别准确率
WasteGAN: Data Augmentation for Robotic Waste Sorting through Generative Adversarial Networks
- 设计新型GAN架构,通过特殊损失函数和激活函数增强小样本学习能力
- 在仅有100个标注样本下,使分割模型性能提升5.8%,显著改善垃圾识别
- 生成真实感强的合成数据,适合用于训练机器人抓取复杂垃圾的智能系统
机器人垃圾分拣面临感知与操作双重挑战,因传送带上物品种类繁多且杂乱。尽管深度学习有效,但大量数据收集与标注限制了其在真实场景中的应用。为此,我们提出基于新型GAN架构wasteGAN的数据增强方法。该方法可从极少标注样本(如仅100张)出发,提升语义分割模型性能。关键创新包括新损失函数、新激活函数及更大生成器模块,使网络更高效学习并生成贴近真实分布的合成数据。随后利用高质量分割掩码计算语义感知抓取姿态,使机械臂能在真实场景中有效识别杂质并分类垃圾。经数据集评估与实地实验验证,本方法在抓取杂质任务中性能最高提升5.8%。项目主页见 https://github.com/bach05/wasteGAN.git
原文摘要 · Abstract (English)
Robotic waste sorting poses significant challenges in both perception and manipulation, given the extreme variability of objects that should be recognized on a cluttered conveyor belt. While deep learning has proven effective in solving complex tasks, the necessity for extensive data collection and labeling limits its applicability in real-world scenarios like waste sorting. To tackle this issue, we introduce a data augmentation method based on a novel GAN architecture called wasteGAN. The proposed method allows to increase the performance of semantic segmentation models, starting from a very limited bunch of labeled examples, such as few as 100. The key innovations of wasteGAN include a novel loss function, a novel activation function, and a larger generator block. Overall, such innovations helps the network to learn from limited number of examples and synthesize data that better mirrors real-world distributions. We then leverage the higher-quality segmentation masks predicted from models trained on the wasteGAN synthetic data to compute semantic-aware grasp poses, enabling a robotic arm to effectively recognizing contaminants and separating waste in a real-world scenario. Through comprehensive evaluation encompassing dataset-based assessments and real-world experiments, our methodology demonstrated promising potential for robotic waste sorting, yielding performance gains of up to 5.8\% in picking contaminants. The project page is available at https://github.com/bach05/wasteGAN.git
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。