评估软件检测贴纸的不确定性,提升笔记本翻新安全性
Assessing the Uncertainty and Robustness of the Laptop Refurbishing Software
- 用蒙特卡洛丢弃法量化六种贴纸检测模型的不确定性
- 在三个数据集上测试,发现不同模型性能差异显著
- 提出新鲁棒性指标,适合工业质检系统开发者参考
翻新笔记本电脑可延长其使用寿命,减少电子垃圾,推动可持续发展。丹麦技术研究所(DTI)研发了基于软件的机器人应用,其中清洁是关键步骤,需自动识别并去除笔记本表面的贴纸。由于贴纸形状、颜色和位置多样,识别过程存在高度不确定性,需明确量化该不确定性以降低误操作导致设备损伤的风险。为此,采用蒙特卡洛丢弃法评估了六种贴纸检测模型(SDMs),使用三个数据集:原始图像数据集及通过DALL-E-3和Stable Diffusion-3生成的两个数据集。此外,基于密集对抗方法生成对抗数据集,提出了新的鲁棒性评估指标,涵盖检测准确率与不确定性。结果表明不同模型在各项指标表现各异,据此提供了模型选择指南及多维度经验总结。
原文摘要 · Abstract (English)
Refurbishing laptops extends their lives while contributing to reducing electronic waste, which promotes building a sustainable future. To this end, the Danish Technological Institute (DTI) focuses on the research and development of several robotic applications empowered with software, including laptop refurbishing. Cleaning represents a major step in refurbishing and involves identifying and removing stickers from laptop surfaces. Software plays a crucial role in the cleaning process. For instance, the software integrates various object detection models to identify and remove stickers from laptops automatically. However, given the diversity in types of stickers (e.g., shapes, colors, locations), identification of the stickers is highly uncertain, thereby requiring explicit quantification of uncertainty associated with the identified stickers. Such uncertainty quantification can help reduce risks in removing stickers, which, for example, could otherwise result in software faults damaging laptop surfaces. For uncertainty quantification, we adopted the Monte Carlo Dropout method to evaluate six sticker detection models (SDMs) from DTI using three datasets: the original image dataset from DTI and two datasets generated with vision language models, i.e., DALL-E-3 and Stable Diffusion-3. In addition, we presented novel robustness metrics concerning detection accuracy and uncertainty to assess the robustness of the SDMs based on adversarial datasets generated from the three datasets using a dense adversary method. Our evaluation results show that different SDMs perform differently regarding different metrics. Based on the results, we provide SDM selection guidelines and lessons learned from various perspectives.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。