arXiv:2605.07530cs.ROcs.SE2026-05

用搜索算法找机器人视觉模型的漏洞,提升笔记本翻新安全性

Search-based Robustness Testing of Laptop Refurbishing Robotic Software

论文配图:Search-based Robustness Testing of Laptop Refurbishing Robotic Software
图 1 · 摘自论文原文
  • 用多目标优化搜索最小扰动,暴露检测模型缺陷
  • 比随机搜索高效3到7倍,扰动更小且可跨模型迁移
  • 适合关注工业机器人安全与模型鲁棒性的研究者

丹麦技术研究所(DTI)致力于将先进科技(包括机器人)推广至工业和公共部门。其中关键应用是使用专用机器人进行笔记本电脑翻新,以促进设备再利用、减少电子垃圾,并支持欧洲循环经济行动计划。此类机器人软件常依赖物体检测模型完成螺丝识别或贴纸定位等任务。确保这些模型对输入微小变化的鲁棒性仍是一大挑战,若处理不当可能导致笔记本损坏。本文提出PROBE,一种基于搜索的鲁棒性测试方法,通过多目标优化寻找能诱发故障的最小、局部扰动。PROBE采用NSGA-II系统探索扰动空间,同时优化故障诱导效果、定位精度与扰动幅度,在发现多样化故障案例方面表现优异。实验表明,相比随机搜索,PROBE在生成故障扰动上效率提升3×至7×,且所需扰动幅度更小,生成扰动具备跨模型迁移能力。此外,我们还发现元变换关系可提供额外洞察,即使在未触发失败的情况下也能评估模型稳定性。

原文摘要 · Abstract (English)

The Danish Technological Institute (DTI) focuses on transferring advanced technologies (including robots) to the industry and the public sector. One key application is laptop refurbishment using specialized robots, aimed at promoting reuse, reducing electronic waste, and supporting the European Circular Economy Action Plan. The software of such robots often includes features that use object detection models to detect objects for various purposes, such as identifying screws for laptop disassembly or detecting stickers to remove them. Ensuring the robustness of such models to small input variations remains a critical challenge, and addressing it is important to avoid potential damage to laptops during refurbishment. In this paper, we propose PROBE, a search-based robustness testing approach that leverages multi-objective optimization to identify minimal, localized perturbations that expose failures in object detection models used in the software of laptop refurbishing robots. PROBE employs NSGA-II to systematically explore the perturbation space, optimizing for failure induction considering both localization and confidence, and perturbation magnitude, while enabling the discovery of diverse failure cases. Results show that PROBE is 3$\times$ to 7$\times$ more effective than random search in generating failure-inducing perturbations, while requiring smaller perturbation magnitudes, and that the generated perturbations transfer across models. We further show that metamorphic relations provide additional insights into model robustness, enabling the assessment of stability even in non-failing cases.

机器人鲁棒性测试物体检测搜索优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。