arXiv:2503.04838cs.CVcs.RO2025-03被引 6

用仿真生成机器人抓握滑动数据,提升研究效率与可复现性。

Combined Physics and Event Camera Simulator for Slip Detection

  • 构建物理与事件相机联合仿真管道,模拟机械臂抓握场景
  • 生成两个数据集,神经网络验证准确率高且泛化能力强
  • 适合做事件相机滑动检测的算法研究者和机器人开发者

机器人操作在工业制造等领域广泛应用。检测物体是否从机械臂中滑落对安全可靠运行至关重要。事件相机通过以高时间分辨率(称作“事件”)记录像素亮度变化,具备独特优势:当物体被正确抓握时无事件产生,一旦滑动则立即触发。现有大多数基于事件数据的滑动检测研究依赖真实场景与人工标注,导致数据收集耗时长、场景调整困难、实验重复复杂。本文提出一种仿真流程,用于在机械臂末端执行器配置下生成滑动数据,并通过初步数据驱动实验验证其有效性。仿真系统一旦搭建,可大幅减少数据采集时间,支持灵活场景切换,简化重复实验并生成大规模数据集。两个数据集经视觉检查和人工神经网络(ANN)验证:视觉检查确认帧图像逼真、滑动建模准确;三个训练模型在验证集上表现优异,在独立测试集上展现良好泛化能力,并初步适用于真实数据。项目主页:https://github.com/tub-rip/event_slip

原文摘要 · Abstract (English)

Robot manipulation is a common task in fields like industrial manufacturing. Detecting when objects slip from a robot's grasp is crucial for safe and reliable operation. Event cameras, which register pixel-level brightness changes at high temporal resolution (called ``events''), offer an elegant feature when mounted on a robot's end effector: since they only detect motion relative to their viewpoint, a properly grasped object produces no events, while a slipping object immediately triggers them. To research this feature, representative datasets are essential, both for analytic approaches and for training machine learning models. The majority of current research on slip detection with event-based data is done on real-world scenarios and manual data collection, as well as additional setups for data labeling. This can result in a significant increase in the time required for data collection, a lack of flexibility in scene setups, and a high level of complexity in the repetition of experiments. This paper presents a simulation pipeline for generating slip data using the described camera-gripper configuration in a robot arm, and demonstrates its effectiveness through initial data-driven experiments. The use of a simulator, once it is set up, has the potential to reduce the time spent on data collection, provide the ability to alter the setup at any time, simplify the process of repetition and the generation of arbitrarily large data sets. Two distinct datasets were created and validated through visual inspection and artificial neural networks (ANNs). Visual inspection confirmed photorealistic frame generation and accurate slip modeling, while three ANNs trained on this data achieved high validation accuracy and demonstrated good generalization capabilities on a separate test set, along with initial applicability to real-world data. Project page: https://github.com/tub-rip/event_slip

事件相机滑动检测仿真生成机器人感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。