用摄像头教机器人识别风险,实时预警并自适应学习新故障。
ILeSiA: Interactive Learning of Robot Situational Awareness from Camera Input
- 通过图像低维表征+高斯过程,输出连续风险评分。
- 仅需一个例子即可检测已知和未知故障,准确率超传统MLP。
- 适合需要快速部署、安全协作的工业机器人场景。
示范学习是教授机器人新技能的有前景方法,但执行中难以识别故障和预防失败,因示范通常只覆盖有限场景且多为成功案例。本文提出基于摄像头输入的交互式情境感知学习方法,通过标注图像帧为安全或危险,训练高斯过程回归模型,从图像低维表征输出0到1间的连续风险分数,量化每时刻风险程度。该机制支持在不安全时暂停任务,并由用户直接添加新训练数据。实验在机械臂上验证:本方法仅需每类新故障一个示例即可可靠检测已知与未知故障;而标准多层感知机(MLP)仅对训练中出现的故障表现良好。该方法使下一代协作机器人能快速部署,实现基于视觉的风险评估,主动保护人类,并提前发现零件错位或缺失。代码与数据已公开于 imitrob.ciirc.cvut.cz/publications/ilesia。
原文摘要 · Abstract (English)
Learning from demonstration is a promising approach for teaching robots new skills. However, a central challenge in the execution of acquired skills is the ability to recognize faults and prevent failures. This is essential because demonstrations typically cover only a limited set of scenarios and often only the successful ones. During task execution, unforeseen situations may arise, such as changes in the robot's environment or interaction with human operators. To recognize such situations, this paper focuses on teaching the robot situational awareness by using a camera input and labeling frames as safe or risky. We train a Gaussian Process (GP) regression model fed by a low-dimensional latent space representation of the input images. The model outputs a continuous risk score ranging from zero to one, quantifying the degree of risk at each timestep. This allows for pausing task execution in unsafe situations and directly adding new training data, labeled by the human user. Our experiments on a robotic manipulator show that the proposed method can reliably detect both known and novel faults using only a single example for each new fault. In contrast, a standard multi-layer perceptron (MLP) performs well only on faults it has encountered during training. Our method enables the next generation of cobots to be rapidly deployed with easy-to-set-up, vision-based risk assessment, proactively safeguarding humans and detecting misaligned parts or missing objects before failures occur. We provide all the code and data required to reproduce our experiments at imitrob.ciirc.cvut.cz/publications/ilesia.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。