让移动机器人主动识别化学实验风险,避免误判导致的流程中断。
PREVENT: Proactive Risk Evaluation and Vigilant Execution of Tasks for Mobile Robotic Chemists using Multi-Modal Behavior Trees
- 用多模态行为树整合视觉与气体传感器,实现任务执行中的风险感知。
- 在模拟场景中零误报、零漏报,导航与操作准确率均优于单一模态方法。
- 适合需要高可靠性自主实验的智能化学机器人系统部署。
移动式化学机器人在化学与材料研究中发展迅速,但目前普遍缺乏对工作流状态的感知能力。即使微小异常(如未正确密封的样品管)也可能导致整个流程中断,造成时间与资源浪费,并可能使研究人员暴露于有毒物质中。现有感知机制虽可预测异常,但常产生过多误报,导致不必要的流程暂停,需人工介入重启,削弱了自动化优势。为此,本文提出PREVENT系统,基于多模态行为树架构,融合灵巧视觉、导航视觉摄像头及物联网气体传感器,构建分层感知机制,实现执行过程中的决策支持。实验表明,该方法在模拟风险场景中完全避免了假阳性与假阴性,且多模态感知在导航与操作任务中的部署准确率均高于对应单模态方法的平均值。
原文摘要 · Abstract (English)
Mobile robotic chemists are a fast growing trend in the field of chemistry and materials research. However, so far these mobile robots lack workflow awareness skills. This poses the risk that even a small anomaly, such as an improperly capped sample vial could disrupt the entire workflow. This wastes time, and resources, and could pose risks to human researchers, such as exposure to toxic materials. Existing perception mechanisms can be used to predict anomalies but they often generate excessive false positives. This may halt workflow execution unnecessarily, requiring researchers to intervene and to resume the workflow when no problem actually exists, negating the benefits of autonomous operation. To address this problem, we propose PREVENT a system comprising navigation and manipulation skills based on a multimodal Behavior Tree (BT) approach that can be integrated into existing software architectures with minimal modifications. Our approach involves a hierarchical perception mechanism that exploits AI techniques and sensory feedback through Dexterous Vision and Navigational Vision cameras and an IoT gas sensor module for execution-related decision-making. Experimental evaluations show that the proposed approach is comparatively efficient and completely avoids both false negatives and false positives when tested in simulated risk scenarios within our robotic chemistry workflow. The results also show that the proposed multi-modal perception skills achieved deployment accuracies that were higher than the average of the corresponding uni-modal skills, both for navigation and for manipulation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。