arXiv:2411.00781cs.ROcs.AI2024-11NAACL被引 20

让机器人主动发现家庭隐患,提前规避风险。

Hazards in Daily Life? Enabling Robots to Proactively Detect and Resolve Anomalies

  • 用多智能体协作生成家庭异常场景,无需人工标注数据。
  • 构建三维仿真环境,让机器人学会分解任务应对隐患。
  • 适合做智能家居安全与机器人自主决策的研究者参考。

现有家用机器人在执行清洁、递送等常规任务上已取得显著进展,但难以识别家庭环境中的潜在危险。例如,儿童可能捡起掉落的药品并误食,构成严重风险。本文提出主动检测家庭异常的新任务,利用基础模型构建模拟环境,通过多智能体头脑风暴生成涵盖家庭安全隐患、卫生管理与儿童安全的多样化场景。这些文本任务描述与定制3D资产结合,生成逼真仿真环境。机器人在其中通过任务分解和最优学习策略选择,习得主动发现并处理异常的能力。实验表明,该生成环境在任务描述质量与场景多样性上优于现有方案,显著提升机器人应对家庭潜在风险的能力。

原文摘要 · Abstract (English)

Existing household robots have made significant progress in performing routine tasks, such as cleaning floors or delivering objects. However, a key limitation of these robots is their inability to recognize potential problems or dangers in home environments. For example, a child may pick up and ingest medication that has fallen on the floor, posing a serious risk. We argue that household robots should proactively detect such hazards or anomalies within the home, and propose the task of anomaly scenario generation. We leverage foundational models instead of relying on manually labeled data to build simulated environments. Specifically, we introduce a multi-agent brainstorming approach, where agents collaborate and generate diverse scenarios covering household hazards, hygiene management, and child safety. These textual task descriptions are then integrated with designed 3D assets to simulate realistic environments. Within these constructed environments, the robotic agent learns the necessary skills to proactively discover and handle the proposed anomalies through task decomposition, and optimal learning approach selection. We demonstrate that our generated environment outperforms others in terms of task description and scene diversity, ultimately enabling robotic agents to better address potential household hazards.

机器人异常检测家庭安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。