arXiv:2502.20843cs.ROcs.AI2025-02被引 4

提出模块化网络,让机器人零样本适配复杂家居环境的非抓取操作。

Hierarchical and Modular Network on Non-prehensile Manipulation in General Environments

  • 用可重构模块网络动态匹配任务需求,适应不同环境约束。
  • 在模拟环境中训练后,直接部署到真实世界新场景和物体上成功操作。
  • 构建包含353个物体的9个真实场景数字孪生数据集,推动领域研究。

为使机器人在家庭等通用环境中执行非抓取操作(如推倒、滚动)以处理无法抓握的物体,需克服环境几何多样性带来的挑战。现有方法难以跨环境泛化,因策略需适应墙体、天花板或台阶等复杂约束。本文提出一种模块化且可重构的网络架构,能根据任务动态调整网络模块。为捕捉环境几何变化,将基于接触的对象表示(CORN)扩展至环境几何,并设计程序化算法生成多样化训练环境。所提策略可在完全仿真中训练后实现零样本迁移至真实世界的全新场景与物体。此外,本文发布一个基于仿真的真实场景基准,包含9个真实场景的数字孪生和353个物体,助力非抓取操作研究向真实场景推进。

原文摘要 · Abstract (English)

For robots to operate in general environments like households, they must be able to perform non-prehensile manipulation actions such as toppling and rolling to manipulate ungraspable objects. However, prior works on non-prehensile manipulation cannot yet generalize across environments with diverse geometries. The main challenge lies in adapting to varying environmental constraints: within a cabinet, the robot must avoid walls and ceilings; to lift objects to the top of a step, the robot must account for the step's pose and extent. While deep reinforcement learning (RL) has demonstrated impressive success in non-prehensile manipulation, accounting for such variability presents a challenge for the generalist policy, as it must learn diverse strategies for each new combination of constraints. To address this, we propose a modular and reconfigurable architecture that adaptively reconfigures network modules based on task requirements. To capture the geometric variability in environments, we extend the contact-based object representation (CORN) to environment geometries, and propose a procedural algorithm for generating diverse environments to train our agent. Taken together, the resulting policy can zero-shot transfer to novel real-world environments and objects despite training entirely within a simulator. We additionally release a simulation-based benchmark featuring nine digital twins of real-world scenes with 353 objects to facilitate non-prehensile manipulation research in realistic domains.

非抓取操作模块化网络零样本迁移机器人控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。