arXiv:2604.15569cs.RO2026-04

用自动生成的多样化物体数据,让机器人学会处理同一类物品的形状变化。

ShapeGen: Robotic Data Generation for Category-Level Manipulation

论文配图:ShapeGen: Robotic Data Generation for Category-Level Manipulation
图 1 · 摘自论文原文
  • 通过空间映射构建可复用的3D物体库,实现无仿真器的形状变异生成
  • 仅需少量人工标注即可生成物理合理且功能正确的操作示范
  • 显著提升机器人在真实场景中对同类物品的泛化能力,适合机器人操控研究者

在非受控现实场景中部署的操作策略需应对日常物品在类别内的巨大几何差异。为实现稳健性能,策略必须具备类别级泛化能力,即能与某一类别中的任意物体交互,而非仅限于训练时见过的具体实例。这种类别内泛化通常依赖形状多样化的训练数据,但手动收集此类数据因需大量人力和多样物体而不可行。本文提出ShapeGen,一种无需模拟器、基于3D的形状变异操作数据生成方法。该方法分为两阶段:第一阶段,训练点到点的空间扭曲模型以建立功能性对应关系,并将3D模型及扭曲关系整合为即插即用的形状库;第二阶段,设计一个利用已有库的生成流水线,仅需最少人工标注即可生成物理合理且功能正确的全新操作示范。真实世界实验表明,ShapeGen有效提升了策略在类别内形状变化下的泛化能力。

原文摘要 · Abstract (English)

Manipulation policies deployed in uncontrolled real-world scenarios are faced with great in-category geometric diversity of everyday objects. In order to function robustly under such variations, policies need to work in a category-level manner, i.e. knowing how to interact with any object in a certain category, instead of only a specific one seen during training. This in-category generalizability is usually nurtured with shape-diversified training data; however, manually collecting such a corpus of data is infeasible due to the requirement of intense human labor and large collections of divergent objects at hand. In this paper, we propose ShapeGen, a data generation method that aims at generating shape-variated manipulation data in a simulator-free and 3D manner. ShapeGen decomposes the process into two stages: Shape Library curation and Function-Aware Generation. In the first stage, we train spatial warpings between shapes mapping points to points that correspond functionally, and aggregate 3D models along with the warpings into a plug-and-play Shape Library. In the second stage, we design a pipeline that, leveraging established Libraries, requires only minimal human annotation to generate physically plausible and functionally correct novel demonstrations. Experiments in the real world demonstrate the effectiveness of ShapeGen to boost policies' in-category shape generalizability. Project page: https://wangyr22.github.io/ShapeGen/.

机器人操控数据生成类别泛化3D生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。