提出统一框架与仿真基准,提升机器人抓取扁平物的泛化能力。
FlatLab: A Unified Methodology Framework and Simulation-Based Benchmark for Robotic Manipulation of Flat Objects

- 分策略生成与执行模块,从点云预测适配策略
- 在仿真中实现对未见物体的有效泛化,性能优于基线
- 适用于需要强泛化能力的工业抓取场景
机器人操控扁平物体因不可抓握构型及几何、材质变化大而困难。现有方法依赖启发式预操作,且评估环境封闭、泛化性差。本文提出统一框架,将操控分解为策略生成器与动作执行模块。策略生成器通过模拟数据变换与对比学习,从物体点云中学习以策略为中心、与物体无关的表征。基于预测策略,执行模块将长时序操作分解为可复用的动作原语,并动态组合生成稳定轨迹。为支持系统评估,引入FlatLab——一个全面的仿真基准,提供高保真物理仿真、多模态数据自动采集及标准化任务定义与评测协议。在FlatLab上的实验表明,该方法能有效泛化至未见物体与类别,优于现有基线。项目页面与代码详见https://flatlab-web.github.io/。
原文摘要 · Abstract (English)
Robotic manipulation of flat objects is challenging due to the ungraspable configurations and strong variations in object geometry and material. Existing methods rely on heuristic pre-manipulation and are often evaluated in closed settings with limited generalization. We propose a unified framework that decouples the manipulation into a strategy generator and an action execution module. The strategy generator predicts appropriate manipulation strategies from object point clouds by learning strategy-centric, object-invariant representations via simulated data transformation and contrastive learning. Conditioned on the predicted strategy, the execution module decomposes long-horizon manipulation into reusable action primitives and dynamically composes them to generate stable trajectories. To enable systematic evaluation, we introduce FlatLab, a comprehensive simulation benchmark for robotic flat object manipulation. FlatLab provides high-fidelity physical simulation of diverse rigid and deformable flat objects, automated multi-modal data collection, and standardized task definitions and evaluation protocols. Experiments conducted in FlatLab demonstrate that our approach generalizes effectively to unseen objects and categories, outperforming existing baselines. The project page and the code are provided at https://flatlab-web.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。