arXiv:2605.15836cs.ROcs.AI2026-05

通过几何锚点预训练,让机器人用极少示范就能稳定抓取物体。

GAP: Geometric Anchor Pre-training for Data-Efficient Visuomotor Learning of Manipulation Tasks

论文配图:GAP: Geometric Anchor Pre-training for Data-Efficient Visuomotor Learning of Manipulation Tasks
图 1 · 摘自论文原文
  • 用仿真任务预训练空间池化模块,使其生成稳定几何关键点。
  • 15次示范下成功率提升16%,50次示范时达63%。
  • 无需修改主视觉模型,可复用于多种操作任务。

从稀少专家示范中学习视觉-运动策略仍是机器人操作的核心挑战。主要难点在于将高维RGB表示提炼为控制相关的几何信息,同时避免过拟合。尽管冻结预训练视觉基础模型(VFMs)能提升数据效率,但多数任务适应依赖小型空间池化模块,易陷入无关捷径且微调时丧失几何一致性。更广泛来看,现有预训练视觉表示在轻微场景扰动下表现不佳,凸显对鲁棒性归纳偏置的需求。本文提出几何锚点预训练(GAP),一种无需动作的轻量级预热阶段,用于在下游模仿学习前正则化空间适配器。GAP在无成本的仿真代理任务上预训练池化层,利用对象掩码引导适配器生成位于物体上、覆盖其空间范围且时间上稳定清晰的关键点。该方法生成稳定的几何锚点,为少样本策略学习提供可靠坐标接口,同时保持视觉模型冻结。在RoboMimic和ManiSkill上评估,极端数据稀缺(15–50次示范)与域偏移条件下,仅用简单适配器配合GAP,即持续优于更强的注意力池化结构和端到端微调:在RoboMimic Can任务上15次示范达62%成功(+16%超AFA),长程高精度Tool Hang任务50次示范达63%,ManiSkill StackCube任务30次示范达61%(+11%超全微调)。代理阶段轻量且与下游任务完全解耦,可跨环境和技能复用。

原文摘要 · Abstract (English)

Learning visuomotor policies from scarce expert demonstrations remains a core challenge in robotic manipulation. A primary hurdle lies in distilling high-dimensional RGB representations into control-relevant geometry without overfitting. While using frozen pre-trained Vision Foundation Models (VFMs) improves data efficiency, it also shifts most task adaptation onto a small spatial pooling module, which can latch onto task-irrelevant shortcuts and lose geometric grounding when finetuned with few data samples. More broadly, pre-trained visual representations used for policy learning have been observed to struggle under even minor scene perturbations, highlighting the need for robustness-oriented inductive biases. We propose Geometric Anchor Pre-training (GAP), a simple, action-free warm-up stage that regularizes the spatial adapter before downstream imitation learning. GAP pre-trains the pooling layer on a lightweight simulated proxy task where object masks are available at no cost, encouraging the adapter to produce keypoints that lie on the object, cover its spatial extent, and remain sharp and repeatable over time. This yields stable geometric anchors that provide a reliable coordinate interface for few-shot policy learning, while keeping the VFM frozen. We evaluate GAP on RoboMimic and ManiSkill under severe data scarcity (15-50 demonstrations) and domain shift. A simple adapter regularized with GAP consistently outperforms stronger attention-based poolers and end-to-end fine-tuning, achieving 62% success on RoboMimic Can with 15 demonstrations (+16% over AFA), 63% on the long-horizon high-precision Tool Hang task with 50 demonstrations, and 61% on ManiSkill StackCube with 30 demonstrations (+11% over full fine-tuning). The proxy stage is lightweight and fully decoupled from downstream tasks, making it practical to reuse across environments and manipulation skills.

机器人操作少样本学习几何先验预训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。