arXiv:2602.20871cs.RO2026-02中稿 · CVPR

让机器人在不同任务间持续学习仿真到现实的迁移,提升效率与性能。

GeCo-SRT: Geometry-aware Continual Adaptation for Robotic Cross-Task Sim-to-Real Transfer

  • 利用几何特征构建可复用的知识基础,动态激活专家模块应对视觉差异。
  • 相比基线平均性能提升52%,新任务仅需1/6数据即可高效适应。
  • 适合需要跨任务快速部署的低成本机器人系统研发人员。

弥合仿真到现实的差距对低成本仿真数据在真实机器人系统中的应用至关重要。然而,以往方法将每次迁移视为孤立任务,导致重复昂贵的调参并浪费已有经验。为此,我们提出一种基于知识积累的持续跨任务仿真到现实迁移范式——GeCo-SRT。该方法利用局部几何特征中的领域不变与任务不变知识作为可迁移基础,加速后续迁移过程。首先引入几何感知的专家混合模块,动态激活专精于不同几何知识的专家以缓解观测差异。进一步设计几何专家引导的优先经验回放模块,优先采样未充分使用的专家,刷新专有知识以缓解遗忘,维持跨任务鲁棒性。借助迭代迁移中积累的知识,GeCo-SRT在新任务上仅需1/6数据即实现显著性能提升,平均较基线提高52%。本工作旨在启发高效、低成本的跨任务仿真到现实迁移方法。

原文摘要 · Abstract (English)

Bridging the sim-to-real gap is important for applying low-cost simulation data to real-world robotic systems. However, previous methods are severely limited by treating each transfer as an isolated endeavor, demanding repeated, costly tuning and wasting prior transfer experience. To move beyond isolated sim-to-real, we build a continual cross-task sim-to-real transfer paradigm centered on knowledge accumulation across iterative transfers, thereby enabling effective and efficient adaptation to novel tasks. Thus, we propose GeCo-SRT, a geometry-aware continual adaptation method. It utilizes domain-invariant and task-invariant knowledge from local geometric features as a transferable foundation to accelerate adaptation during subsequent sim-to-real transfers. This method starts with a geometry-aware mixture-of-experts module, which dynamically activates experts to specialize in distinct geometric knowledge to bridge observation sim-to-real gap. Further, the geometry-expert-guided prioritized experience replay module preferentially samples from underutilized experts, refreshing specialized knowledge to combat forgetting and maintain robust cross-task performance. Leveraging knowledge accumulated during iterative transfer, GeCo-SRT method not only achieves 52% average performance improvement over the baseline, but also demonstrates significant data efficiency for new task adaptation with only 1/6 data. We hope this work inspires approaches for efficient, low-cost cross-task sim-to-real transfer.

机器人仿真实现持续学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。