用少量示范实现鲁棒机器人操作,自动纠正姿态偏差
SID: Sliding into Distribution for Robust Few-Demonstration Manipulation

- 构建物体中心运动场,引导系统滑向示范轨迹
- 仅2次示范即达90%成功率,干扰下性能下降不足10%
- 适合少样本、动态扰动场景下的真实机器人控制
在仅有少量示范的情况下,实现跨物体姿态、视角及动态扰动的机器人操作泛化仍具挑战。端到端视觉-运动策略表达能力强但数据需求高;规划与优化虽能满足显式约束,却难以捕捉人类示范中的交互策略。本文提出滑入分布(SID)框架,从标准化示范中学习物体中心运动场,通过迭代滑向示范流形并进入轻量级自参照执行策略的可靠操作区域,缓解分布外(OOD)执行问题。运动场在远离示范流形时提供大范围修正动作,接近收敛时自然衰减,使系统在大幅姿态与视角变化下仍能稳健抵达目标。在抵达区域内,基于条件流匹配训练的自参照策略完成任务特定操作,并通过保持动作-观测一致性的点云重投影增强实现运动一致性。在六个真实任务中,SID仅需两次示范即在分布外初始化下实现约90%成功率,面对干扰和外部扰动时性能下降低于10%。总体而言,SID为少样本操作提供新范式:通过在线分布恢复显式管理分布偏移。
原文摘要 · Abstract (English)
Generalizing robotic manipulation across object poses, viewpoints, and dynamic disturbances is difficult, especially with only a few demonstrations. End-to-end visuomotor policies are expressive but data-hungry, while planning and optimization satisfy explicit constraints but do not directly capture the interaction strategies demonstrated by humans. We propose Sliding into Distribution (SID), a structured framework that learns an object-centric motion field from canonicalized demonstrations to iteratively slide the system toward the demonstrated manifold and into the reliable operating region of a lightweight egocentric execution policy, mitigating out-of-distribution (OOD) execution. The motion field provides large corrective motions when far from the demonstration manifold and naturally vanishes near convergence, enabling robust reaching under substantial pose and viewpoint shifts. Within the reached regime, an egocentric policy trained with conditioned flow matching performs task-specific manipulation, supported by kinematically consistent point-cloud reprojection augmentation that preserves action-observation consistency. Across six real-world tasks, SID achieves approximately 90% success under OOD initializations with only two demonstrations, with under a 10% drop under distractors and external disturbances. Overall, SID provides a new paradigm for few-shot manipulation: explicitly managing distribution shift via online distribution recovery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。