统一建模四种精细操作技能,实现流畅长序列抓取与操控。
UniCross: Unified Cross-Skill Dexterous Manipulation Synthesis

- 用统一状态与动作空间建模四类操作技能
- 单一策略在多种物体上表现优异且抗干扰
- 适用于不同机械手形态,适合复杂任务链
许多精细操作任务要求物体在整个交互过程中保持稳定抓握。从手-物关系运动视角看,这些操作包含四种典型技能:抓取、位移、原地旋转和原地平移。人类手部可灵活组合这些技能完成复杂任务。现有方法分别建模各技能,使用专用动作约束、目标函数甚至独立手型,破坏了长时序组合所需的兼容性与连续性。本文提出统一框架,将四类技能纳入同一公式化表达,共享状态与动作空间及通用目标结构。该框架可直接提炼出单一跨技能策略,在各类技能上均表现强劲,泛化至未见物体,对扰动保持鲁棒,并能无缝串联成长时序操作。该框架还能有效迁移至不同手型。结果表明,不同精细操作技能可视为同一任务形式的不同实例,揭示了行为间的内在一致性。
原文摘要 · Abstract (English)
Many dexterous manipulation tasks require the object to remain securely held throughout the interaction. From the perspective of hand-object relational motion, such manipulation comprises four canonical skills: grasping, relocation, in-hand rotation, and in-hand translation. Human hands flexibly compose these skills to accomplish complex tasks. Existing approaches, however, model these skills separately with skill-specific action constraints, objectives, or even dedicated hand morphologies, which breaks the compatibility and continuity required for long-horizon composition. In this work, we present a unified framework that models all four skills in a single formulation that shares the same state and action spaces and a common objective structure. This formulation enables straightforward distillation of a single cross-skill policy that performs strongly on every skill, generalizes to unseen objects, stays robust to disturbances, and chains skills seamlessly into long-horizon manipulation. The framework also transfers effectively across different hand morphologies. Overall, our results suggest that different dexterous manipulation skills can be viewed as instantiations of a shared task formulation, revealing the intrinsic consistency across different behaviors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。