arXiv:2606.28323cs.ROcs.AI2026-06被引 3

通过分角色残差机制,让单手复用抓取策略完成多任务操作。

DexCompose: Reusing Dexterous Policies for Multi-Task Manipulation with a Single Hand

论文配图:DexCompose: Reusing Dexterous Policies for Multi-Task Manipulation with a Single Hand
图 1 · 摘自论文原文
  • 按手指分配动作归属,用双残差模块分离保留与新任务
  • 在16个复合任务上达成77.4%平均成功率
  • 适合需灵活组合复杂操作的机器人抓取场景

灵巧操作策略可独立完成单项技能,但用单手组合多个任务仍具挑战。新增任务常与已有技能在重叠手指和接触模式上产生冲突,导致原有操作状态被破坏。本文提出DexCompose,一种角色感知的残差组合框架,通过显式的手指级动作所有权复用预训练灵巧策略。给定两个预训练全手策略,DexCompose首先从第一个技能的成功后状态中收集样本,并对候选手指掩码进行释放测试,以确定维持当前技能状态所需的手指。随后训练两个非对称残差模块:一个有界残差稳定器用于任务状态保持,一个上下文感知残差仅在新任务分配的动作子空间内微调冻结的下游策略。在涵盖四种物体保持技能与四种下游交互的16个复合灵巧操作任务上评估,DexCompose实现77.4%的平均复合成功率,表明结构化动作归属与双残差设计为超越传统策略串联的灵巧技能组合提供了可行方向。

原文摘要 · Abstract (English)

Dexterous manipulation policies can solve individual skills, but composing them to perform multiple tasks with a single hand remains challenging. Adding a new task on top of an existing manipulation skill often imposes conflicting demands on overlapping fingers and contact modes, causing destructive interference between preserving an existing manipulation outcome and executing a new one. We propose DexCompose, a role-aware residual composition framework that reuses pretrained dexterous policies for multi-task manipulation through explicit finger-level action ownership. Given two pretrained full-hand policies, DexCompose first collects successful post-task states from the first skill and performs release tests over candidate finger masks to identify which fingers are necessary for maintaining the established skill state. It then trains two asymmetric residual modules: a bounded residual stabilizer for task preservation, and a context-aware residual that adapts the frozen downstream policy only within the action subspace assigned to the new task. We evaluate the framework on 16 composite dexterous manipulation tasks spanning four object-retention skills and four downstream interactions. DexCompose achieves a 77.4% average composite success rate, demonstrating that structural action ownership with dual residuals offers a promising direction for composing dexterous skills beyond conventional policy chaining.

灵巧操作多任务残差学习策略复用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。