用单一扩散模型实现机器人任务的组合泛化,大幅降低训练成本。
Factored Diffusion Policies:Compositionally Generalized Robot Control with a Single Score Network

- 通过因子独热掩码训练共享扩散网络,推理时得分可加分解。
- 在未见过的任务组合中表现接近最优,90%关卡通过率匹配理想模型。
- 适用于需要零样本迁移的复杂机器人控制场景,如无人机竞速。
机器人任务通常由多个因子(如抓取目标、避障、目标颜色等)构成,为每种因子组合收集专家示范会带来组合爆炸。本文提出因子分解扩散策略:仅使用一个共享的扩散网络,通过因子级空标记丢弃进行训练,推理时得分可加分解。在给定动作-观测对下因子近似条件独立的假设下,该方法将联合得分逼近误差控制在有界范围内,使训练任务预算从因子基数乘积降至和。轨迹管证书将该得分误差通过反向时间采样微分方程与收缩跟踪控制器传递,形成闭环状态-轨迹管,其半径可分解为微分方程敏感性常数与各因子得分误差预算。与需分别训练多个网络的组合扩散方法不同,本方法仅使用一个共享网络。无人机竞速实验验证了泛化边界与证书有效性:在基于状态的多门竞速中,该策略通过90%的未见关卡——与理想模型一致,而基线方法仅达3%;在基于视觉的单门穿越中,零样本迁移至未见场地,成功率提升11.7个百分点,崩溃率降低2.4倍。
原文摘要 · Abstract (English)
Robotic tasks are typically specified by a tuple of factors, such as the object to be grasped, the obstacles to be avoided, the color of the target, and so on. Collecting expert demonstrations for every combination of factor values grows combinatorially. We present factored diffusion policies: a single shared diffusion network trained with per-factor null-token dropout, whose score decomposes additively across factors at inference. Under approximate conditional independence between factors given the action-observation pair, this composition approximates the true joint score with a bounded uniform error, reducing the training-task budget from a product of factor cardinalities to a sum. A trajectory-tube certificate chains this score-level bound through the reverse-time sampling ODE and a contracting tracking controller into a closed-loop state-trajectory tube whose radius factors into an ODE-sensitivity constant and a per-factor score-error budget. Unlike compositional-diffusion methods for control that combine separately trained networks, we use one shared network. Drone racing experiments confirm both the generalization bound and the certificate. On state-based multi-gate racing, the factored policy passes 90% of held-out gates -- matching an oracle -- while a K-network composition baseline collapses to 3%; on vision-based single-gate traversal, it transfers zero-shot to an unseen venue with +11.7pp success-rate gain and 2.4X crash-rate reduction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。