arXiv:2603.18336cs.RO2026-03

让机器人在不确定中精准操作,通过动态建模提升真实世界适应力。

ManiDreams: An Open-Source Library for Robust Object Manipulation via Uncertainty-aware Task-specific Intuitive Physics

  • 用分布状态表示和约束优化,融合感知、参数与结构不确定性
  • 在扰动下表现稳定,比强化学习基线提升显著鲁棒性
  • 开源模块化框架,适配多种策略与物理引擎,支持真实部署

动力学模型(仿真或学习型)长期是机器人操作的核心,但多数方法仅关注降低预测误差,而忽视了更根本的挑战:现实操作本质上具有不确定性。我们提出,不确定性下的鲁棒操作本质上是整合问题:不确定性必须在规划循环中被表征、传播并约束,而非仅在训练阶段抑制。本文提出并开源了ManiDreams,一个基于直观物理模型的不确定性感知操作规划模块化框架。其通过可组合的分布状态表示、后端无关的动力学预测以及动作优化的声明式约束规范,实现三者融合。框架明确处理感知、参数和结构三类不确定性。它为任意基础策略封装样本-预测-约束循环,评估候选动作的分布结果,在不重新训练的前提下增强鲁棒性。在ManiSkill任务上的实验表明,当强化学习基线性能显著下降时,ManiDreams仍保持稳健表现。推拉、抓取、接物及真实部署的可运行示例展示了其在不同策略、优化器、物理后端和执行器间的高度灵活性。代码已公开于 https://github.com/Rice-RobotPI-Lab/ManiDreams。

原文摘要 · Abstract (English)

Dynamics models, whether simulators or learned world models, have long been central to robotic manipulation, but most focus on minimizing prediction error rather than confronting a more fundamental challenge: real-world manipulation is inherently uncertain. We argue that robust manipulation under uncertainty is fundamentally an integration problem: uncertainties must be represented, propagated, and constrained within the planning loop, not merely suppressed during training. We present and open-source ManiDreams, a modular framework for uncertainty-aware manipulation planning over intuitive physics models. It realizes this integration through composable abstractions for distributional state representation, backend-agnostic dynamics prediction, and declarative constraint specification for action optimization. The framework explicitly addresses three sources of uncertainty: perceptual, parametric, and structural. It wraps any base policy with a sample-predict-constrain loop that evaluates candidate actions against distributional outcomes, adding robustness without retraining. Experiments on ManiSkill tasks show that ManiDreams maintains robust performance under various perturbations where the RL baseline degrades significantly. Runnable examples on pushing, picking, catching, and real-world deployment demonstrate flexibility across different policies, optimizers, physics backends, and executors. The framework is publicly available at https://github.com/Rice-RobotPI-Lab/ManiDreams

机器人操作不确定性建模物理模拟开源框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。