让扩散模型规划更安全,只在最终轨迹上加约束。
DiRecT: Safe Diffusion-Based Planning via Receding-Horizon Denoising

- 仅在最终轨迹施加约束,避免中间过程过度限制。
- 在多个安全规划基准上显著提升安全性和任务表现。
- 无需训练,兼容各类优化器,适合实际部署场景。
扩散模型通过学习动作与轨迹的多模态分布,已成为强大的规划与控制工具。然而,在推理阶段可靠地保证安全性仍是其在高危任务中应用的关键障碍。现有方法通常对每个去噪步骤的中间样本施加可行性约束,尽管约束仅针对最终的干净轨迹。这种对噪声中间样本的强制约束会过度限制采样动态,显著降低样本质量。为此,我们提出DiRecT(基于递推时域去噪的扩散规划,仅约束终态),一种无需训练的约束采样算法,基于随机最优控制(SOC)。DiRecT仅在最终清洁样本上施加约束,避免对中间去噪动态造成不必要的限制。受模型预测控制启发,我们推导出一个可计算的递推时域近似解,解决了原本难以求解的约束型SOC问题,从而得到一种高效算法:将随机去噪与约束满足清晰分离,逐步引导样本趋向可行的最终轨迹,同时不扭曲已学习的扩散动态。此外,DiRecT具有高度灵活性,可使用现成或领域特定优化器,融入环境动力学先验,并优化额外软奖励。在多个安全规划基准上的大量实验表明,相比现有基于扩散模型的规划基线,DiRecT在部署安全性与任务性能上均有显著提升。
原文摘要 · Abstract (English)
Diffusion models have emerged as powerful tools for planning and control by learning multimodal distributions over actions and trajectories. Yet reliable inference-time safety enforcement remains a key barrier to their deployment in safety-critical tasks. Existing approaches typically project each denoising iterate onto the feasible set, even though constraints are defined only on the final clean trajectory. Enforcing feasibility on noisy intermediate samples can therefore overconstrain the sampling dynamics, substantially degrading sample quality. To address this limitation, we introduce DiRecT (Diffusion-based planning via Receding-horizon denoising with Terminal constraints), a training-free algorithm for constrained sampling from diffusion models via stochastic optimal control (SOC). DiRecT enforces constraints only on the final clean sample, avoiding unnecessary restrictions on the intermediate denoising dynamics. Inspired by model predictive control, we derive a principled receding-horizon surrogate for the otherwise intractable constrained SOC formulation, yielding an efficient algorithm that cleanly separates stochastic denoising from constraint satisfaction, progressively steering samples toward feasible final trajectories without distorting the learned diffusion dynamics. Furthermore, DiRecT is highly flexible: it can leverage off-the-shelf or domain-specific optimizers, incorporate priors over environment dynamics, and optimize additional soft rewards. Extensive experiments on safe planning benchmarks demonstrate that DiRecT substantially improves deployment safety and task performance over existing diffusion-based planning baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。