让扩散模型学会追踪隐藏动态,提升决策适应性。
Ada-Diffuser: Latent-Aware Adaptive Diffusion for Decision-Making

- 在生成式决策中显式建模随时间演化的隐藏状态。
- 从少量观测中准确推断潜在动态,支持精准规划与控制。
- 适用于动态、奖励或动作变化的场景,适合机器人控制研究者。
近期工作将决策问题视为序列建模任务,采用生成模型如扩散模型。然而,这些方法常忽视具有演化特性的潜在因素,而这些因素对环境变迁、奖励结构和高层智能体行为至关重要。显式建模这些隐含过程对精确的动力学建模和有效决策不可或缺。本文提出统一框架,从最小但充分的观测中显式融入潜在动态推理。理论上证明,在温和条件下,可从小时间片段的观测中识别潜在过程。基于此,我们提出Ada-Diffuser,一种因果扩散模型,能同时学习观测交互的时序结构与底层潜在动态,并用于规划与控制。模块化设计支持规划与策略学习任务,可适应动力学、奖励和潜在动作的变化。在模拟控制与机器人基准测试中,验证了其在潜在推理准确性和自适应策略学习方面的有效性。
原文摘要 · Abstract (English)
Recent work has framed decision-making as a sequence modeling problem using generative models such as diffusion models. Although promising, these approaches often overlook latent factors that exhibit evolving dynamics, elements that are fundamental to environment transitions, reward structures, and high-level agent behavior. Explicitly modeling these hidden processes is essential for both precise dynamics modeling and effective decision-making. In this paper, we propose a unified framework that explicitly incorporates latent dynamic inference into generative decision-making from minimal yet sufficient observations. We theoretically show that under mild conditions, the latent process can be identified from small temporal blocks of observations. Building on this insight, we introduce Ada-Diffuser, a causal diffusion model that learns the temporal structure of observed interactions and the underlying latent dynamics simultaneously, and furthermore, leverages them for planning and control. With a modular design, Ada-Diffuser supports both planning and policy learning tasks, enabling adaptation to latent variations in dynamics, rewards, and latent actions. Experiments on simulated control and robotic benchmarks demonstrate its effectiveness in accurate latent inference and adaptive policy learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。