arXiv:2609.07299cs.AI2026-09

让世界模型适应异步传感器数据,提升真实环境下的预测能力

World Models Under Asynchronous Sensor Observations

论文配图:World Models Under Asynchronous Sensor Observations
图 1 · 摘自论文原文
  • 用时间到刷新和陈旧度作为输入特征,处理不同速率的传感器数据
  • 在连续控制、闭环规划等场景中验证,效果优于插值或降采样
  • 适合物理系统建模、机器人感知与决策等需要异步观测的场景

学习型世界模型通常假设观测同步到达,源于模拟器每步返回完整状态向量的设定。而真实传感以异构速率运行,导致多数观测通道在任一时刻都已过时。插值过时通道会引入未实际观测的数据,而降采样至最慢传感器则会丢弃有效信息。一种自然替代方案是使用零阶保持最近读数,并通过两个特征——陈旧度和时间到刷新——将采样调度提供给模型。我们利用Transformer世界模型,在三个因果耦合强度递增的场景中测试该方法:连续控制中的开环滚动预测、闭环保留模型预测规划(每个模型充当规划器的动力学),以及线性锁存执行器系统,其中刷新事件对系统施加零阶保持命令。结果表明,时间到刷新的有效性取决于采样调度的因果角色——当刷新事件影响系统而非仅报告状态时,其作用显著。这些发现明确了在异步物理观测下,采样调度何时能为预测型世界模型提供有用信息。

原文摘要 · Abstract (English)

Learned world models typically assume that observations arrive synchronously, an abstraction inherited from simulators that return a complete state vector at each environment step. Physical sensing instead operates at heterogeneous rates, leaving most observation channels stale at any given instant. Interpolating stale channels introduces measurements that were never observed, while downsampling to the slowest sensor discards valid measurements. A natural alternative is to zero-order-hold the most recent reading and provide the known sampling schedule to the model through two features, staleness and time-to-refresh. We test this prediction using transformer world models across three regimes of increasing causal coupling: open-loop rollouts in continuous-control locomotion, closed-loop model-predictive planning in which each learned model serves as the planner dynamics, and a linear latched-actuator system in which refresh events apply a zero-order-held command to the plant. Our findings show that the effectiveness of time-to-refresh depends on the causal role of the sampling schedule, specifically when refresh events affect the system rather than merely report its state. These results establish when sampling schedules provide useful information for predictive world models operating under asynchronous physical observations.

世界模型异步观测机器人时空建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。