提出确定性世界模型,实现视觉控制系统的闭环可达性分析。
Deterministic World Models for Closed-loop Reachability Analysis of End-to-End Vision-based Control
- 直接从物理状态生成合成图像,避免随机隐变量带来的误差
- 在CARLA和三个Gym环境中,可达集比基线更紧凑且覆盖率达目标
- 适合安全关键系统验证,尤其对视觉闭环控制有高价值
端到端图像控制器将原始摄像头帧直接映射为控制动作,正越来越多地应用于安全关键系统。然而,由于摄像头生成的高维图像难以用封闭数学形式描述,其闭环行为的形式化验证仍是一个开放挑战。我们提出了确定性世界模型(DWM),一种无隐空间的神经解码器,可将物理状态(如位置和速度)直接映射为合成图像,从而在不引入随机隐变量过估计的情况下实现闭环可达性分析。DWM采用新型双损失训练:结合显著性图重建与控制一致性项,确保与真实控制器的行为一致。我们将DWM集成至闭环可达性分析,并利用保形预测方法,通过无分布轨迹管偏差界对可达集进行膨胀,以高概率将代理保证转移至真实系统。在CARLA刹车系统及三个Gym基准(CartPole、MountainCar、Pendulum)上的实验表明,DWM生成的可达管比cGAN和轨迹预测基线更紧致,且经保形膨胀后达到目标覆盖率。
原文摘要 · Abstract (English)
End-to-end image controllers that map raw camera frames directly to control actions are increasingly deployed in safety-critical systems. However, formally verifying their closed-loop behavior remains an open challenge because cameras produce high-dimensional images whose generation cannot easily be described in a closed mathematical form. We propose a Deterministic World Model (DWM), a latent-free neural decoder that maps physical states (e.g., position and velocity) directly to synthetic camera images, enabling closed-loop reachability analysis without the overapproximation caused by stochastic latent variables. The DWM is trained with a novel dual loss combining saliency-map reconstruction and a control-consistent term that preserves behavioral consistency with the real controller. We integrate the DWM into closed-loop reachability analysis and apply conformal prediction to inflate the reachable sets by a distribution-free trajectory-tube deviation bound, transferring the surrogate guarantee to the real system with high probability. Experiments on a CARLA braking system and three Gym benchmarks (CartPole, MountainCar, Pendulum) show that the DWM produces substantially tighter reachable tubes than a cGAN and trajectory predictor baselines while meeting the target coverage after conformal inflation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。