用几何生成模型让视觉位姿估计可证明正确,适合自动驾驶安全系统。
Correct-by-Construction Vision-based Pose Estimation using Geometric Generative Models
- 基于目标物体几何结构构建生成模型,融合物理规律与学习方法。
- 在真实和合成图像上验证,能保证位姿估计误差在理论范围内。
- 支持复杂环境检测与估计,且全程具备可证明的安全性保障。
本文研究自主系统中的视觉位姿估计问题。尽管深度神经网络在视觉任务中表现优异,但其输出缺乏可证明的正确性保证,难以用于安全关键场景。为此,提出一种可证伪神经网络(NN)框架,将物理驱动建模与学习估计相结合。该框架利用环境中常见平面物体(如交通标志、跑道标记)的已知几何信息,引入几何生成模型(GGM),其参数源自目标物体在相机下的成像过程。训练后,该模型可为基于神经网络的位姿估计算法提供可证明的误差保证。首先在无杂波环境中验证,随后结合神经网络可达性分析,设计出可认证的目标检测器以应对复杂环境。最终将认证检测器与位姿估计算法集成,形成多阶段感知流水线,在保持认证性质的同时推广至杂波环境。通过合成数据与真实图像(包括事件相机拍摄的交通标志)进行评估,结果表明所训练编码器能有效估计位姿,并符合框架提供的理论误差边界。
原文摘要 · Abstract (English)
We consider the problem of vision-based pose estimation for autonomous systems. While deep neural networks have been successfully used for vision-based tasks, they inherently lack provable guarantees on the correctness of their output, which is crucial for safety-critical applications. We present a framework for designing certifiable neural networks (NNs) for perception-based pose estimation that integrates physics-driven modeling with learning-based estimation. The proposed framework begins by leveraging the known geometry of planar objects commonly found in the environment, such as traffic signs and runway markings, referred to as target objects. At its core, it introduces a geometric generative model (GGM), a neural-network-like model whose parameters are derived from the image formation process of a target object observed by a camera. Once designed, the GGM can be used to train NN-based pose estimators with certified guarantees in terms of their estimation errors. We first demonstrate this framework in uncluttered environments, where the target object is the only object present in the camera's field of view. We extend this using ideas from NN reachability analysis to design certified object NN that can detect the presence of the target object in cluttered environments. Subsequently, the framework consolidates the certified object detector with the certified pose estimator to design a multi-stage perception pipeline that generalizes the proposed approach to cluttered environments, while maintaining its certified guarantees. We evaluate the proposed framework using both synthetic and real images of various planar objects commonly encountered by autonomous vehicles. Using images captured by an event-based camera, we show that the trained encoder can effectively estimate the pose of a traffic sign in accordance with the certified bound provided by the framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。