arXiv:2604.02441cs.RO2026-04被引 1

让卡尔曼滤波学会自适应多传感器噪声,提升自动驾驶定位精度。

Adaptive Learned State Estimation based on KalmanNet

论文配图:Adaptive Learned State Estimation based on KalmanNet
图 1 · 摘自论文原文
  • 用分传感器模块学习雷达、激光雷达、摄像头的独立噪声特性。
  • 在nuScenes和View-of-Delft数据集上,误差降低12%,跟踪更稳定。
  • 适合做自动驾驶多传感器融合的工程师和研究者参考。

结合模型驱动的卡尔曼滤波与学习组件的混合状态估计算法在模拟数据上表现良好,但在真实汽车数据上的性能仍不足。本文提出自适应多模态卡尔曼网(AM-KNet),针对自动驾驶多传感器场景进行优化。AM-KNet引入传感器特异性测量模块,使网络能独立学习雷达、激光雷达和摄像头的噪声特征;通过带上下文调制的超网络,根据目标类型、运动状态和相对位姿动态调整滤波器,实现对复杂交通场景的自适应。此外,基于Joseph形式设计协方差估计分支,并通过估计误差与创新项的负对数似然损失进行监督。采用分项损失函数,编码传感器可靠性、目标类别、运动状态及测量一致性等物理先验。AM-KNet在nuScenes和View-of-Delft数据集上训练与评估,结果表明其相比基础卡尔曼网在真实汽车数据上显著提升了估计精度与跟踪稳定性,缩小了与经典贝叶斯滤波的性能差距。

原文摘要 · Abstract (English)

Hybrid state estimators that combine model-based Kalman filtering with learned components have shown promise on simulated data, yet their performance on real-world automotive data remains insufficient. In this work we present Adaptive Multi-modal KalmanNet (AM-KNet), an advancement of KalmanNet tailored to the multi-sensor autonomous driving setting. AM-KNet introduces sensor-specific measurement modules that enable the network to learn the distinct noise characteristics of radar, lidar, and camera independently. A hypernetwork with context modulation conditions the filter on target type, motion state, and relative pose, allowing adaptation to diverse traffic scenarios. We further incorporate a covariance estimation branch based on the Josephs form and supervise it through negative log-likelihood losses on both the estimation error and the innovation. A comprehensive, component-wise loss function encodes physical priors on sensor reliability, target class, motion state, and measurement flow consistency. AM-KNet is trained and evaluated on the nuScenes and View-of-Delft datasets. The results demonstrate improved estimation accuracy and tracking stability compared to the base KalmanNet, narrowing the performance gap with classical Bayesian filters on real-world automotive data.

状态估计多传感器融合自动驾驶卡尔曼滤波

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。