让自动驾驶更可信:用新方法实时检测并纠正AI预测偏差
Enhancing System Self-Awareness and Trust of AI: A Case Study in Trajectory Prediction and Planning
- 用分布外检测+滚动时域估计,动态监控AI行为异常
- 在三个仿真场景中成功识别并干预了AI预测失误
- 适合关注自动驾驶安全与可解释性的研究者和工程师
在自动驾驶的轨迹规划中,数据驱动的统计人工智能方法被广泛用于预测其他道路使用者的突发行为。尽管这些方法在特定数据集上表现优异,但通常依赖独立同分布假设,因此在真实世界中遭遇分布偏移时容易失效。此外,由于其黑箱特性,缺乏可解释性,进一步影响审批流程和社会信任。为此,本文提出并研究了TrustMHE概念。TrustMHE是一种与底层AI系统无关的互补方法,结合了基于AI的分布外检测与控制驱动的滚动时域估计(MHE),不仅能实现异常检测与监控,还能主动干预。所提方法在三个仿真场景中得到验证并证明有效。
原文摘要 · Abstract (English)
In the trajectory planning of automated driving, data-driven statistical artificial intelligence (AI) methods are increasingly established for predicting the emergent behavior of other road users. While these methods achieve exceptional performance in defined datasets, they usually rely on the independent and identically distributed (i.i.d.) assumption and thus tend to be vulnerable to distribution shifts that occur in the real world. In addition, these methods lack explainability due to their black box nature, which poses further challenges in terms of the approval process and social trustworthiness. Therefore, in order to use the capabilities of data-driven statistical AI methods in a reliable and trustworthy manner, the concept of TrustMHE is introduced and investigated in this paper. TrustMHE represents a complementary approach, independent of the underlying AI systems, that combines AI-driven out-of-distribution detection with control-driven moving horizon estimation (MHE) to enable not only detection and monitoring, but also intervention. The effectiveness of the proposed TrustMHE is evaluated and proven in three simulation scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。