AI让自动驾驶系统更智能,也更难保证安全可靠。
Autonomous Systems Dependability in the era of AI: Design Challenges in Safety, Security, Reliability and Certification

- 从设计到运行全周期保障,应对AI带来的不确定性
- 传统方法难管AI非确定性,需新模型与框架
- 适合关注汽车/机器人安全认证的研究者和工程师
下一代汽车和自动驾驶平台中的嵌入式安全关键系统,正面临日益增长的系统复杂性、软硬件异构性以及智能数据驱动组件集成的挑战。确保此类系统的可靠性需要跨越多个抽象层次的综合方法,涵盖设计与运行时保障。传统的可靠性、安全性和安全管理方法难以应对由人工智能(AI)和机器学习(ML)组件引入的动态与不确定行为,尤其是在严格实时、功耗和安全约束下。尽管AI和ML具备强大的预测、自适应和自我优化能力,可提升系统可靠性,但其固有的非确定性、数据依赖性和缺乏形式化保证,给验证、确认与认证带来新挑战。本文探讨了在AI时代设计可靠自主与嵌入式系统的新方法、新架构与新框架,重点介绍在可靠性建模、安全系统设计及认证方法方面的进展,旨在弥合AI创新与可认证系统级可靠性之间的差距。
原文摘要 · Abstract (English)
The design of embedded safety-critical systems such as those used in next-generation automotive and autonomous platforms, is increasingly challenged by escalating system complexity, hardware-software heterogeneity, and the integration of intelligent, data-driven components. Ensuring dependability in such systems requires a holistic approach that spans multiple abstraction layers and encompasses both design- and run-time assurance. Traditional methods for reliability, safety, and security management often fall short in addressing the dynamic and uncertain behaviors introduced by Artificial Intelligence (AI) and Machine Learning (ML) components, especially under stringent real-time, power, and safety constraints. While AI and ML offer powerful predictive, adaptive, and self-optimizing capabilities that can enhance system dependability, their inherent non-determinism, data-dependence, and lack of formal guarantees introduce new challenges for verification, validation, and certification. This paper explores emerging methodologies, architectures, and frameworks for designing dependable autonomous and embedded systems in the era of AI. It highlight advances in reliability modeling, secure system design, and certification approaches that account for imperfect, learning-enabled components, aiming to bridge the gap between AI innovation and certifiable system-level dependability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。