提出可解释自主系统的抽象架构,增强高危环境中人机信任
An Abstract Architecture for Explainable Autonomy in Hazardous Environments

- 设计支持行为解释的系统架构,从底层集成可解释性
- 在核电领域示范应用,满足工人与监管者对决策可信的需求
- 适合需高可靠性与透明度的工业自动化场景
自主机器人正被应用于高危环境以降低人员风险。未来人类仍需操作和指导这些系统,如同使用复杂工具,但其决策能力更强大。因此,工程重点应是确保使用者信任系统。研究表明,可解释性与系统可信度密切相关。如同安全与安全性,可解释性应内置于系统设计中,而非事后添加。本文提出一种支持自主系统解释自身行为的抽象架构,为可解释自主系统提供设计模板。通过在民用核工业中的实际应用示例,展示该架构如何满足工作人员与监管机构对决策能力的信任需求。
原文摘要 · Abstract (English)
Autonomous robotic systems are being proposed for use in hazardous environments, often to reduce the risks to human workers. In the immediate future, it is likely that human workers will continue to use and direct these autonomous robots, much like other computerised tools but with more sophisticated decision-making. Therefore, one important area on which to focus engineering effort is ensuring that these users trust the system. Recent literature suggests that explainability is closely related to how trustworthy a system is. Like safety and security properties, explainability should be designed into a system, instead of being added afterwards. This paper presents an abstract architecture that supports an autonomous system explaining its behaviour (explainable autonomy), providing a design template for implementing explainable autonomous systems. We present a worked example of how our architecture could be applied in the civil nuclear industry, where both workers and regulators need to trust the system's decision-making capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。