让机器人决策可追溯,每一步都能找到传感器证据。
Towards Trustworthy Autonomous Robots: An Explainable AI-Based Decision Framework
- 用四层架构记录决策因果链,确保每步动作可回溯
- 实测在500次模拟中达98.6%证据可追踪、99.0%完整审计
- 适合高风险场景如仓储机器人,满足欧盟AI法案透明要求
由深度学习驱动的自主机器人面临根本性可审计挑战:事故发生时,无法还原系统为何做出特定决策。本文提出TRACE(可信执行的透明推理架构),一种决策框架,确保每个自主行为均可通过文档化的因果链追溯至传感器证据。该框架将决策过程划分为四个可审计层级:语义感知(基于证据的实体识别)、信念推理(基于因果图的概率状态估计)、行动合成(带反事实记录的约束感知规划)和执行验证(合规性监控)。TRACE具有模型无关性,可集成学习型感知模块(如CNN、Transformer),同时保持决策级可审计性。我们采用三项客观指标评估:证据可追溯性(传感器到决策的关联)、决策可重构性(事后分析能力)和时间连续性(审计轨迹完整性)。在仓库机器人导航任务中的实验表明,TRACE在500次模拟决策周期中实现了98.6%的证据可追溯性、99.0%的时间连续性和98.1%的决策可重构性。事后分析方法如LIME虽能提供特征归因,但缺乏决策级重构所需的结构化产物。该框架符合欧盟《人工智能法案》对高风险系统的透明性要求,为安全关键自主系统贡献了可解释AI方案。
原文摘要 · Abstract (English)
Autonomous robots powered by deep learning face a fundamental auditability challenge: when incidents occur, investigators cannot reconstruct why the system made specific decisions. This paper presents TRACE (Transparent Reasoning Architecture for Credible Execution), a decision framework that ensures every autonomous action can be traced back to sensor evidence through documented causal chains. The framework organizes decision-making into four auditable layers: Semantic Perception for evidence-grounded entity recognition, Belief Reasoning for probabilistic state estimation with causal graphs, Action Synthesis for constraint-aware planning with counterfactual documentation, and Execution Verification for compliance monitoring. TRACE is model-agnostic yet designed to integrate learning-based perception modules (CNNs, transformers) while preserving decision-level auditability. We evaluate the framework using three objective metrics: Evidence Traceability (sensor-to-decision linkage), Decision Reconstructability (post-hoc analysis capability), and Temporal Continuity (audit trail completeness). Experimental evaluation on warehouse robot navigation demonstrates that TRACE achieves 98.6% evidence traceability, 99.0% temporal continuity, and 98.1% decision reconstructability across 500 simulated decision cycles. Post-hoc methods like LIME provide feature attributions but lack the artifact structure needed for decision-level reconstruction. The framework addresses EU AI Act requirements for high-risk system transparency and contributes to Explainable AI for safety-critical autonomous systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。