用语义与符号推理增强强化学习,让自动驾驶刹车更安全智能。
Reinforcement Learning Enhancement Using Vector Semantic Representation and Symbolic Reasoning for Human-Centered Autonomous Emergency Braking
- 融合语义、空间和形状信息的神经符号特征表示
- 在CARLA中提升安全指标,适应不同交通密度和遮挡
- 适合研究自动驾驶决策与人机对齐的开发者
现有基于摄像头的深度强化学习方法存在两大问题:极少将高层场景上下文融入特征表示,且依赖僵化的固定奖励函数。本文提出新流程,生成包含语义、空间与形状信息的神经符号特征表示,并突出动态物体的空间增强特征,重点关注安全关键道路使用者。同时提出软一阶逻辑(SFOL)奖励函数,通过符号推理模块平衡人类价值观。从分割图中提取语义与空间谓词,应用语言规则获得奖励权重。在CARLA仿真环境中定量实验表明,相比基线表示与奖励设计,该方法在不同交通密度和遮挡水平下均提升了策略鲁棒性与安全性能指标。结果表明,整合整体表征与软推理可支持更上下文感知、价值对齐的自动驾驶决策。
原文摘要 · Abstract (English)
The problem with existing camera-based Deep Reinforcement Learning approaches is twofold: they rarely integrate high-level scene context into the feature representation, and they rely on rigid, fixed reward functions. To address these challenges, this paper proposes a novel pipeline that produces a neuro-symbolic feature representation that encompasses semantic, spatial, and shape information, as well as spatially boosted features of dynamic entities in the scene, with an emphasis on safety-critical road users. It also proposes a Soft First-Order Logic (SFOL) reward function that balances human values via a symbolic reasoning module. Here, semantic and spatial predicates are extracted from segmentation maps and applied to linguistic rules to obtain reward weights. Quantitative experiments in the CARLA simulation environment show that the proposed neuro-symbolic representation and SFOL reward function improved policy robustness and safety-related performance metrics compared to baseline representations and reward formulations across varying traffic densities and occlusion levels. The findings demonstrate that integrating holistic representations and soft reasoning into Reinforcement Learning can support more context-aware and value-aligned decision-making for autonomous driving.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。