arXiv:2503.21232cs.AI2025-03被引 3

用知识图谱让自动驾驶车识别障碍物材质,提升避障决策能力。

Knowledge Graphs as World Models for Semantic Material-Aware Obstacle Handling in Autonomous Vehicles

  • 构建基于语义的知识图谱,融合传感器数据推断障碍物材质属性
  • 使车辆对硬物变道、对软物通过,碰撞避免率提升13.3%
  • 适合研究自动驾驶、具身智能与多模态决策的开发者

自动驾驶车辆难以推断障碍物的材料特性,限制了其决策能力。本文提出将传感器数据与基于知识图谱(KG)的世界模型结合,使车辆不仅能感知障碍物,还能推断其可塑性、密度和弹性等物理属性。在CARLA仿真环境中对比测试表明,引入KG的系统能更准确处理冲突传感器信号,导致紧急制动的场景增加13.3%;在车道变换任务中,对大型高影响障碍物的成功率提高6.6%。例如,系统可识别交通锥等硬物并主动变道,对塑料袋等柔性物体则选择碾压通过。该方法不仅提升了自动驾驶的响应能力,也为具身智能系统在机器人、医疗及环境模拟等领域的应用提供了新范式。

原文摘要 · Abstract (English)

The inability of autonomous vehicles (AVs) to infer the material properties of obstacles limits their decision-making capacity. While AVs rely on sensor systems such as cameras, LiDAR, and radar to detect obstacles, this study suggests combining sensors with a knowledge graph (KG)-based world model to improve AVs' comprehension of physical material qualities. Beyond sensor data, AVs can infer qualities such as malleability, density, and elasticity using a semantic KG that depicts the relationships between obstacles and their attributes. Using the CARLA autonomous driving simulator, we evaluated AV performance with and without KG integration. The findings demonstrate that the KG-based method improves obstacle management, which allows AVs to use material qualities to make better decisions about when to change lanes or apply emergency braking. For example, the KG-integrated AV changed lanes for hard impediments like traffic cones and successfully avoided collisions with flexible items such as plastic bags by passing over them. Compared to the control system, the KG framework demonstrated improved responsiveness to obstacles by resolving conflicting sensor data, causing emergency stops for 13.3% more cases. In addition, our method exhibits a 6.6% higher success rate in lane-changing maneuvers in experimental scenarios, particularly for larger, high-impact obstacles. While we focus particularly on autonomous driving, our work demonstrates the potential of KG-based world models to improve decision-making in embodied AI systems and scale to other domains, including robotics, healthcare, and environmental simulation.

自动驾驶知识图谱障碍物识别具身智能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。