arXiv:2506.23739cs.ROcs.CE2025-06被引 1

验证了虚拟行人姿态估计在车路协同测试中的可行性与局限性。

Validation of AI-Based 3D Human Pose Estimation in a Cyber-Physical Environment

  • 用真实相机与虚实结合场景对比,测试单目三维姿态估计性能。
  • 静态行走时姿态估计一致性高,动态骑行和遮挡下误差明显增加。
  • 适合自动驾驶感知系统测试人员及人机交互建模研究者参考。

确保自动驾驶系统与城市环境中弱势道路使用者(VRUs)的安全、真实交互,需要先进测试方法。本文提出一种融合车辆在环(ViL)测试台与动作实验室的软硬件协同测试环境,验证了车-人与车-自行车交互的可行性和真实性。基于先前行人定位研究,进一步通过真实世界(RW)与虚拟表示的对比分析,验证了一种基于商用单目摄像头的3D骨骼检测人工智能方法。虚拟场景在Unreal Engine 5中实时生成,人物模型投射至屏幕以刺激相机感知。该刺激技术确保视角正确,实现真实车辆感知。通过分析检测可靠性、运动轨迹差异与关节估计稳定性,评估了全身体态感知在真实与虚拟环境间的一致性。实验涵盖受控条件下步行与骑行的人类化身动态场景。结果显示,在稳定运动模式下,真实与虚拟环境下姿态估计高度一致;但在动态运动与遮挡情况下,尤其复杂骑行姿态,仍存在显著误差。研究结果有助于优化下一代基于AI的车辆感知系统的协同测试方法,并提升自动驾驶与弱势道路使用者在协同环境中的交互建模能力。

原文摘要 · Abstract (English)

Ensuring safe and realistic interactions between automated driving systems and vulnerable road users (VRUs) in urban environments requires advanced testing methodologies. This paper presents a test environment that combines a Vehiclein-the-Loop (ViL) test bench with a motion laboratory, demonstrating the feasibility of cyber-physical (CP) testing of vehicle-pedestrian and vehicle-cyclist interactions. Building upon previous work focused on pedestrian localization, we further validate a human pose estimation (HPE) approach through a comparative analysis of real-world (RW) and virtual representations of VRUs. The study examines the perception of full-body motion using a commercial monocular camera-based 3Dskeletal detection AI. The virtual scene is generated in Unreal Engine 5, where VRUs are animated in real time and projected onto a screen to stimulate the camera. The proposed stimulation technique ensures the correct perspective, enabling realistic vehicle perception. To assess the accuracy and consistency of HPE across RW and CP domains, we analyze the reliability of detections as well as variations in movement trajectories and joint estimation stability. The validation includes dynamic test scenarios where human avatars, both walking and cycling, are monitored under controlled conditions. Our results show a strong alignment in HPE between RW and CP test conditions for stable motion patterns, while notable inaccuracies persist under dynamic movements and occlusions, particularly for complex cyclist postures. These findings contribute to refining CP testing approaches for evaluating next-generation AI-based vehicle perception and to enhancing interaction models of automated vehicles and VRUs in CP environments.

姿态估计自动驾驶虚实测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。