让机器人在室内更懂人,通过基建感知+人体姿态估计实现舒适导航
SAP-CoPE: Social-Aware Planning using Cooperative Pose Estimation with Infrastructure Sensor Nodes
- 用多摄像头和激光点云融合估计人体3D姿态,考虑相机误差与关节一致性
- 将心理学中的个人空间概念融入模型预测控制,生成符合人类心理舒适区的路径
- 适合需要与人近距离互动的室内机器人场景,如导览、配送
自动驾驶系统需在人群密集的室内环境平稳运行,仅依赖车载传感器面临感知受限与遮挡问题,同时需兼顾人类心理舒适区的社会化运动规划。为此,我们提出SAP-CoPE,一种融合协作基础设施的室内导航系统,结合新颖的3D人体姿态估计方法与社会感知的模型预测控制(MPC)运动规划器。感知模块中,构建优化问题以处理相机投影矩阵的不确定性,并强制人体关节约束一致;该方法适用于单/多相机配置,可融合稀疏LiDAR点云数据。运动规划方面,将基于心理学的个人空间场信息融入MPC框架,提升在人群密集环境中的社会舒适度。大量真实世界评估表明,该方法能有效生成社会感知轨迹。
原文摘要 · Abstract (English)
Autonomous driving systems must operate smoothly in human-populated indoor environments, where challenges arise including limited perception and occlusions when relying only on onboard sensors, as well as the need for socially compliant motion planning that accounts for human psychological comfort zones. These factors complicate accurate recognition of human intentions and the generation of comfortable, socially aware trajectories. To address these challenges, we propose SAP-CoPE, an indoor navigation system that integrates cooperative infrastructure with a novel 3D human pose estimation method and a socially-aware model predictive control (MPC)-based motion planner. In the perception module, an optimization problem is formulated to account for uncertainty propagation in the camera projection matrix while enforcing human joint coherence. The proposed method is adaptable to both single- and multi-camera configurations and can incorporate sparse LiDAR point-cloud data. For motion planning, we integrate a psychology inspired personal-space field using the information from estimated human poses into an MPC framework to enhance socially comfort in human-populated environments. Extensive real-world evaluations demonstrate the effectiveness of the proposed approach in generating socially aware trajectories for autonomous systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。