通过交互学习提升激光雷达下人体姿态估计的鲁棒性。
Learning Human-Object Interaction for 3D Human Pose Estimation from LiDAR Point Clouds
- 引入人-物交互感知对比学习,区分交互区域的人体与物体点。
- 设计接触感知分部引导池化,缓解肢体交互区域点数稀疏问题。
- 支持基于接触时序优化,提升单帧关键点预测精度,适合自动驾驶场景。
从激光雷达点云中理解人类是自动驾驶中保障行人安全的关键任务,但复杂的人体-物体交互和杂乱背景使其面临挑战。现有方法多忽视利用人-物交互构建鲁棒的3D人体姿态估计框架。主要挑战包括:交互区域的人体与物体点存在空间混淆,易导致关键点误判;交互频繁部位(如手、脚)在激光雷达中点数稀疏,造成类别不平衡。为此,本文提出人-物交互学习(HOIL)框架。为解决空间混淆,提出人-物交互感知对比学习(HOICL),增强交互区域人体与物体点的特征区分度;为缓解类别不平衡,设计接触感知分部引导池化(CPPool),自适应压缩过代表征点,保留交互部位的有效信息。此外,可选的基于接触的时序精修模块利用时间接触线索修正单帧关键点估计。实验表明,该框架有效利用交互信息,在交互区域显著提升姿态估计精度。代码将公开。
原文摘要 · Abstract (English)
Understanding humans from LiDAR point clouds is one of the most critical tasks in autonomous driving due to its close relationships with pedestrian safety, yet it remains challenging in the presence of diverse human-object interactions and cluttered backgrounds. Nevertheless, existing methods largely overlook the potential of leveraging human-object interactions to build robust 3D human pose estimation frameworks. There are two major challenges that motivate the incorporation of human-object interaction. First, human-object interactions introduce spatial ambiguity between human and object points, which often leads to erroneous 3D human keypoint predictions in interaction regions. Second, there exists severe class imbalance in the number of points between interacting and non-interacting body parts, with the interaction-frequent regions such as hand and foot being sparsely observed in LiDAR data. To address these challenges, we propose a Human-Object Interaction Learning (HOIL) framework for robust 3D human pose estimation from LiDAR point clouds. To mitigate the spatial ambiguity issue, we present human-object interaction-aware contrastive learning (HOICL) that effectively enhances feature discrimination between human and object points, particularly in interaction regions. To alleviate the class imbalance issue, we introduce contact-aware part-guided pooling (CPPool) that adaptively reallocates representational capacity by compressing overrepresented points while preserving informative points from interacting body parts. In addition, we present an optional contact-based temporal refinement that refines erroneous per-frame keypoint estimates using contact cues over time. As a result, our HOIL effectively leverages human-object interaction to resolve spatial ambiguity and class imbalance in interaction regions. Codes will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。