arXiv:2602.22346cs.RO2026-02

用简单几何运动特征检测人与人互动,让服务机器人更安全地导航。

A Pairwise Human-Human Interaction Detection and Recognition Framework for Mobile Service Robots

  • 先用轻量几何运动特征找可能互动的人对
  • 再用关系网络分类互动类型,准确率达82.1%
  • 适合资源受限的移动机器人,通用性强

自主移动服务机器人在有人环境中运行时,需理解人与人之间的互动以实现安全、社交意识的导航。此类系统中的交互理解并非精细识别问题,而是受限于感知质量和计算资源的感知问题。现有方法多聚焦整体群体活动识别,常依赖复杂且计算昂贵的模型,不适用于移动机器人平台。本文认为,成对人机互动是机器人中心社交理解的最小且充分的感知单元。研究提出识别互动人对并分类粗粒度互动行为的任务,以支持下游群体推理与机器人决策。采用两阶段框架:首先利用轻量级几何与运动线索识别候选互动对,再通过关系网络分类互动类型。在JRDB数据集上,该方法性能与基于外观的方法相当,但计算成本和模型规模显著降低。在集体活动数据集(CAD)及割草机采集数据集上的零样本评估进一步验证了框架的泛化能力。结果表明,简单几何与运动线索可为移动服务机器人提供高效实用的互动感知基础。代码已开源。

原文摘要 · Abstract (English)

Autonomous mobile service robots, such as lawnmowers or cleaning robots, operating in human-populated environments need to reason about human-human interactions to support safe and socially aware navigation. For such systems, interaction understanding is not primarily a fine-grained recognition problem, but a perception problem under limited sensing quality and computational resources. Many existing approaches focus on holistic group activity recognition, often relying on complex and computationally expensive models that are not well suited for mobile robotic platforms. In this work, we argue that pairwise human interactions constitute a minimal yet sufficient perceptual unit for robot-centric social understanding. We study the problem of identifying interacting person pairs and classifying coarse-grained interaction behaviors sufficient for downstream group-level reasoning and robot decision-making. To this end, we adopt a two-stage framework in which candidate interacting pairs are first identified using lightweight geometric and motion cues, and interaction types are subsequently classified using a relation network. We evaluate the proposed approach on the JRDB dataset, where it achieves competitive performance with reduced computational cost and model size compared to appearance-based methods. Additional experiments on the Collective Activity Dataset (CAD) and zero-shot evaluation on a lawnmower-collected dataset further demonstrate the generalizability of the proposed framework. These results suggest that simple geometric and motion cues provide a practical and efficient basis for interaction-aware perception in mobile service robots. Code is released.

人机互动服务机器人轻量化动作识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。