arXiv:2507.20217cs.ROcs.AI2025-07被引 8

为类人机器人打造通用多模态占位感知系统,提升环境理解能力。

Humanoid Occupancy: Enabling A Generalized Multimodal Occupancy Perception System on Humanoid Robots

  • 融合多传感器数据生成带语义的网格化占位输出
  • 解决类人机器人运动干扰与遮挡问题,优化传感器布局
  • 首次构建类人机器人全景占位数据集,助力后续研究

类人机器人技术快速发展,制造商推出了针对特定场景的多样化异构视觉感知模块。在各类感知范式中,基于占位的表征被广泛认为特别适合类人机器人,因其能提供任务规划与导航所需的丰富语义和三维几何信息。本文提出 Humanoid Occupancy,一个集成软硬件、数据采集设备与专用标注流程的通用多模态占位感知系统。该框架采用先进的多模态融合技术,生成编码占位状态与语义标签的网格化输出,实现对环境的全面理解。针对类人机器人特有的运动学干扰与遮挡问题,我们提出有效的传感器布局策略,并开发首个专用于类人机器人的全景占位数据集,为该领域未来研究提供重要基准与资源。网络架构融合多模态特征与时间信息,确保感知鲁棒性。整体上,Humanoid Occupancy 实现了类人机器人高效环境感知,为统一视觉模块标准化奠定技术基础,推动其在复杂真实场景中的广泛应用。

原文摘要 · Abstract (English)

Humanoid robot technology is advancing rapidly, with manufacturers introducing diverse heterogeneous visual perception modules tailored to specific scenarios. Among various perception paradigms, occupancy-based representation has become widely recognized as particularly suitable for humanoid robots, as it provides both rich semantic and 3D geometric information essential for comprehensive environmental understanding. In this work, we present Humanoid Occupancy, a generalized multimodal occupancy perception system that integrates hardware and software components, data acquisition devices, and a dedicated annotation pipeline. Our framework employs advanced multi-modal fusion techniques to generate grid-based occupancy outputs encoding both occupancy status and semantic labels, thereby enabling holistic environmental understanding for downstream tasks such as task planning and navigation. To address the unique challenges of humanoid robots, we overcome issues such as kinematic interference and occlusion, and establish an effective sensor layout strategy. Furthermore, we have developed the first panoramic occupancy dataset specifically for humanoid robots, offering a valuable benchmark and resource for future research and development in this domain. The network architecture incorporates multi-modal feature fusion and temporal information integration to ensure robust perception. Overall, Humanoid Occupancy delivers effective environmental perception for humanoid robots and establishes a technical foundation for standardizing universal visual modules, paving the way for the widespread deployment of humanoid robots in complex real-world scenarios.

类人机器人占位感知多模态融合环境理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。