arXiv:2604.07430cs.CV2026-04被引 15

专为真实世界智能体打造的视觉语言基础模型,兼顾感知与推理能力。

HY-Embodied-0.5: Embodied Foundation Models for Real-World Agents

论文配图:HY-Embodied-0.5: Embodied Foundation Models for Real-World Agents
图 1 · 摘自论文原文
  • 采用混合变压器架构实现模态特异性计算,提升空间时间感知能力。
  • 2B参数模型在16个基准上超越同类模型,32B版性能媲美Gemini 3.0 Pro。
  • 支持边缘部署与机器人控制,适合具身智能研究与应用开发。

我们提出HY-Embodied-0.5,一套专为真实世界具身智能体设计的基础模型。为弥合通用视觉语言模型(VLMs)与具身智能需求之间的差距,本模型强化了空间与时间视觉感知,以及预测、交互和规划等高级具身推理能力。该系列包含两个版本:一个2B激活参数的高效模型,适用于边缘部署;一个32B激活参数的强大模型,用于复杂推理。为支持具身任务所需的精细视觉感知,采用混合变压器(MoT)架构实现模态特异性计算,并引入潜在标记增强感知表征。通过迭代自进化后训练范式提升推理能力,并使用在线策略蒸馏将大模型能力迁移至小模型,最大化小型模型性能潜力。在22个基准上的广泛评估显示,其MoT-2B模型在16个基准上优于同类先进模型,32B版本性能接近前沿模型Gemini 3.0 Pro。下游机器人控制实验中,基于鲁棒的VLM基础训练出有效的视觉-语言-动作(VLA)模型,在真实物理环境中取得优异表现。代码与模型已开源。

原文摘要 · Abstract (English)

We introduce HY-Embodied-0.5, a family of foundation models specifically designed for real-world embodied agents. To bridge the gap between general Vision-Language Models (VLMs) and the demands of embodied agents, our models are developed to enhance the core capabilities required by embodied intelligence: spatial and temporal visual perception, alongside advanced embodied reasoning for prediction, interaction, and planning. The HY-Embodied-0.5 suite comprises two primary variants: an efficient model with 2B activated parameters designed for edge deployment, and a powerful model with 32B activated parameters targeted for complex reasoning. To support the fine-grained visual perception essential for embodied tasks, we adopt a Mixture-of-Transformers (MoT) architecture to enable modality-specific computing. By incorporating latent tokens, this design effectively enhances the perceptual representation of the models. To improve reasoning capabilities, we introduce an iterative, self-evolving post-training paradigm. Furthermore, we employ on-policy distillation to transfer the advanced capabilities of the large model to the smaller variant, thereby maximizing the performance potential of the compact model. Extensive evaluations across 22 benchmarks, spanning visual perception, spatial reasoning, and embodied understanding, demonstrate the effectiveness of our approach. Our MoT-2B model outperforms similarly sized state-of-the-art models on 16 benchmarks, while the 32B variant achieves performance comparable to frontier models such as Gemini 3.0 Pro. In downstream robot control experiments, we leverage our robust VLM foundation to train an effective Vision-Language-Action (VLA) model, achieving compelling results in real-world physical evaluations. Code and models are open-sourced at https://github.com/Tencent-Hunyuan/HY-Embodied.

具身智能视觉语言模型机器人控制模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。