arXiv:2601.08876cs.CV2026-01被引 3

用基础模型构建智能体的语义生命周期,打通感知到行动的闭环。

The Semantic Lifecycle in Embodied AI: Acquisition, Representation and Storage via Foundation Models

  • 提出语义生命周期框架,统一处理语义获取、表示与存储。
  • 强调基础模型在跨域泛化中的作用,提升智能体鲁棒性。
  • 适合研究具身智能、通用认知架构的学者参考。

具身智能中的语义信息具有多源性和多阶段特性,难以在真实环境中稳定实现感知到行动的闭环。早期研究结合人工设计与深度神经网络,在特定任务上取得显著进展。然而,随着智能体面对更复杂环境和开放性任务,对更具泛化能力和鲁棒性的语义处理需求日益迫切。近年来,基础模型凭借其跨领域泛化能力与丰富的语义先验,重塑了具身智能研究格局。本文提出语义生命周期框架,以统一刻画基础模型驱动下具身智能中语义知识的演进过程。不同于传统将语义处理视为孤立模块或离散任务的范式,该框架提供整体视角,捕捉语义知识的持续流动与维护。基于此框架,我们系统分析并比较了近年在语义获取、表示与存储三个关键阶段的进展,并总结现有挑战,展望未来研究方向。

原文摘要 · Abstract (English)

Semantic information in embodied AI is inherently multi-source and multi-stage, making it challenging to fully leverage for achieving stable perception-to-action loops in real-world environments. Early studies have combined manual engineering with deep neural networks, achieving notable progress in specific semantic-related embodied tasks. However, as embodied agents encounter increasingly complex environments and open-ended tasks, the demand for more generalizable and robust semantic processing capabilities has become imperative. Recent advances in foundation models (FMs) address this challenge through their cross-domain generalization abilities and rich semantic priors, reshaping the landscape of embodied AI research. In this survey, we propose the Semantic Lifecycle as a unified framework to characterize the evolution of semantic knowledge within embodied AI driven by foundation models. Departing from traditional paradigms that treat semantic processing as isolated modules or disjoint tasks, our framework offers a holistic perspective that captures the continuous flow and maintenance of semantic knowledge. Guided by this embodied semantic lifecycle, we further analyze and compare recent advances across three key stages: acquisition, representation, and storage. Finally, we summarize existing challenges and outline promising directions for future research.

具身智能基础模型语义生命周期

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。