arXiv:2507.02771cs.AIcs.CV2025-07被引 3

将运动作为智能核心建模目标,推动跨领域行为理解。

Grounding Intelligence in Movement

  • 以运动为首要建模对象,利用其结构化与具身性优势。
  • 运动数据可压缩为低维表示(如姿态),提升可解释性与计算效率。
  • 适合关注具身智能、跨物种行为分析与生成模型的研究者。

近年来机器学习在语言、视觉等高维数据建模上取得显著进展,但仍难以捕捉生物系统最基础的特征——运动。在神经科学、医学、机器人学和动物行为学中,运动对解读行为、预测意图和实现交互至关重要。然而,运动常被当作次要因素,而非独立的结构性模态。这反映了运动数据采集与建模的割裂,受限于特定任务与领域假设。实际上,运动受共同物理约束、保守形态结构与目的性动力学支配,跨越物种与场景。我们主张将运动作为人工智能的核心建模目标,因其内在结构化且根植于具身性与物理规律。这种结构使运动能以紧凑的低维表示(如姿态)呈现,比原始高维感官输入更易建模与解释。发展能从多样化运动数据中学习并泛化的模型,不仅将增强生成建模与控制能力,还将建立理解生物与人工系统行为的共享基础。运动不仅是结果,更是智能体与世界互动的窗口。

原文摘要 · Abstract (English)

Recent advances in machine learning have dramatically improved our ability to model language, vision, and other high-dimensional data, yet they continue to struggle with one of the most fundamental aspects of biological systems: movement. Across neuroscience, medicine, robotics, and ethology, movement is essential for interpreting behavior, predicting intent, and enabling interaction. Despite its core significance in our intelligence, movement is often treated as an afterthought rather than as a rich and structured modality in its own right. This reflects a deeper fragmentation in how movement data is collected and modeled, often constrained by task-specific goals and domain-specific assumptions. But movement is not domain-bound. It reflects shared physical constraints, conserved morphological structures, and purposeful dynamics that cut across species and settings. We argue that movement should be treated as a primary modeling target for AI. It is inherently structured and grounded in embodiment and physics. This structure, often allowing for compact, lower-dimensional representations (e.g., pose), makes it more interpretable and computationally tractable to model than raw, high-dimensional sensory inputs. Developing models that can learn from and generalize across diverse movement data will not only advance core capabilities in generative modeling and control, but also create a shared foundation for understanding behavior across biological and artificial systems. Movement is not just an outcome, it is a window into how intelligent systems engage with the world.

具身智能运动建模行为理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。