arXiv:2607.19548cs.LG2026-07

用自回归模型预测果蝇社交行为,从个体视角建模动作与感知。

Agent-Centric Animal Pose Forecasting

论文配图:Agent-Centric Animal Pose Forecasting
图 1 · 摘自论文原文
  • 基于个体视角的感官-动作映射,模拟动物自身参考系下的行为决策。
  • 模型精准捕捉果蝇求偶群体的社会行为分布,量化拟合效果。
  • 开源通用工具库支持多种表示形式转换,适配新场景快速迁移。

理解动物行为的算法本质——动物关注什么、如何构建内部模型与计划,以及如何映射到行动——仍是神经科学与行为学的核心挑战。数据驱动的生成模型为此提供了路径。我们提出一种框架,利用追踪姿态数据训练个体中心的自回归动物行为模型,适用于单个动物及群体中相互感知与响应的个体。模型输入为个体视角的感官观测,输出为个体视角的动作,符合生物体从自身参考系观察和行动的限制。社交行为由各主体独立感知并回应彼此而自然涌现。该个体中心范式需管理大量并行的数据表示,以及如离散化等机器学习特有变换。我们发布一个通用库,专注于在这些表示间转换的可组合操作序列。结果显示,训练后的模型能准确捕捉果蝇求偶群体的社会行为分布,且库中包含定量评估拟合度的工具。我们还展示了该库如何支持不同输入/输出表示的系统性比较,并可轻松扩展至新领域。

原文摘要 · Abstract (English)

Understanding animal behavior at an algorithmic level -- what animals attend to, how they form internal models and plans, and how this maps to action -- remains a central challenge in neuroscience and ethology. Data-driven generative models offer a path toward this understanding. We introduce a framework for training agent-centric autoregressive models of animal behavior from tracked pose, applicable to single animals and to groups in which each agent senses and responds to its conspecifics. Our models input egocentric sensory observations and output egocentric movements, mirroring the biological constraint that animals observe and act on the world from their own reference frame. Social behavior emerges from agents independently sensing and responding to one another. This agent-centric formulation requires managing many parallel representations of the same data, along with ML-specific transformations like discretization. We release a general-purpose library focused on the composable sequences of operations that translate between these representations. We show that trained models capture the distribution of social behavior in groups of courting Drosophila, and our library includes quantitative tools for measuring fit. We demonstrate how the library supports systematic comparison across input and output representations and that it adapts straightforwardly to a new domain.

动物行为自回归模型多智能体果蝇

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。