arXiv:2602.19874cs.CV2026-02被引 2

构建首个融合3D姿态与动作的猕猴视频数据集,提升行为识别准确率。

BigMaQ: A Big Macaque Motion and Animation Dataset Bridging Image and 3D Pose Representations

  • 基于高精度猕猴模板建模个体化纹理化身,实现3D姿态精准追踪
  • 在BigMaQ500上使用姿态信息使mAP显著提升,验证其有效性
  • 适合动物行为学、计算机视觉及灵长类社会互动研究者使用

动物动态与社交行为的识别对推动动物行为学、生态学、医学和神经科学具有重要意义。尽管深度学习已实现视频中行为的自动识别,但三维(3D)姿态与形态的精确重建仍未被整合。尤其对于非人灵长类,基于网格的追踪进展滞后于其他物种,导致姿态描述仅限于稀疏关键点,难以充分捕捉动作动态。为此,我们提出$ extbf{Big Ma}$ca$ extbf{Q}$ue 3D运动与动画数据集($ exttt{BigMaQ}$),包含超过750个交互猕猴场景,提供详细的3D姿态描述。通过将高质量猕猴模板网格适配至个体猴子,构建专属纹理化身,实现比现有最先进表面追踪方法更精确的姿态表示。从原始数据中提取出BigMaQ500,一个连接表面姿态向量与多只猕猴单帧图像的动作识别基准。通过结合主流图像与视频编码器特征,对比加入与未加入姿态描述的效果,证明引入姿态信息可显著提升平均精度均值(mAP)。$ exttt{BigMaQ}$首次将动态3D姿态-形状表示融入动物行为识别任务,并为非人灵长类视觉外观、姿势与社会互动研究提供丰富资源。代码与数据已公开于https://martinivis.github.io/BigMaQ/。

原文摘要 · Abstract (English)

The recognition of dynamic and social behavior in animals is fundamental for advancing ethology, ecology, medicine and neuroscience. Recent progress in deep learning has enabled automated behavior recognition from video, yet an accurate reconstruction of the three-dimensional (3D) pose and shape has not been integrated into this process. Especially for non-human primates, mesh-based tracking efforts lag behind those for other species, leaving pose descriptions restricted to sparse keypoints that are unable to fully capture the richness of action dynamics. To address this gap, we introduce the $\textbf{Big Ma}$ca$\textbf{Q}$ue 3D Motion and Animation Dataset ($\texttt{BigMaQ}$), a large-scale dataset comprising more than 750 scenes of interacting rhesus macaques with detailed 3D pose descriptions. Extending previous surface-based animal tracking methods, we construct subject-specific textured avatars by adapting a high-quality macaque template mesh to individual monkeys. This allows us to provide pose descriptions that are more accurate than previous state-of-the-art surface-based animal tracking methods. From the original dataset, we derive BigMaQ500, an action recognition benchmark that links surface-based pose vectors to single frames across multiple individual monkeys. By pairing features extracted from established image and video encoders with and without our pose descriptors, we demonstrate substantial improvements in mean average precision (mAP) when pose information is included. With these contributions, $\texttt{BigMaQ}$ establishes the first dataset that both integrates dynamic 3D pose-shape representations into the learning task of animal action recognition and provides a rich resource to advance the study of visual appearance, posture, and social interaction in non-human primates. The code and data are publicly available at https://martinivis.github.io/BigMaQ/ .

动物行为识别3D姿态估计猕猴研究视觉表征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。