AlphaChimp实现黑猩猩行为自动识别与追踪,提升社交行为分析精度。
AlphaChimp: Tracking and Behavior Recognition of Chimpanzees
- 端到端架构融合时空特征,用Transformer捕捉复杂互动
- 追踪准确率高10%,社交行为识别提升20%
- 适合动物行为学、认知科学与AI交叉研究者
理解非人类灵长类动物行为对改善动物福利、建模社会行为以及揭示人类特有与共有的行为特征至关重要。尽管计算机视觉技术取得进展,但灵长类动物行为的自动化分析仍面临挑战,主要源于其社会互动的复杂性及缺乏专用算法。现有方法在处理灵长类社会动态中的细微行为和频繁遮挡时表现不佳。本研究提出AlphaChimp,一种端到端方法,可同时从视频中检测黑猩猩位置并估计行为类别。结果表明,该方法在行为识别上显著优于现有技术,追踪准确率提升约10%,行为识别性能提高20%,尤其在社交行为识别方面表现突出。这一优势源于其创新架构,结合了时间特征融合与基于Transformer的自注意力机制,更有效地捕捉和解析黑猩猩间的复杂社会互动。本方法弥合了计算机视觉与灵长类学之间的差距,提升了技术能力并深化了对灵长类交流与社会性的理解。我们开源代码与模型,期望推动动物社会动态研究的发展。本工作为动物行为学、认知科学和人工智能提供新视角,拓展了对社会智能的理解。
原文摘要 · Abstract (English)
Understanding non-human primate behavior is crucial for improving animal welfare, modeling social behavior, and gaining insights into both distinctly human and shared behaviors. Despite recent advances in computer vision, automated analysis of primate behavior remains challenging due to the complexity of their social interactions and the lack of specialized algorithms. Existing methods often struggle with the nuanced behaviors and frequent occlusions characteristic of primate social dynamics. This study aims to develop an effective method for automated detection, tracking, and recognition of chimpanzee behaviors in video footage. Here we show that our proposed method, AlphaChimp, an end-to-end approach that simultaneously detects chimpanzee positions and estimates behavior categories from videos, significantly outperforms existing methods in behavior recognition. AlphaChimp achieves approximately 10% higher tracking accuracy and a 20% improvement in behavior recognition compared to state-of-the-art methods, particularly excelling in the recognition of social behaviors. This superior performance stems from AlphaChimp's innovative architecture, which integrates temporal feature fusion with a Transformer-based self-attention mechanism, enabling more effective capture and interpretation of complex social interactions among chimpanzees. Our approach bridges the gap between computer vision and primatology, enhancing technical capabilities and deepening our understanding of primate communication and sociality. We release our code and models and hope this will facilitate future research in animal social dynamics. This work contributes to ethology, cognitive science, and artificial intelligence, offering new perspectives on social intelligence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。