arXiv:2511.03819cs.CVq-bio.QM2025-11被引 1

SiLVi让研究者能高效标注视频中的动物互动行为。

SiLVi: Simple Interface for Labeling Video Interactions

  • 结合行为标注与个体定位,支持互动关系标注
  • 生成结构化数据,可用于训练视觉模型
  • 适用于动物行为分析,也可扩展至人类互动

计算机视觉方法正被广泛应用于通过相机陷阱、无人机或野外直接观测获取的大量视频数据的自动化分析。尽管近期进展主要集中在个体行为检测上,但对交互行为的检测与标注仍较少涉及——而交互是理解动物社会行为和个体行为的关键。现有开源标注工具要么仅支持行为标注而不定位个体,要么支持定位却无法捕捉交互关系。为此,我们提出SiLVi,一款开源标注软件,整合了行为标注与个体定位功能。SiLVi使研究人员能够直接在视频中标注行为与交互,生成适合训练和验证计算机视觉模型的结构化输出。通过连接行为生态学与计算机视觉,SiLVi推动了细粒度行为分析的自动化发展。尽管主要针对动物行为设计,该工具也可广泛用于需提取动态场景图的人类互动视频标注。软件及相关文档下载地址:https://silvi.eckerlab.org。

原文摘要 · Abstract (English)

Computer vision methods are increasingly used for the automated analysis of large volumes of video data collected through camera traps, drones, or direct observations of animals in the wild. While recent advances have focused primarily on detecting individual actions, much less work has addressed the detection and annotation of interactions -- a crucial aspect for understanding social and individualized animal behavior. Existing open-source annotation tools support either behavioral labeling without localization of individuals, or localization without the capacity to capture interactions. To bridge this gap, we present SiLVi, an open-source labeling software that integrates both functionalities. SiLVi enables researchers to annotate behaviors and interactions directly within video data, generating structured outputs suitable for training and validating computer vision models. By linking behavioral ecology with computer vision, SiLVi facilitates the development of automated approaches for fine-grained behavioral analyses. Although developed primarily in the context of animal behavior, SiLVi could be useful more broadly to annotate human interactions in other videos that require extracting dynamic scene graphs. The software, along with documentation and download instructions, is available at: https://silvi.eckerlab.org.

视频标注动物行为交互识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。