arXiv:2512.17655cs.CVq-bio.NC2025-12

Bitbox让行为科学家无需编程就能用AI分析视频中的表情动作。

Bitbox: Behavioral Imaging Toolbox for Computational Analysis of Behavior from Videos

  • 提供标准化接口,整合人脸、头部、身体追踪模块
  • 可直接输出心理学研究可用的高阶行为指标
  • 开源可扩展,适合临床与行为科研人员使用

由于人工智能的重大进展,从视频中进行计算化的人类行为测量已成为可能。这些技术现可实现面部表情、头部运动、身体动作等行为模态的精细量化,广泛应用于心理学、精神病学、神经科学和心理健康研究。然而,主流应用仍较缓慢。现有方法多面向工程背景,需复杂软件栈,且难以提供对假设驱动研究直接有用的行为度量。为此,我们推出Bitbox——一个开源工具包,旨在消除使用门槛,使先进计算分析直接服务于行为科学家与临床研究者。Bitbox遵循可复现性、模块化与可解释性原则,提供统一接口,融合多种面部、头部与身体处理器,核心模块已在临床样本中验证,并支持低门槛新增测量。它既为行为研究者提供无需工程技能的可靠行为指标,也为计算机科学家提供向关键领域传播方法的实际路径。Bitbox自始即为社区共建项目,将随方法开发者与领域科学家的贡献持续演进。

原文摘要 · Abstract (English)

Computational measurement of human behavior from video has recently become feasible due to major advances in AI. These advances now enable granular and precise quantification of facial expression, head movement, body action, and other behavioral modalities and are increasingly used in psychology, psychiatry, neuroscience, and mental health research. However, mainstream adoption remains slow. Most existing methods and software are developed for engineering audiences, require specialized software stacks, and fail to provide behavioral measurements at a level directly useful for hypothesis-driven research. As a result, there is a large barrier to entry for researchers who wish to use modern, AI-based tools in their work. We introduce Bitbox, an open-source toolkit designed to remove this barrier and make advanced computational analysis directly usable by behavioral scientists and clinical researchers. Bitbox is guided by principles of reproducibility, modularity, and interpretability. It provides a standardized interface for extracting high-level behavioral measurements from video, leveraging multiple face, head, and body processors. The core modules have been tested and validated on clinical samples and are designed so that new measures can be added with minimal effort. Bitbox is intended to serve both sides of the translational gap. It gives behavioral researchers access to robust, high-level behavioral metrics without requiring engineering expertise, and it provides computer scientists a practical mechanism for disseminating methods to domains where their impact is most needed. We expect that Bitbox will accelerate integration of computational behavioral measurement into behavioral, clinical, and mental health research. Bitbox has been designed from the beginning as a community-driven effort that will evolve through contributions from both method developers and domain scientists.

行为分析视频处理开源工具临床研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。