构建手术团队互动的多模态数据集,支持行为分析与因果推断。
Towards Actionable Surgical Team Dynamics: from Teamwork to Counterfactual Annotations
- 基于真实手术室录音,整合语音、转录与多层级标注。
- 引入反事实标注,分析交互失败如何影响团队表现结果。
- 适合医疗协作研究与智能辅助系统开发人员使用。
在高风险环境如手术室中建模团队互动对理解协调、沟通及个体行为如何影响团队表现与安全至关重要。现有数据集常因模态、标注方式和格式碎片化,难以支持对真实协作过程的综合分析。本文通过扩展真实手术室录制数据,构建了一个可直接用于分析的多模态数据集。在已有语料基础上,补充了说话人分离、转录文本及多层次标注,涵盖团队表现、交互过程与个体特征。团队表现采用标准化手术团队评估协议衡量,交互质量与个体属性则通过结构化评分体系覆盖协作、群体动态与非技术技能。为支持对协调失效与绩效变异的研究,新增反事实标注,描述在观察到的交互失败下可能的替代结果,从而分析特定行为模式与团队绩效轨迹之间的关联。此外,提供结构化的时序与关系表示,以支持团队协作过程的计算建模及人工智能辅助协作系统设计。该数据集旨在揭示个体行为、交互模式与团队层面过程如何共同影响手术场景中的团队成果,为高风险领域协作行为分析提供统一资源。
原文摘要 · Abstract (English)
Modeling team interactions in high-stakes environments such as operating rooms is critical for understanding how coordination, communication, and individual behaviors shape team performance and safety outcomes. Existing datasets in this domain are often fragmented across modalities, annotation schemes, and formats, limiting their ability to support integrated analyses of real-world collaborative processes. We address this limitation by introducing an extended multimodal dataset for surgical team interaction analysis, built from real operating room recordings. Starting from an existing corpus, we construct an analysis-ready version of the data by providing speaker diarization, transcripts, and multi-level annotations capturing team performance, interaction processes, and individual characteristics. Team performance is assessed using a standardized surgical teamwork evaluation protocol, while interaction quality and individual attributes are annotated through structured rating schemes covering collaboration, group dynamics, and non-technical skills. To further support the study of coordination breakdowns and performance variability, we introduce counterfactual annotations that describe plausible alternative team outcomes in the presence of observed interaction failures, enabling analysis of how specific behavioral patterns may relate to different trajectories of team performance. In addition, we provide structured temporal and relational representations designed to support computational modeling of teamwork processes and the design of AI-assisted collaborative systems. The dataset is designed to support the study of how individual actions, interaction patterns, and team-level processes jointly contribute to team outcomes in surgical settings, providing a unified resource for analyzing collaborative behavior in high-stakes domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。