arXiv:2508.08028cs.CV2025-08

用3D点云建模医护人员,减少因服装统一带来的识别偏差。

Mitigating Biases in Surgical Operating Rooms with Geometry

  • 将医护人员表示为3D点云序列,分离形状与动作特征。
  • 在真实手术室中,几何模型比RGB模型高12%准确率。
  • 适合开发可靠的人体行为建模系统,如评估手术技能。

深度神经网络容易学习虚假相关性,依赖数据集特有的视觉瑕疵而非有意义的特征进行预测。在手术室中,统一的手术服和罩袍遮蔽了可靠的识别标志,导致模型对人员身份等任务产生偏差。通过在两个公开手术室数据集上进行基于梯度的显著性分析,我们发现CNN模型会过度关注鞋履、眼镜等偶然视觉线索。避免此类偏差对下一代智能辅助系统至关重要,这类系统需准确识别个人化工作流特征,如手术熟练度或与其他成员的协作关系。为此,我们采用3D点云序列表示人员,将身份相关的形状与运动模式从外观混淆因子中解耦。实验表明,尽管在存在明显模拟伪影的数据集中,RGB与几何方法表现相当,但在视觉多样性降低的真实临床环境中,RGB模型准确率下降12%。该性能差距证实几何表示能捕捉更本质的生物特征,为构建鲁棒的手术室人体建模方法提供了新路径。

原文摘要 · Abstract (English)

Deep neural networks are prone to learning spurious correlations, exploiting dataset-specific artifacts rather than meaningful features for prediction. In surgical operating rooms (OR), these manifest through the standardization of smocks and gowns that obscure robust identifying landmarks, introducing model bias for tasks related to modeling OR personnel. Through gradient-based saliency analysis on two public OR datasets, we reveal that CNN models succumb to such shortcuts, fixating on incidental visual cues such as footwear beneath surgical gowns, distinctive eyewear, or other role-specific identifiers. Avoiding such biases is essential for the next generation of intelligent assistance systems in the OR, which should accurately recognize personalized workflow traits, such as surgical skill level or coordination with other staff members. We address this problem by encoding personnel as 3D point cloud sequences, disentangling identity-relevant shape and motion patterns from appearance-based confounders. Our experiments demonstrate that while RGB and geometric methods achieve comparable performance on datasets with apparent simulation artifacts, RGB models suffer a 12% accuracy drop in realistic clinical settings with decreased visual diversity due to standardizations. This performance gap confirms that geometric representations capture more meaningful biometric features, providing an avenue to developing robust methods of modeling humans in the OR.

手术室建模3D点云去偏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。