无需标注和标定,实现手术室多视角视频自动匿名化。
Self-Supervised Uncalibrated Multi-View Video Anonymization in the Operating Room
- 用时序与多视角信息自动找回漏检,自监督迭代优化检测器。
- 在模拟与真实手术数据上分别达到99%和97%的检测召回率。
- 适合医疗视频研究者,尤其关注隐私保护与自动化处理的场景。
隐私保护是手术室(OR)视频研究应用的前提。有效匿名化依赖于对每个人的全面定位;哪怕一次漏检也需大量人工修正。现有方法面临两大可扩展性瓶颈:(1) 新临床站点需手动标注以保证精度;(2) 多摄像头系统虽能缓解单视角歧义,但相机重置后通常需重新标定。为此,我们提出一种自监督多视角视频匿名化框架,包含全身人体检测与全身姿态估计,无需标注或相机标定。核心策略是通过时间与多视角上下文“检索”低分误漏检,并进行自监督域适应。首先在各视角使用预训练全身检测器,以低阈值获取候选检测;再通过追踪与自监督非标定多视角关联,找回与高分检测一致的低分漏检;这些恢复的检测作为伪标签,用于迭代微调检测器。最后对每个检测人执行全身姿态估计,并利用自身高分预测微调姿态模型。在4D-OR模拟手术数据集与真实手术数据集上的实验表明,该方法分别实现99%与97%的召回率。此外,基于伪标签训练的实时全身检测器性能接近人工标注模型,凸显方法实用性。代码将开源于https://github.com/CAMMA-public/OR_anonymization。
原文摘要 · Abstract (English)
Privacy preservation is a prerequisite for using video data in Operating Room (OR) research. Effective anonymization relies on the exhaustive localization of every individual; even a single missed detection necessitates extensive manual correction. However, existing approaches face two critical scalability bottlenecks: (1) they usually require manual annotations of each new clinical site for high accuracy; (2) while multi-camera setups have been widely adopted to address single-view ambiguity, camera calibration is typically required whenever cameras are repositioned. To address these problems, we propose a self-supervised multi-view video anonymization framework consisting of whole-body person detection and whole-body pose estimation, without annotation or camera calibration. Our core strategy is to enhance the single-view detector by "retrieving" false negatives using temporal and multi-view context, and conducting self-supervised domain adaptation. We first run an off-the-shelf whole-body person detector in each view with a low-score threshold to gather candidate detections. Then, we retrieve the low-score false negatives that exhibit consistency with the high-score detections via tracking and self-supervised uncalibrated multi-view association. These recovered detections serve as pseudo labels to iteratively fine-tune the whole-body detector. Finally, we apply whole-body pose estimation on each detected person, and fine-tune the pose model using its own high-score predictions. Experiments on the 4D-OR dataset of simulated surgeries and our dataset of real surgeries show the effectiveness of our approach achieving 99% and 97% recall, respectively. Moreover, we train a real-time whole-body detector using our pseudo labels, achieving comparable performance and highlighting our method's practical applicability. Code will be available at https://github.com/CAMMA-public/OR_anonymization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。