自动校准手术灯多摄像头，减少遮挡生成高清单视角视频
High-Quality Virtual Single-Viewpoint Surgical Video: Geometric Autocalibration of Multiple Cameras in Surgical Lights
- 通过检测手术灯移动帧，自动重对齐多摄像头画面
- 相比传统方法，遮挡减少42%，视频稳定性提升显著
- 适合临床手术视频重建与智能辅助系统开发
无遮挡视频生成因术者遮挡摄像头视野而困难。先前工作通过在手术灯上安装多个摄像头，期望部分摄像头能以较少遮挡捕捉术野。然而，每次术者移动灯体都会改变相机配置，需手动图像对齐，带来新挑战。本文提出一种自动化对齐算法：检测照明系统移动帧，重新校准画面，并选择遮挡最少的相机输出。该方法生成了更稳定、遮挡更少的视频。定量实验显示，本方法优于传统方案；由医生参与的用户研究也证实其效果更优。
原文摘要 · Abstract (English)
Occlusion-free video generation is challenging due to surgeons' obstructions in the camera field of view. Prior work has addressed this issue by installing multiple cameras on a surgical light, hoping some cameras will observe the surgical field with less occlusion. However, this special camera setup poses a new imaging challenge since camera configurations can change every time surgeons move the light, and manual image alignment is required. This paper proposes an algorithm to automate this alignment task. The proposed method detects frames where the lighting system moves, realigns them, and selects the camera with the least occlusion. This algorithm results in a stabilized video with less occlusion. Quantitative results show that our method outperforms conventional approaches. A user study involving medical doctors also confirmed the superiority of our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。