自动对齐多摄像头手术视频,消除遮挡并固定视角。
Disturbance-Free Surgical Video Generation from Multi-Camera Shadowless Lamps for Open Surgery
- 通过检测灯光系统移动自动重对齐多视角视频。
- 选择遮挡最少的相机输出固定视角视频,提升观看体验。
- 医生评估显示新方法更易确认手术区域,观感更舒适。
开放手术视频在教育和研究中至关重要,但因术者频繁遮挡摄像机视野,难以获取无遮挡画面。以往方法将多个摄像头安装于无影灯上,环绕手术区以提高捕捉清晰视角的概率。然而,每次调整灯光位置后需手动对齐图像,耗时费力。本文提出全自动对齐方案:识别灯光移动帧,自动重对齐,并选取遮挡最小的相机生成固定视角视频。用户研究显示,相比传统方法,本方法生成的视频在确认手术区域的便捷性和观看舒适度方面均表现更优。此外,本方法在视频质量上优于现有技术。我们还实现了多种视图合成选项,并通过用户研究评估了外科医生的偏好。
原文摘要 · Abstract (English)
Video recordings of open surgeries are greatly required for education and research purposes. However, capturing unobstructed videos is challenging since surgeons frequently block the camera field of view. To avoid occlusion, the positions and angles of the camera must be frequently adjusted, which is highly labor-intensive. Prior work has addressed this issue by installing multiple cameras on a shadowless lamp and arranging them to fully surround the surgical area. This setup increases the chances of some cameras capturing an unobstructed view. However, manual image alignment is needed in post-processing since camera configurations change every time surgeons move the lamp for optimal lighting. This paper aims to fully automate this alignment task. The proposed method identifies frames in which the lighting system moves, realigns them, and selects the camera with the least occlusion to generate a video that consistently presents the surgical field from a fixed perspective. A user study involving surgeons demonstrated that videos generated by our method were superior to those produced by conventional methods in terms of the ease of confirming the surgical area and the comfort during video viewing. Additionally, our approach showed improvements in video quality over existing techniques. Furthermore, we implemented several synthesis options for the proposed view-synthesis method and conducted a user study to assess surgeons' preferences for each option.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。