首个4K高清手术视频数据集,助力机器人微创手术智能成像研究
SurgiSR4K: A High-Resolution Endoscopic Video Dataset for Robotic-Assisted Minimally Invasive Procedures
- 构建了真实手术场景的原生4K视频数据集
- 涵盖反光、遮挡、出血等10类典型手术挑战
- 适合超分辨率、器械检测等高阶视觉任务研究
高分辨率成像对提升微创手术(MIS)中视觉清晰度和精准辅助至关重要。尽管4K内窥镜系统日益普及,但针对机器人辅助微创手术的公开原生4K数据集仍十分匮乏。本文提出SurgiSR4K,首个公开可用的原生4K手术影像与视频数据集,真实还原机器人辅助手术场景。该数据集包含镜面反光、器械遮挡、出血、软组织形变等多种复杂视觉情况,专为模拟腹腔镜与机器人手术中的常见挑战而设计。SurgiSR4K可支持超分辨率、烟雾去除、手术器械检测、3D组织重建、单目深度估计、实例分割、新视角合成及视觉语言模型(VLM)开发等计算机视觉任务。该数据集为高分辨率手术成像研究提供了坚实基础,推动智能化成像技术在图像引导机器人手术中的性能、安全性和可用性提升。
原文摘要 · Abstract (English)
High-resolution imaging is crucial for enhancing visual clarity and enabling precise computer-assisted guidance in minimally invasive surgery (MIS). Despite the increasing adoption of 4K endoscopic systems, there remains a significant gap in publicly available native 4K datasets tailored specifically for robotic-assisted MIS. We introduce SurgiSR4K, the first publicly accessible surgical imaging and video dataset captured at a native 4K resolution, representing realistic conditions of robotic-assisted procedures. SurgiSR4K comprises diverse visual scenarios including specular reflections, tool occlusions, bleeding, and soft tissue deformations, meticulously designed to reflect common challenges faced during laparoscopic and robotic surgeries. This dataset opens up possibilities for a broad range of computer vision tasks that might benefit from high resolution data, such as super resolution (SR), smoke removal, surgical instrument detection, 3D tissue reconstruction, monocular depth estimation, instance segmentation, novel view synthesis, and vision-language model (VLM) development. SurgiSR4K provides a robust foundation for advancing research in high-resolution surgical imaging and fosters the development of intelligent imaging technologies aimed at enhancing performance, safety, and usability in image-guided robotic surgeries.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。