用新损失函数和可学习维纳滤波提升腹腔镜烟雾去除效果
Laparoscopic Image Desmoking Using the U-Net with New Loss Function and Integrated Differentiable Wiener Filter
- 结合像素、结构与感知损失的新型损失函数
- 在公开数据集上显著提升图像清晰度与真实感
- 适合实时手术视觉增强,代码已开源
腹腔镜手术中,手术器械产生的烟雾会降低视觉清晰度,给外科医生和基于视觉的计算机辅助技术带来挑战。为此,提出一种融合新损失函数与可学习微分维纳滤波的U-Net方法(ULW)。新损失函数整合了结构相似性指数损失、感知损失与均方误差损失,有效提升重建图像的质量与真实感。可学习维纳滤波能有效建模烟雾引起的退化过程。在公开的配对腹腔镜烟雾/无烟雾图像数据集上评估,实验结果表明该方法在视觉清晰度和指标评价上均表现优异。该方法为实时腹腔镜图像增强提供了有前景的解决方案。代码已发布于 https://github.com/chengyuyang-njit/ImageDesmoke。
原文摘要 · Abstract (English)
Laparoscopic surgeries often suffer from reduced visual clarity due to the presence of surgical smoke originated by surgical instruments, which poses significant challenges for both surgeons and vision based computer-assisted technologies. In order to remove the surgical smoke, a novel U-Net deep learning with new loss function and integrated differentiable Wiener filter (ULW) method is presented. Specifically, the new loss function integrates the pixel, structural, and perceptual properties. Thus, the new loss function, which combines the structural similarity index measure loss, the perceptual loss, as well as the mean squared error loss, is able to enhance the quality and realism of the reconstructed images. Furthermore, the learnable Wiener filter is capable of effectively modelling the degradation process caused by the surgical smoke. The effectiveness of the proposed ULW method is evaluated using the publicly available paired laparoscopic smoke and smoke-free image dataset, which provides reliable benchmarking and quantitative comparisons. Experimental results show that the proposed ULW method excels in both visual clarity and metric-based evaluation. As a result, the proposed ULW method offers a promising solution for real-time enhancement of laparoscopic imagery. The code is available at https://github.com/chengyuyang-njit/ImageDesmoke.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。