用退化特征指导实时内窥镜视频增强,提升清晰度与手术安全性。
DGGAN: Degradation Guided Generative Adversarial Network for Real-time Endoscopic Video Enhancement
- 通过对比学习提取图像退化特征,并跨帧传播以指导增强。
- 单帧增强模型在退化与恢复图像间保持循环一致性,提升鲁棒性。
- 轻量设计实现近实时处理,适合临床手术场景应用。
内窥镜手术依赖术中视频,图像质量直接影响手术安全与效果。然而,内窥镜视频常受光照不均、组织散射、遮挡和运动模糊等退化因素影响,导致解剖结构模糊,增加操作难度。尽管深度学习方法在图像增强方面展现潜力,但多数现有方法计算复杂度高,难以满足实时手术需求。为此,本文提出一种退化感知的内窥镜视频增强框架,通过跨帧传播退化表征实现高效高质量增强。首先利用对比学习从图像中提取退化特征,再引入融合机制,将退化表征调制图像特征,引导单帧增强模型;模型训练时采用退化与恢复图像间的循环一致性约束,提升泛化能力与鲁棒性。实验表明,本方法在性能与效率之间取得更优平衡,显著优于多个先进方法。结果验证了退化感知建模在实时内窥镜视频增强中的有效性,表明隐式学习并传播退化表征是推动临床应用的可行路径。
原文摘要 · Abstract (English)
Endoscopic surgery relies on intraoperative video, making image quality a decisive factor for surgical safety and efficacy. Yet, endoscopic videos are often degraded by uneven illumination, tissue scattering, occlusions, and motion blur, which obscure critical anatomical details and complicate surgical manipulation. Although deep learning-based methods have shown promise in image enhancement, most existing approaches remain too computationally demanding for real-time surgical use. To address this challenge, we propose a degradation-aware framework for endoscopic video enhancement, which enables real-time, high-quality enhancement by propagating degradation representations across frames. In our framework, degradation representations are first extracted from images using contrastive learning. We then introduce a fusion mechanism that modulates image features with these representations to guide a single-frame enhancement model, which is trained with a cycle-consistency constraint between degraded and restored images to improve robustness and generalization. Experiments demonstrate that our framework achieves a superior balance between performance and efficiency compared with several state-of-the-art methods. These results highlight the effectiveness of degradation-aware modeling for real-time endoscopic video enhancement. Nevertheless, our method suggests that implicitly learning and propagating degradation representation offer a practical pathway for clinical application.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。