arXiv:2411.14663eess.IVcs.CV2024-11被引 2

用改进的VAE模型提升内窥镜图像亮度,改善诊断准确性。

BrightVAE: Luminosity Enhancement in Underexposed Endoscopic Images

  • 基于分层VQ-VAE设计,融合多尺度感受野与注意力机制。
  • 在Endo4IE数据集上PSNR提升3.2dB,SSIM和LPIPS均优于当前最佳。
  • 适合医疗影像增强,尤其对低光照内窥镜图像优化有实用价值。

内窥镜图像的亮度增强至关重要。由于光照不均和阴影区域,低光照内窥镜图像常呈现对比度降低、亮度不均的问题,严重影响诊断准确性和治疗规划。本文提出BrightVAE,一种基于分层向量量化变分自编码器(hierarchical VQ-VAE)的专用架构,专为增强低光内窥镜图像亮度而设计。该模型通过多视角特征提取,结合不同感受野、跳跃连接与特征注意力机制,有效应对内窥镜成像中光照剧烈变化和细节模糊等挑战。实验采用端到端评估,使用三个标准指标——SSIM、PSNR、LPIPS,在包含真实内窥镜图像的Endo4IE数据集上验证性能。结果表明,该方法在亮度增强方面显著超越现有先进方法,具有重要临床应用潜力。

原文摘要 · Abstract (English)

The enhancement of image luminosity is especially critical in endoscopic images. Underexposed endoscopic images often suffer from reduced contrast and uneven brightness, significantly impacting diagnostic accuracy and treatment planning. Internal body imaging is challenging due to uneven lighting and shadowy regions. Enhancing such images is essential since precise image interpretation is crucial for patient outcomes. In this paper, we introduce BrightVAE, an architecture based on the hierarchical Vector Quantized Variational Autoencoder (hierarchical VQ-VAE) tailored explicitly for enhancing luminosity in low-light endoscopic images. Our architecture is meticulously designed to tackle the unique challenges inherent in endoscopic imaging, such as significant variations in illumination and obscured details due to poor lighting conditions. The proposed model emphasizes advanced feature extraction from three distinct viewpoints-incorporating various receptive fields, skip connections, and feature attentions to robustly enhance image quality and support more accurate medical diagnoses. Through rigorous experimental analysis, we demonstrate the effectiveness of these techniques in enhancing low-light endoscopic images. To evaluate the performance of our architecture, we employ three widely recognized metrics-SSIM, PSNR, and LPIPS-specifically on Endo4IE dataset, which consists of endoscopic images. We evaluated our method using the Endo4IE dataset, which consists exclusively of endoscopic images, and showed significant advancements over the state-of-the-art methods for enhancing luminosity in endoscopic imaging.

图像增强医学影像VAE内窥镜

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。