针对微型内窥镜传感器噪声问题,提出实时混合去噪系统。
A Real-time Endoscopic Image Denoising System
- 构建模拟传感器噪声模型,识别三类主要噪声来源。
- 融合传统算法与学习方法,实现去噪不损细节且实时运行。
- 在FPGA上实现实时处理,平均PSNR提升11.89,适合临床应用。
微型化内窥镜显著提升了操作灵活性、便携性与诊断能力,同时大幅降低侵入性。近期采用超小型模拟图像传感器(<1mm×1mm)的单次使用型内窥镜,推动医疗诊断革新:减少结构冗余与资本支出,消除因消毒不彻底导致的感染风险,并减轻患者痛苦。然而,感光面积受限导致每个像素捕获光子数减少,需提高感光度以保证亮度。在高对比度成像场景下,小尺寸传感器动态范围有限,难以同时保留亮部与暗部细节,还需局部数字增益补偿。此外,简化电路设计与模拟信号传输引入额外噪声源。上述因素共同造成图像显著噪声。本文建立医用内窥镜模拟传感器的综合噪声模型,涵盖固定图案噪声、周期性条纹噪声及泊松-高斯混合噪声三类。基于此分析,提出一种混合去噪系统,结合传统图像处理与先进学习方法,对传感器原始帧进行处理。实验表明,该方法有效降低噪声,保持细节与色彩不失真,且在FPGA平台实现实时性能,测试集上平均PSNR由21.16提升至33.05。
原文摘要 · Abstract (English)
Endoscopes featuring a miniaturized design have significantly enhanced operational flexibility, portability, and diagnostic capability while substantially reducing the invasiveness of medical procedures. Recently, single-use endoscopes equipped with an ultra-compact analogue image sensor measuring less than 1mm x 1mm bring revolutionary advancements to medical diagnosis. They reduce the structural redundancy and large capital expenditures associated with reusable devices, eliminate the risk of patient infections caused by inadequate disinfection, and alleviate patient suffering. However, the limited photosensitive area results in reduced photon capture per pixel, requiring higher photon sensitivity settings to maintain adequate brightness. In high-contrast medical imaging scenarios, the small-sized sensor exhibits a constrained dynamic range, making it difficult to simultaneously capture details in both highlights and shadows, and additional localized digital gain is required to compensate. Moreover, the simplified circuit design and analog signal transmission introduce additional noise sources. These factors collectively contribute to significant noise issues in processed endoscopic images. In this work, we developed a comprehensive noise model for analog image sensors in medical endoscopes, addressing three primary noise types: fixed-pattern noise, periodic banding noise, and mixed Poisson-Gaussian noise. Building on this analysis, we propose a hybrid denoising system that synergistically combines traditional image processing algorithms with advanced learning-based techniques for captured raw frames from sensors. Experiments demonstrate that our approach effectively reduces image noise without fine detail loss or color distortion, while achieving real-time performance on FPGA platforms and an average PSNR improvement from 21.16 to 33.05 on our test dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。