arXiv:2511.20245cs.CVphysics.optics2025-11被引 1

用信息约束提升光纤成像重建质量,少数据也能高保真。

HistoSpeckle-Net: Mutual Information-Guided Deep Learning for high-fidelity reconstruction of complex OrganAMNIST images via perturbed Multimode Fibers

  • 通过互信息损失和直方图统计增强模型对复杂图像的建模能力
  • 在有限样本下实现比U-Net、Pix2Pix更高的结构保真度(SSIM提升)
  • 适合医疗内窥镜等真实场景中低数据、光纤弯曲扰动下的成像

现有基于多模光纤(MMF)成像的深度学习方法多针对简单数据集,难以应用于复杂真实场景。这些模型通常依赖大量数据,而面对多样复杂的图像时挑战更大。本文提出HistoSpeckle-Net,一种用于从MMF散斑中重建结构丰富的医学图像的深度学习架构。为构建临床相关数据集,我们设计光学系统,通过空间光调制器(SLM)将激光耦合进MMF,采集对应输入OrganAMNIST图像的输出散斑图案。不同于以往方法忽略散斑与重建图像的统计特性,我们引入分布感知学习策略,采用基于直方图的互信息损失以提升模型鲁棒性并减少对大数据集的依赖。模型包含直方图计算单元,用于估计平滑的边缘与联合直方图以计算互信息损失,并引入三尺度特征精炼模块,实现多尺度结构相似性指数(SSIM)损失。两项损失共同提升重建图像的结构保真度与统计一致性。在复杂OrganAMNIST数据集上的实验表明,HistoSpeckle-Net在结构保真度上优于U-Net、Pix2Pix等基线模型,且在训练样本有限及光纤弯曲条件下仍表现优异。该方法有效实现了复杂解剖特征的高保真重建,显著降低数据需求与对光纤稳定性的依赖,推动了MMF成像向真实临床环境部署迈进。

原文摘要 · Abstract (English)

Existing deep learning methods in multimode fiber (MMF) imaging often focus on simpler datasets, limiting their applicability to complex, real-world imaging tasks. These models are typically data-intensive, a challenge that becomes more pronounced when dealing with diverse and complex images. In this work, we propose HistoSpeckle-Net, a deep learning architecture designed to reconstruct structurally rich medical images from MMF speckles. To build a clinically relevant dataset, we develop an optical setup that couples laser light through a spatial light modulator (SLM) into an MMF, capturing output speckle patterns corresponding to input OrganAMNIST images. Unlike previous MMF imaging approaches, which have not considered the underlying statistics of speckles and reconstructed images, we introduce a distribution-aware learning strategy. We employ a histogram-based mutual information loss to enhance model robustness and reduce reliance on large datasets. Our model includes a histogram computation unit that estimates smooth marginal and joint histograms for calculating mutual information loss. It also incorporates a unique Three-Scale Feature Refinement Module, which leads to multiscale Structural Similarity Index Measure (SSIM) loss computation. Together, these two loss functions enhance both the structural fidelity and statistical alignment of the reconstructed images. Our experiments on the complex OrganAMNIST dataset demonstrate that HistoSpeckle-Net achieves higher fidelity than baseline models such as U-Net and Pix2Pix. It gives superior performance even with limited training samples and across varying fiber bending conditions. By effectively reconstructing complex anatomical features with reduced data and under fiber perturbations, HistoSpeckle-Net brings MMF imaging closer to practical deployment in real-world clinical environments.

光纤成像医学图像互信息低数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。