用坐标条件卷积实现大视场高分辨率成像,解决微型显微镜的模糊问题。
Coordinate-conditioned Deconvolution for Scalable Spatially Varying High-Throughput Imaging
- 通过坐标条件卷积动态调整局部重建核,实现可扩展的图像恢复。
- 在6.5毫米视场内达到最优图像质量,模型规模比基线小54倍。
- 仅需仿真数据训练,即可泛化到活体蠕虫和脑组织等复杂样本。
紧凑光学系统下的宽场荧光显微镜常因视场依赖性像差、渐晕和传感器截断导致空间变化模糊,而有限传感器采样带来视场与分辨率的固有权衡。计算微型介观成像(CM2)通过将多个子视图复用至单个传感器缓解采样限制,但引入视图串扰和高度病态的逆问题,且受空间变化点扩散函数(PSFs)影响。现有基于学习的空间变化(SV)重建方法通常依赖全局固定输入大小的SV算子,导致参数量和训练成本随图像尺寸急剧增长。本文提出SV-CoDe(空间变化坐标条件反卷积),一种可扩展的深度学习框架,在6.5毫米视场内实现均匀高分辨率重建。不同于传统方法,SV-CoDe采用坐标条件卷积,使重建核局部自适应;支持基于块的训练,参数量与视场大小解耦。在模拟与实验测量中均取得最佳图像质量,模型规模比基线小54倍,训练数据需求减少10倍。纯基于物理仿真训练的网络对微球幻影、弱散射脑片及自由运动的秀丽隐杆线虫均表现出强泛化能力。该方法为紧凑光学系统中的空间变化模糊提供了可扩展、物理感知的解决方案,适用于多种生物医学成像场景。
原文摘要 · Abstract (English)
Wide-field fluorescence microscopy with compact optics often suffers from spatially varying blur due to field-dependent aberrations, vignetting, and sensor truncation, while finite sensor sampling imposes an inherent trade-off between field of view (FOV) and resolution. Computational Miniaturized Mesoscope (CM2) alleviate the sampling limit by multiplexing multiple sub-views onto a single sensor, but introduce view crosstalk and a highly ill-conditioned inverse problem compounded by spatially variant point spread functions (PSFs). Prior learning-based spatially varying (SV) reconstruction methods typically rely on global SV operators with fixed input sizes, resulting in memory and training costs that scale poorly with image dimensions. We propose SV-CoDe (Spatially Varying Coordinate-conditioned Deconvolution), a scalable deep learning framework that achieves uniform, high-resolution reconstruction across a 6.5 mm FOV. Unlike conventional methods, SV-CoDe employs coordinate-conditioned convolutions to locally adapt reconstruction kernels; this enables patch-based training that decouples parameter count from FOV size. SV-CoDe achieves the best image quality in both simulated and experimental measurements while requiring 10x less model size and 10x less training data than prior baselines. Trained purely on physics-based simulations, the network robustly generalizes to bead phantoms, weakly scattering brain slices, and freely moving C. elegans. SV-CoDe offers a scalable, physics-aware solution for correcting SV blur in compact optical systems and is readily extendable to a broad range of biomedical imaging applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。