分离骨架与扩散训练信号,实现显微体积图像高效高保真轴向超分辨。
SkelEM: Training-Signal Decoupling of Skeleton and Diffusion for Self-supervised Axial Super-Resolution in Volume Microscopy

- 用冻结的拓扑网络和扩散修正器分步优化,解耦结构与细节重建。
- 仅需5步即可恢复高保真细节,显著降低推理延迟。
- 适用于跨仪器、跨模态的零样本泛化,尤其适合生物医学图像分析。
体式显微技术(包括电子显微和光显微)因物理轴向切片导致严重的各向异性分辨率问题。现有自监督轴向超分辨(ASR)方法面临三重困境:回归纹理过度平滑、纯扩散模型产生结构幻觉、推理延迟过高。本文提出骨架重构显微(SkelEM),一种在训练信号层面解耦的自监督框架:冻结的拓扑网络与扩散修正器分别优化,分离低频拓扑构建与高频细节增强。基于此确定性骨架,我们设计统一的循环一致性机制,在输入稀疏切片上同时提取真实域残差先验并双向对齐扩散修正器,消除跨平面伪影且无合成偏差。通过截断反向扩散过程并引入此物理先验,SkelEM仅需≤5步即可实现高保真细节恢复。为严格评估跨仪器泛化能力,我们进一步提出BRAVE-ASR——一个在Plasma-FIB仪器上获取的共配准各向异性和各向同性体积数据集。在公开基准上,SkelEM在自监督方法中实现了最佳保真度-感知权衡,下游膜分割性能达领先水平,并展现出对不同模态的鲁棒零样本泛化能力。
原文摘要 · Abstract (English)
Volume microscopy, including electron and light microscopy, suffers from severe anisotropic resolution due to physical axial sectioning. Existing self-supervised axial super-resolution (ASR) methods face a trilemma bounded by overly smoothed regression textures, structural hallucinations of pure diffusion models, and prohibitive inference latency. In this paper, we propose Skeleton-refinE Microscopy (SkelEM), a self-supervised framework that decouples ASR at the training-signal level: a frozen topological network and a diffusion refiner are optimized by disjoint objectives, separating low-frequency topology formulation from high-frequency detail enhancement. Building on this deterministic skeleton, we exploit a unified cycle-consistent mechanism on input sparse slices to simultaneously extract a real-domain residual prior and bidirectionally align the diffusion refiner, washing away cross-plane artifacts without synthetic bias. By truncating the reverse diffusion process with this physical prior, SkelEM achieves high-fidelity detail restoration in merely $\le 5$ steps. To rigorously assess cross-instrument generalization, we further introduce BRAVE-ASR, a new benchmark of co-aligned anisotropic and isotropic volumes acquired on a Plasma-FIB instrument. Across public benchmarks, SkelEM achieves the most favorable balance across the fidelity-perception trade-off among self-supervised methods, with state-of-the-art downstream membrane segmentation performance and robust zero-shot generalization across distinct modalities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。