arXiv:2505.20746eess.IVcs.CV2025-05

用无配对数据实现生物图像风格迁移,保留关键结构信息

Unpaired Image-to-Image Translation for Segmentation and Signal Unmixing

  • 基于U-Net改进生成器,融合注意力机制与谱归一化提升特征分离能力
  • 在无配对条件下完成核分割与荧光信号解混,保持结构精度优于传统方法
  • 首次实现在真实未配对数据上解耦多重荧光信号,适合医学图像分析研究者

本文提出Ui2i,一种用于无配对图像到图像翻译的新模型,可在内容无关的配对数据上训练,实现跨域风格迁移的同时保持内容完整性。受CycleGAN启发,Ui2i通过U-Net结构的生成器引入跳跃连接,将浅层局部特征深层传递;移除所有模块中的特征归一化层,改用近似双向谱归一化以增强训练稳定性;并在生成器中集成通道与空间注意力机制,进一步保障内容一致性。训练过程采用图像尺度增强。在两项生物医学任务中进行评估:免疫组化(IHC)图像中细胞核分割的域自适应,以及单通道免疫荧光(IF)图像中重叠生物结构的信号解混。结果表明,Ui2i在要求更高结构保真的场景下仍能有效保持内容真实度。据我们所知,Ui2i是首个能在真实未配对数据上实现IF图像信号解混的方法。

原文摘要 · Abstract (English)

This work introduces Ui2i, a novel model for unpaired image-to-image translation, trained on content-wise unpaired datasets to enable style transfer across domains while preserving content. Building on CycleGAN, Ui2i incorporates key modifications to better disentangle content and style features, and preserve content integrity. Specifically, Ui2i employs U-Net-based generators with skip connections to propagate localized shallow features deep into the generator. Ui2i removes feature-based normalization layers from all modules and replaces them with approximate bidirectional spectral normalization -- a parameter-based alternative that enhances training stability. To further support content preservation, channel and spatial attention mechanisms are integrated into the generators. Training is facilitated through image scale augmentation. Evaluation on two biomedical tasks -- domain adaptation for nuclear segmentation in immunohistochemistry (IHC) images and unmixing of biological structures superimposed in single-channel immunofluorescence (IF) images -- demonstrates Ui2i's ability to preserve content fidelity in settings that demand more accurate structural preservation than typical translation tasks. To the best of our knowledge, Ui2i is the first approach capable of separating superimposed signals in IF images using real, unpaired training data.

图像翻译生物图像信号解混无配对学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。