PRISM通过局部门控机制实现图像翻译中内容与风格的精准分离。
PRISM: Distribution-Gated Flow Matching for Controllable Unpaired Image Translation

- 用可学习的逐特征门控替代全局噪声控制,实现内容保留与风格变换的解耦。
- 在五个自然与生物医学数据集上,四项指标领先,组织病理学核数比最接近理想值。
- 支持文本或检测器局部干预,无需重训练即可保护关键结构。
无配对图像翻译需在每张图上决定保留什么、改变什么,而无需成对监督。现有基于扩散的方法依赖单一全局噪声或引导值,无法区分需保留的内容与需改变的外观。本文提出PRISM,一种无需GAN的流匹配框架,以学习得到的逐特征门控替代全局控制。该门控的空间先验来自源特征到目标特征分布的标准化距离,远离目标的特征被释放,一致的特征则被保留。同一门控同时控制初始化(混合真实源隐空间与任务匹配的扰动)和微分方程积分过程中的传输时机。扰动与任务匹配:结构保持型使用AdaIN锚定,结构变化型部分锚定。推理时可通过文本或检测器局部覆盖门控,无需重训练,既保留原图重要结构,又生成逼真结果。在五个自然与生物医学基准测试(AFHQ cat→dog、CelebA-HQ外观转换、日→夜光照重制、虚拟染色、乳腺冰冻→永久病理)上评估,采用统一分割协议,PRISM在四项指标中达到最佳Inception FID与KID,在第五项表现竞争力;在病理学任务中,其细胞核数量比最接近理想值,表明目标真实度与结构保真之间取得良好平衡。
原文摘要 · Abstract (English)
Unpaired image-to-image translation must decide, per image, what to change and what to preserve without paired supervision. Many diffusion-based unpaired translators control preservation through a single global noise or guidance value applied across the image, which cannot separate content to keep from appearance to change. We present PRISM, a GAN-free flow-matching framework that replaces this global control with a learned per-feature gate. The gate's spatial prior is derived from each source feature's standardized distance to the target feature distribution, so features far from the target are freed while target-consistent features are preserved. The same gate controls both the initialization, which mixes the real source latent with a task-matched corruption, and the transport timing during Ordinary Differential Equation (ODE) integration. The corruption is matched to the task, content-anchored (AdaIN) for structure-preserving translation and partially anchored for structure-changing translation, and the gate can be overridden locally at inference from text or a detector without retraining, preserving important structures of the original image while still generating realistic results. We evaluate PRISM on five natural and biomedical benchmarks (AFHQ cat->dog, CelebA-HQ appearance translation, day->night relighting, virtual staining, and breast frozen->permanent histopathology). Among the evaluated methods under a shared same-split protocol, PRISM attains the best Inception FID and KID on four benchmarks and a competitive result on the fifth, and on histopathology yields the nuclei-count ratio closest to the ideal, supporting a favorable balance between target realism and structural preservation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。