提出可控制的科学图像复原框架,同时处理多种噪声并支持精准修复。
Seeing Through the PRISM: Compound & Controllable Restoration of Scientific Images
- 基于提示的扩散模型,分离混合退化特征
- 在多类科学图像上实现超越基线的复原效果
- 支持自然语言指令选择性修复,提升科研准确性
科学与环境图像常受传感器和环境因素导致的复杂噪声影响。现有方法通常逐项去除退化,引发级联伪影、过度校正或重要信号丢失。在科学应用中,复原需同时处理多重退化,并允许专家选择性移除部分失真而不破坏关键特征。为此,我们提出PRISM(精度复原与混合分离框架),一种带提示的条件扩散模型,结合对混合退化的复合感知监督与加权对比解耦目标,使原始特征及其混合体在潜在空间中对齐。该组合几何结构支持高保真联合去噪,同时可通过自然语言提示灵活、定向修复。在显微镜、野生动物监测、遥感及城市气象数据集上,PRISM在复杂复合退化场景下(包括训练时未见的零样本混合)均优于当前最优基线。更重要的是,选择性复原显著提升了多个领域的下游科学准确性,相较传统“黑箱”复原方法。结果表明,PRISM是一种通用且可控的高保真复原框架,适用于以科学效用为优先的领域。
原文摘要 · Abstract (English)
Scientific and environmental imagery often suffer from complex mixtures of noise related to the sensor and the environment. Existing restoration methods typically remove one degradation at a time, leading to cascading artifacts, overcorrection, or loss of meaningful signal. In scientific applications, restoration must be able to simultaneously handle compound degradations while allowing experts to selectively remove subsets of distortions without erasing important features. To address these challenges, we present PRISM (Precision Restoration with Interpretable Separation of Mixtures). PRISM is a prompted conditional diffusion framework which combines compound-aware supervision over mixed degradations with a weighted contrastive disentanglement objective that aligns primitives and their mixtures in the latent space. This compositional geometry enables high-fidelity joint removal of overlapping distortions while also allowing flexible, targeted fixes through natural language prompts. Across microscopy, wildlife monitoring, remote sensing, and urban weather datasets, PRISM outperforms state-of-the-art baselines on complex compound degradations, including zero-shot mixtures not seen during training. Importantly, we show that selective restoration significantly improves downstream scientific accuracy in several domains over standard "black-box" restoration. These results establish PRISM as a generalizable and controllable framework for high-fidelity restoration in domains where scientific utility is a priority.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。