arXiv:2607.09193cs.CV2026-07中稿 · ECCV

仅用两张噪点图就能生成真实世界噪声,无需干净图像或相机信息。

YeTI: You Only Need Two Noisy Images for Real-World sRGB Noise Generation

论文配图:YeTI: You Only Need Two Noisy Images for Real-World sRGB Noise Generation
图 1 · 摘自论文原文
  • 通过自编码器分离场景结构与噪声,用扩散模型学习噪声分布。
  • 在SIDD、SID等数据集上生成的噪声能有效提升去噪模型性能。
  • 适合需要真实噪声合成但无干净样本或元数据的研究者使用。

真实世界sRGB图像去噪因传感器噪声的非线性特性及难以获取对齐的干净-噪点图像对而面临挑战。监督式去噪模型常因配对数据有限而过拟合,自监督方法仍依赖足够多样的噪点观测。为此,我们提出YeTI,一种仅需同一场景的两张噪点图像即可建模真实噪声的生成框架。YeTI利用重建自编码器分离场景结构与噪声特征,并通过一致性目标训练单步条件扩散变换器建模潜在噪声分布。推理时仅需一张噪点输入,即可生成信号相关的逼真噪声并保留原始场景内容。大量实验表明,YeTI在SIDD、SIDD+、MAI2021和SID等真实世界基准上表现优异。下游去噪任务在DND上的结果进一步显示,使用YeTI生成图像训练的去噪器具备强现实表现,凸显了无需干净图像和元数据的噪声生成的实际价值。

原文摘要 · Abstract (English)

Real-world sRGB image denoising remains challenging due to the nonlinear characteristics of sensor noise and the difficulty of acquiring aligned clean-noisy image pairs. Supervised denoisers often overfit to limited paired datasets, while self-supervised methods still depend on sufficiently diverse noisy observations. These limitations motivate scalable noise synthesis methods that can model real-world noise without clean ground truth or camera metadata. We propose YeTI, a real-world sRGB noise generation framework that learns from only two noisy observations of the same scene. YeTI uses a Reconstruction Autoencoder to disentangle scene structure and noise characteristics, and models the latent noise distribution with a one-step Conditional Diffusion Transformer trained using consistency objectives. Given a single noisy input at inference time, YeTI generates realistic, signal-dependent noise while preserving the underlying scene content. Extensive experiments demonstrate the effectiveness of YeTI across real-world benchmarks. We evaluate noise generation on SIDD and further assess generalization on SIDD+, MAI2021, and SID, covering smartphone and diverse consumer-camera sensors. Downstream denoising results on DND further show that denoisers trained with YeTI-synthesized images achieve strong real-world performance, highlighting the practical value of clean-image-free and metadata-free noise generation.

噪声生成扩散模型去噪自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。