arXiv:2411.01472cs.CVcs.AI2024-11NeurIPS被引 1

用少量新传感器数据,让降噪模型自动适应不同相机噪声模式。

Adaptive Domain Learning for Cross-domain Image Denoising

  • 自适应筛选源域数据,剔除有害样本提升泛化能力。
  • 引入传感器信息调制模块,显著提升跨域降噪效果。
  • 仅需少量目标传感器数据,适合移动端快速部署。

不同相机传感器具有不同的噪声特性,导致在某一传感器上训练的图像降噪模型难以泛化到其他传感器。传统方法需为每个传感器收集大量数据,成本高昂。为此,本文提出自适应域学习(ADL)框架,仅利用现有多个传感器的源域数据和少量目标传感器数据,实现跨域RAW图像降噪。ADL自动识别并移除对目标域微调有害的源域样本(部分数据会因域差异降低性能)。同时引入调制模块,融合传感器类型与ISO等信息,增强模型对输入数据的理解。在多个公共数据集(涵盖智能手机与单反相机)上的实验表明,本方法在仅使用少量目标传感器数据时,性能优于现有先进方法。

原文摘要 · Abstract (English)

Different camera sensors have different noise patterns, and thus an image denoising model trained on one sensor often does not generalize well to a different sensor. One plausible solution is to collect a large dataset for each sensor for training or fine-tuning, which is inevitably time-consuming. To address this cross-domain challenge, we present a novel adaptive domain learning (ADL) scheme for cross-domain RAW image denoising by utilizing existing data from different sensors (source domain) plus a small amount of data from the new sensor (target domain). The ADL training scheme automatically removes the data in the source domain that are harmful to fine-tuning a model for the target domain (some data are harmful as adding them during training lowers the performance due to domain gaps). Also, we introduce a modulation module to adopt sensor-specific information (sensor type and ISO) to understand input data for image denoising. We conduct extensive experiments on public datasets with various smartphone and DSLR cameras, which show our proposed model outperforms prior work on cross-domain image denoising, given a small amount of image data from the target domain sensor.

图像降噪跨域学习自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。