构建首个跨传感器去噪评估基准,提升模型泛化能力
MSSIDD: A Benchmark for Multi-Sensor Denoising
- 提出多传感器去噪数据集MSSIDD,涵盖6种传感器共6万张原始图像
- 设计一致性训练框架,使模型学习跨传感器不变特征,提升未见传感器适应性
- 验证了现有方法在跨传感器场景下的性能瓶颈,为工业应用提供新范式
移动端相机在不同拍摄模式下采用不同传感器,原始域去噪模型在传感器间的迁移能力至关重要但研究不足。工业方案或为每种传感器定制训练策略,或忽略传感器差异直接推广现有模型,导致训练繁琐或性能不佳。本文提出首个面向原始域的跨传感器去噪评估基准——多传感器SIDD(MSSIDD)数据集,包含60,000张由sRGB图像通过不同相机传感器参数退化生成的原始图像,覆盖6种不同传感器。同时提出传感器一致性训练框架,使去噪模型学习传感器无关特征,从而实现对未见传感器的有效泛化。在新提出的MSSIDD数据集上评估现有方法,实验结果验证了所提方法的有效性。数据集已公开于https://www.kaggle.com/datasets/sjtuwh/mssidd。
原文摘要 · Abstract (English)
The cameras equipped on mobile terminals employ different sensors in different photograph modes, and the transferability of raw domain denoising models between these sensors is significant but remains sufficient exploration. Industrial solutions either develop distinct training strategies and models for different sensors or ignore the differences between sensors and simply extend existing models to new sensors, which leads to tedious training or unsatisfactory performance. In this paper, we introduce a new benchmark, the Multi-Sensor SIDD (MSSIDD) dataset, which is the first raw-domain dataset designed to evaluate the sensor transferability of denoising models. The MSSIDD dataset consists of 60,000 raw images of six distinct sensors, derived through the degeneration of sRGB images via different camera sensor parameters. Furthermore, we propose a sensor consistency training framework that enables denoising models to learn the sensor-invariant features, thereby facilitating the generalization of the consistent model to unseen sensors. We evaluate previous arts on the newly proposed MSSIDD dataset, and the experimental results validate the effectiveness of our proposed method. Our dataset is available at https://www.kaggle.com/datasets/sjtuwh/mssidd.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。