提出轻量自适应ISP插件Dark-ISP,直接处理RAW图像提升暗光目标检测性能
Dark-ISP: Enhancing RAW Image Processing for Low-Light Object Detection
- 将ISP流程拆解为可微分的线性与非线性模块,实现端到端优化
- 在三个数据集上超越现有方法,参数量极小且暗光环境下表现优异
- 适合需要高效低光目标检测的嵌入式视觉系统应用
暗光目标检测对众多现实应用至关重要,但受限于图像质量下降。尽管近期研究显示RAW图像相比RGB图像具有更高潜力,现有方法或因转换损失使用RAW-RGB图像,或采用复杂框架。为此,我们提出轻量级自适应图像信号处理(ISP)插件Dark-ISP,直接处理暗环境下的Bayer RAW图像,支持目标检测的无缝端到端训练。核心创新包括:(1) 将传统ISP流水线分解为顺序的线性(传感器校准)与非线性(色调映射)子模块,重构为可微分组件,通过任务驱动损失优化;各模块配备内容感知自适应与物理先验,实现与检测目标对齐的自动RAW-to-RGB转换。(2) 利用ISP流水线内在级联结构,设计自增强机制,促进子模块间协作。在三个RAW图像数据集上的大量实验表明,本方法优于现有基于RGB和RAW的检测方法,在参数极少情况下仍取得卓越性能。
原文摘要 · Abstract (English)
Low-light Object detection is crucial for many real-world applications but remains challenging due to degraded image quality. While recent studies have shown that RAW images offer superior potential over RGB images, existing approaches either use RAW-RGB images with information loss or employ complex frameworks. To address these, we propose a lightweight and self-adaptive Image Signal Processing (ISP) plugin, Dark-ISP, which directly processes Bayer RAW images in dark environments, enabling seamless end-to-end training for object detection. Our key innovations are: (1) We deconstruct conventional ISP pipelines into sequential linear (sensor calibration) and nonlinear (tone mapping) sub-modules, recasting them as differentiable components optimized through task-driven losses. Each module is equipped with content-aware adaptability and physics-informed priors, enabling automatic RAW-to-RGB conversion aligned with detection objectives. (2) By exploiting the ISP pipeline's intrinsic cascade structure, we devise a Self-Boost mechanism that facilitates cooperation between sub-modules. Through extensive experiments on three RAW image datasets, we demonstrate that our method outperforms state-of-the-art RGB- and RAW-based detection approaches, achieving superior results with minimal parameters in challenging low-light environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。