arXiv:2503.13163cs.CV2025-03ICCV被引 3

用并行处理RAW数据提升目标检测,效果优于传统RGB方法。

Beyond RGB: Adaptive Parallel Processing for RAW Object Detection

  • 并行执行多种图像处理,保留更多原始传感器信息
  • 在多个光照和动态范围下均实现最优检测性能
  • 适合需要高精度视觉感知的自动驾驶等场景

目标检测模型通常基于经过图像信号处理(ISP)管道处理的标准RGB图像。然而,这些ISP操作会损失对计算机视觉任务至关重要的信息。本文提出原始图像自适应模块(RAM),替代传统ISP,其参数专门优化用于RAW图像的目标检测。受人类视觉系统并行处理机制启发,RAM采用并行而非串行方式应用多种ISP功能,更全面地捕捉图像特征,并通过专用融合模块动态整合与优化信息以适配目标任务。该方法充分挖掘了RAW数据潜力,实现任务定制化预处理,显著提升检测性能。在不同光照条件和动态范围下的多个RAW图像数据集上,本方法均超越基于RGB的方法,达到当前最优水平。

原文摘要 · Abstract (English)

Object detection models are typically applied to standard RGB images processed through Image Signal Processing (ISP) pipelines, which are designed to enhance sensor-captured RAW images for human vision. However, these ISP functions can lead to a loss of critical information that may be essential in optimizing for computer vision tasks, such as object detection. In this work, we introduce Raw Adaptation Module (RAM), a module designed to replace the traditional ISP, with parameters optimized specifically for RAW object detection. Inspired by the parallel processing mechanisms of the human visual system, RAM departs from existing learned ISP methods by applying multiple ISP functions in parallel rather than sequentially, allowing for a more comprehensive capture of image features. These processed representations are then fused in a specialized module, which dynamically integrates and optimizes the information for the target task. This novel approach not only leverages the full potential of RAW sensor data but also enables task-specific pre-processing, resulting in superior object detection performance. Our approach outperforms RGB-based methods and achieves state-of-the-art results across diverse RAW image datasets under varying lighting conditions and dynamic ranges.

目标检测RAW图像并行处理视觉感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。