arXiv:2608.03385cs.CV2026-08

将RAW图像处理从空间域转至频域,提升恶劣环境下的目标检测性能。

FreqAdapt: Frequency-Adaptive Processing for RAW Object Detection

论文配图:FreqAdapt: Frequency-Adaptive Processing for RAW Object Detection
图 1 · 摘自论文原文
  • 在频域中重构ISP流程,按物理特性分域处理数据
  • 自适应融合幅度与相位谱信息,实现全局上下文感知增强
  • 轻量模块可嵌入现有检测框架,适合低光/恶劣天气场景

现有目标检测方法主要依赖sRGB输入,这些图像由RAW传感器数据经为可视化设计的图像信号处理器(ISP)压缩而来。相比RGB图像,RAW图像具有更优的噪声特性与更丰富的信息表达,对恶劣天气或低光照条件下的目标检测尤为关键。本文提出FreqAdapt,一种轻量级频域自适应RAW数据增强模块。不同于传统空间域处理,FreqAdapt创新性地将ISP操作映射至傅里叶频率域,并基于ISP操作的物理特性进行域分离,确保每项操作在最适配的域中执行。同时,通过联合分析幅度谱、相位谱与RAW图像特征的自适应频域编码器,提供全局上下文以预测ISP参数,并采用可学习融合机制实现自适应特征增强。在多个包含多样光照与天气条件的数据集上的大量实验表明,FreqAdapt在保持轻量高效的同时达到业界领先性能,且具备良好的物理可解释性。此外,该模块可无缝集成至现有目标检测框架中,为RAW域视觉感知任务提供新解决方案。

原文摘要 · Abstract (English)

Existing object detection methods predominantly utilize sRGB inputs, which are compressed from RAW sensor data using Image Signal Processors (ISP) originally designed for visualization purposes. Compared to RGB images, RAW images possess favorable noise characteristics and richer information representation, which are crucial for object detection, particularly under challenging conditions such as adverse weather or low-light environments. In this paper, we propose FreqAdapt, a lightweight module for adaptive RAW data enhancement in the frequency domain. Unlike traditional spatial domain processing methods, FreqAdapt innovatively maps ISP operations to the Fourier frequency domain and performs domain separation based on the physical properties of ISP operations, ensuring each operation is performed in its most suitable domain. Meanwhile, through an adaptive frequency domain encoder that jointly analyzes amplitude spectrum, phase spectrum, and RAW image features, we provide global context for ISP parameter prediction and employ a learnable fusion mechanism to achieve adaptive feature enhancement. Extensive experiments on multiple datasets with diverse lighting and weather conditions demonstrate that FreqAdapt achieves state-of-the-art performance while maintaining lightweight efficiency and good physical interpretability. Furthermore, our module can be seamlessly incorporated into existing object detection frameworks, providing a novel solution for visual perception tasks in the RAW domain.

目标检测RAW图像频域处理轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。