arXiv:2603.14304cs.CV2026-03被引 1

基于物理模型的攻击与自适应防御框架,提升真实低光图像增强效果。

A Physically-Grounded Attack and Adaptive Defense Framework for Real-World Low-Light Image Enhancement

  • 构建物理降级合成管道,模拟真实成像噪声并生成高保真训练数据
  • 通过噪声预测与动态专家路由,实现对不同噪声强度的自适应处理
  • 支持即插即用,适用于现有低光增强方法,尤其适合复杂噪声场景

光照不足常导致图像出现严重物理噪声和细节退化。现有低光图像增强(LLIE)方法多将增强过程视为黑箱映射,忽视成像过程中物理噪声的转换,导致性能受限。为此,我们提出一种基于物理模型的攻击与显示自适应防御范式。在攻击端,建立基于物理的降级合成(PDS)流程,显式建模图像信号处理器(ISP)逆向至原始域,注入符合物理规律的光子噪声与读出噪声,并重新投影至sRGB域,生成带有显式参数化降级向量的高保真训练对,有效模拟对纯净信号的真实攻击。在防御端,构建双层强化系统:噪声预测器从输入sRGB图像估计降级参数,引导降级感知的专家混合(DA-MoE)动态分配特征至专精于特定噪声强度的专家;同时引入自适应度量防御(AMD)机制,根据噪声严重程度动态校准特征嵌入空间,确保在严重退化下的鲁棒表示学习。大量实验表明,该方法显著提升现有基准LLIE方法的性能,有效抑制真实世界噪声并保持结构保真度。源码已公开于 https://github.com/bywlzts/Attack-defense-llie。

原文摘要 · Abstract (English)

Limited illumination often causes severe physical noise and detail degradation in images. Existing Low-Light Image Enhancement (LLIE) methods frequently treat the enhancement process as a blind black-box mapping, overlooking the physical noise transformation during imaging, leading to suboptimal performance. To address this, we propose a novel LLIE approach, conceptually formulated as a physics-based attack and display-adaptive defense paradigm. Specifically, on the attack side, we establish a physics-based Degradation Synthesis (PDS) pipeline. Unlike standard data augmentation, PDS explicitly models Image Signal Processor (ISP) inversion to the RAW domain, injects physically plausible photon and read noise, and re-projects the data to the sRGB domain. This generates high-fidelity training pairs with explicitly parameterized degradation vectors, effectively simulating realistic attacks on clean signals. On the defense side, we construct a dual-layer fortified system. A noise predictor estimates degradation parameters from the input sRGB image. These estimates guide a degradation-aware Mixture of Experts (DA-MoE), which dynamically routes features to experts specialized in handling specific noise intensities. Furthermore, we introduce an Adaptive Metric Defense (AMD) mechanism, dynamically calibrating the feature embedding space based on noise severity, ensuring robust representation learning under severe degradation. Extensive experiments demonstrate that our approach offers significant plug-and-play performance enhancement for existing benchmark LLIE methods, effectively suppressing real-world noise while preserving structural fidelity. The sourced code is available at https://github.com/bywlzts/Attack-defense-llie.

低光增强物理建模自适应防御噪声抑制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。