arXiv:2512.04496cs.CV2025-12

提出多模型架构,精准去除不同尺度的镜面高光。

Shift-Window Meets Dual Attention: A Multi-Model Architecture for Specular Highlight Removal

  • 结合卷积与注意力机制,兼顾局部细节与全局依赖。
  • 在六类材质上优于现有方法,精度与效率双提升。
  • 适合图像修复、三维重建等需去高光的应用场景。

实际环境中不可避免的镜面高光严重损害视觉效果,降低任务有效性与效率。尽管已有大量方法聚焦于卷积神经网络的局部信息或变压器模型的全局信息,但单一模型在局部精细细节与全局长程依赖之间存在建模困境,难以应对不同尺度的镜面高光。为此,我们提出多模型镜面高光去除架构(MM-SHR),有效捕捉高光区域的细粒度特征,并建模高光区与无高光区域间的长程依赖。具体地,在浅层采用卷积操作提取局部细节,深层利用注意力机制捕获全局特征,兼顾运算效率与去除精度。为在不增加计算复杂度的前提下建模长程依赖,我们采用粗到精策略,提出全向注意力融合模块(OAIBlock)与自适应区域感知混合域双注意力卷积网络(HDDAConv),通过原始特征上的全向像素移位与窗口分割操作实现高光去除。在三个基准任务和六类表面材质上的大量实验表明,MM-SHR在准确率与效率上均优于当前最优方法。代码将公开于 https://github.com/Htcicv/MM-SHR。

原文摘要 · Abstract (English)

Inevitable specular highlights in practical environments severely impair the visual performance, thus degrading the task effectiveness and efficiency. Although there exist considerable methods that focus on local information from convolutional neural network models or global information from transformer models, the single-type model falls into a modeling dilemma between local fine-grained details and global long-range dependencies, thus deteriorating for specular highlights with different scales. Therefore, to accommodate specular highlights of all scales, we propose a multi-model architecture for specular highlight removal (MM-SHR) that effectively captures fine-grained features in highlight regions and models long-range dependencies between highlight and highlight-free areas. Specifically, we employ convolution operations to extract local details in the shallow layers of MM-SHR, and utilize the attention mechanism to capture global features in the deep layers, ensuring both operation efficiency and removal accuracy. To model long-range dependencies without compromising computational complexity, we utilize a coarse-to-fine manner and propose Omni-Directional Attention Integration Block(OAIBlock) and Adaptive Region-Aware Hybrid-Domain Dual Attention Convolutional Network(HDDAConv) , which leverage omni-directiona pixel-shifting and window-dividing operations at the raw features to achieve specular highlight removal. Extensive experimental results on three benchmark tasks and six types of surface materials demonstrate that MM-SHR outperforms state-of-the-art methods in both accuracy and efficiency for specular highlight removal. The implementation will be made publicly available at https://github.com/Htcicv/MM-SHR.

去高光多模型注意力机制图像修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。