arXiv:2605.20436cs.CV2026-05

提出轻量级模块增强实例分割在复杂光照下的鲁棒性,无需微调主干模型。

Lighting-aware Unified Model for Instance Segmentation

论文配图:Lighting-aware Unified Model for Instance Segmentation
图 1 · 摘自论文原文
  • 设计双分支结构,融合图像与对比图特征,感知真实结构变化而非光照干扰
  • 通过成对训练和显式损失函数,显著降低不同光照条件下的分割误差
  • 适用于需要高鲁棒性的实际场景,尤其适合部署在光照多变环境中的视觉系统

如通用分割模型(SAM)虽具备出色的零样本泛化能力,但在多变的真实光照条件下,实例分割性能常明显下降。本文提出一种名为光照卷积-注意力(Lighting Convolutional-Attention, \\lca{})的适配模块,可在不微调重型主干网络的前提下提升分割鲁棒性。该模块采用双分支架构,同时处理RGB特征与对比图特征,实现对结构变化的物理合理敏感度,而非对光照伪影的误判。通过成对训练策略优化,引入显式损失项,明确惩罚干净图像与其光照变体之间的差异。为验证与支持该架构,我们在多个现有基准上开展全面实验,并构建了一个基于Unity的新型合成数据集,专门用于精确模拟复杂真实光照条件。大量实验证明,该方法有效弥合领域差距,实现更优的光照鲁棒性分割效果。

原文摘要 · Abstract (English)

Foundation models like the Segment Anything Model (SAM) demonstrate impressive zero-shot generalization but frequently degrade under diverse real-world illumination, particularly for instance segmentation. In this work, we address this limitation by developing \textit{Lighting Convolutional-Attention (\lca{})}, an adapter module that enhances segmentation robustness without fine-tuning the heavy backbone. \lca{} employs a dual-branch architecture to process RGB features alongside contrast maps, enabling physically motivated sensitivity to structural changes rather than illumination artifacts. We optimize \lca{} through a pairwise training strategy, introducing a targeted loss term that explicitly penalizes discrepancies between clean images and their corresponding illumination variants. To evaluate and support this architecture, we conduct a comprehensive empirical study across multiple existing benchmarks and present a novel Unity-based synthetic dataset specifically designed to accurately replicate complex real-world lighting conditions. Extensive experimental results demonstrate that our approach successfully bridges the domain gap, delivering superior lighting-robust segmentation.

实例分割光照鲁棒适配模块零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。