arXiv:2604.04012cs.CVcs.LG2026-04

新方法OASIC能自动识别遮挡程度并动态选模型,提升遮挡物体分类准确率。

OASIC: Occlusion-Agnostic and Severity-Informed Classification

  • 测试时通过掩码移除遮挡干扰,不依赖遮挡类型
  • 可估计遮挡严重程度,且匹配模型效果最优
  • 适合真实场景中遮挡变化大的物体识别任务

严重遮挡是计算机视觉的重大挑战。我们发现其根源在于(1)可见信息丢失,(2)遮挡物带来的干扰模式。本方法同时应对二者:首先在测试时通过掩码去除遮挡模式,基于目标对象的视觉异常来处理遮挡;其次训练时对物体随机掩码,模拟不同严重程度的遮挡。我们发现(a)可在测试时估计遮挡严重程度,(b)为特定严重程度优化的模型在相似严重程度下表现最佳。由此提出严重程度感知的分类模型OASIC:通过估计测试图像的遮挡严重度,掩码遮挡物,并选择对应严重程度的模型。该策略优于任何单一模型在更小或更广遮挡范围下的表现。实验显示,灰度掩码结合自适应模型选择使$ ext{AUC}_ ext{occ}$提升+18.5(相比标准训练)和+23.7(相比无遮挡微调)。

原文摘要 · Abstract (English)

Severe occlusions of objects pose a major challenge for computer vision. We show that two root causes are (1) the loss of visible information and (2) the distracting patterns caused by the occluders. Our approach addresses both causes at the same time. First, the distracting patterns are removed at test-time, via masking of the occluding patterns. This masking is independent of the type of occlusion, by handling the occlusion through the lens of visual anomalies w.r.t. the object of interest. Second, to deal with less visual details, we follow standard practice by masking random parts of the object during training, for various degrees of occlusions. We discover that (a) it is possible to estimate the degree of the occlusion (i.e. severity) at test-time, and (b) that a model optimized for a specific degree of occlusion also performs best on a similar degree during test-time. Combining these two insights brings us to a severity-informed classification model called OASIC: Occlusion Agnostic Severity Informed Classification. We estimate the severity of occlusion for a test image, mask the occluder, and select the model that is optimized for the degree of occlusion. This strategy performs better than any single model optimized for any smaller or broader range of occlusion severities. Experiments show that combining gray masking with adaptive model selection improves $\text{AUC}_\text{occ}$ by +18.5 over standard training on occluded images and +23.7 over finetuning on unoccluded images.

遮挡识别自适应模型分类优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。