提出频域优化框架FOAM,提升重叠物体检测与分割精度。
FOAM: A General Frequency-Optimized Anti-Overlapping Framework for Overlapping Object Perception
- 从频域和空域联合提取特征,增强纹理与轮廓信息。
- 在4个数据集上显著提升现有模型性能,最高增益达3.2%。
- 适合安全筛查、医学影像等重叠物体识别场景。
重叠物体感知旨在分离随机重叠的前景-背景特征,提取前景特征并抑制背景特征,在安检与医疗辅助诊断等领域具有重要应用价值。尽管已有研究尝试解决该问题,但多数方法局限于空间域。通过频域分析发现,重叠导致的轮廓与纹理退化可直观体现在幅值谱中。基于此,我们提出通用的频域优化抗重叠框架FOAM,助力模型提取更多纹理与轮廓信息,提升抗重叠感知能力。具体地,设计频域空间变换块(FSTB),可同步从频域与空域提取特征,增强对前景纹理的捕捉。同时引入分层去畸变机制(HDC),在训练阶段通过特定一致性损失对齐基分支与扰动分支的相邻特征,抑制FSTB对无关背景特征的响应,从而提升前景轮廓感知。大量实验证明,FOAM在四个数据集上均有效提升现有先进模型性能,尤其在三类重叠物体感知任务(违禁品检测、违禁品分割、肺炎检测)中表现突出。代码将在论文接收后开源。
原文摘要 · Abstract (English)
Overlapping object perception aims to decouple the randomly overlapping foreground-background features, extracting foreground features while suppressing background features, which holds significant application value in fields such as security screening and medical auxiliary diagnosis. Despite some research efforts to tackle the challenge of overlapping object perception, most solutions are confined to the spatial domain. Through frequency domain analysis, we observe that the degradation of contours and textures due to the overlapping phenomenon can be intuitively reflected in the magnitude spectrum. Based on this observation, we propose a general Frequency-Optimized Anti-Overlapping Framework (FOAM) to assist the model in extracting more texture and contour information, thereby enhancing the ability for anti-overlapping object perception. Specifically, we design the Frequency Spatial Transformer Block (FSTB), which can simultaneously extract features from both the frequency and spatial domains, helping the network capture more texture features from the foreground. In addition, we introduce the Hierarchical De-Corrupting (HDC) mechanism, which aligns adjacent features in the separately constructed base branch and corruption branch using a specially designed consistent loss during the training phase. This mechanism suppresses the response to irrelevant background features of FSTBs, thereby improving the perception of foreground contour. We conduct extensive experiments to validate the effectiveness and generalization of the proposed FOAM, which further improves the accuracy of state-of-the-art models on four datasets, specifically for the three overlapping object perception tasks: Prohibited Item Detection, Prohibited Item Segmentation, and Pneumonia Detection. The code will be open source once the paper is accepted.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。