解决遮挡下物体计数难题,重建被遮挡部分特征以提升精度
Counting Through Occlusion: Framework for Open World Amodal Counting
- 通过多模态引导重建遮挡区域的物体特征
- 在FSC-147-OCC上比基线降低26.72%的MAE
- 适用于复杂遮挡场景,适合工业检测与自动驾驶
物体计数在可见实例上已取得显著进展,但现有最先进方法在遮挡情况下表现不佳。根本原因在于主干网络编码了遮挡表面而非目标物体,导致特征表示失真。为此,我们提出CountOCC框架,通过分层多模态引导显式重建被遮挡物体特征。不接受退化的编码,而是融合可见片段的空间上下文与文本、视觉嵌入的语义先验,在多层级金字塔中生成遮挡位置的特征。此外,引入视觉等价目标,强制注意力空间一致性,确保同一场景的遮挡与非遮挡视图产生空间对齐的梯度注意力图。两项机制共同保留计数所需的判别性特征。为严格评估,我们构建了增强遮挡的FSC-147和CARPK数据集(FSC-147-OCC和CARPK-OCC)。CountOCC在FSC-147-OCC上验证集和测试集分别实现26.72%和20.80%的MAE降低;在CARPK-OCC上达到49.89%的MAE降低,在CAPTURe-Real上达28.79%降低,验证其鲁棒的无遮挡计数能力。
原文摘要 · Abstract (English)
Object counting has achieved remarkable success on visible instances, yet state-of-the-art (SOTA) methods fail under occlusion. This failure stems from a fundamental architectural limitation where backbone networks encode occluding surfaces rather than target objects, thereby corrupting the feature representations required for accurate enumeration. To address this, we present CountOCC, an amodal counting framework that explicitly reconstructs occluded object features through hierarchical multimodal guidance. Rather than accepting degraded encodings, we synthesize complete representations by integrating spatial context from visible fragments with semantic priors from text and visual embeddings, generating features at occluded locations across multiple pyramid levels. We further introduce a visual equivalence objective that enforces consistency in attention space, ensuring that both occluded and unoccluded views of the same scene produce spatially aligned gradient-based attention maps. Together, these complementary mechanisms preserve discriminative properties essential for accurate counting under occlusion. For rigorous evaluation, we establish occlusion-augmented versions of FSC-147 and CARPK (FSC-147-OCC and CARPK-OCC). CountOCC achieves SOTA performance on FSC-147-OCC with 26.72% and 20.80% MAE reduction over prior baselines under occlusion in validation and test, respectively. CountOCC also demonstrates exceptional generalization by setting new SOTA results on CARPK-OCC with 49.89% MAE reduction and on CAPTURe-Real with 28.79% MAE reduction, validating robust amodal counting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。