arXiv:2511.07862cs.CV2025-11AAAI被引 3

通过视觉聚类与场景记忆提升单目3D检测精度,尤其在遮挡和视角受限时表现更优。

MonoCLUE : Object-Aware Clustering Enhances Monocular 3D Object Detection

  • 用K-means聚类视觉特征,捕捉物体局部外观部件,增强部分可见目标识别
  • 构建跨图像的通用场景记忆,统一不同场景下的物体特征表示
  • 融合局部聚类与全局记忆信息,显著提升遮挡和视野受限下的检测稳定性

单目3D目标检测因其低成本优势被广泛应用于自动驾驶,但受深度模糊和视场有限限制,导致几何线索不足,在遮挡或截断场景中精度下降。现有方法虽引入深度信息缓解几何歧义,却忽视了对鲁棒识别至关重要的视觉线索。本文提出MonoCLUE,通过结合局部聚类与泛化场景记忆来增强单目3D检测。首先,对视觉特征进行K-means聚类,提取车头、车顶等物体级外观部件,提升部分可见物体的检测能力;聚类特征在区域间传播,捕获相似外观目标。其次,通过聚合多图特征构建通用场景记忆,提供跨场景一致的特征表示,增强物体级别特征一致性。最后,将局部聚类特征与场景记忆融入对象查询,引导注意力聚焦于关键区域。该统一策略在KITTI基准上实现当前最优性能,显著提升遮挡及低可视性场景下的检测鲁棒性。

原文摘要 · Abstract (English)

Monocular 3D object detection offers a cost-effective solution for autonomous driving but suffers from ill-posed depth and limited field of view. These constraints cause a lack of geometric cues and reduced accuracy in occluded or truncated scenes. While recent approaches incorporate additional depth information to address geometric ambiguity, they overlook the visual cues crucial for robust recognition. We propose MonoCLUE, which enhances monocular 3D detection by leveraging both local clustering and generalized scene memory of visual features. First, we perform K-means clustering on visual features to capture distinct object-level appearance parts (e.g., bonnet, car roof), improving detection of partially visible objects. The clustered features are propagated across regions to capture objects with similar appearances. Second, we construct a generalized scene memory by aggregating clustered features across images, providing consistent representations that generalize across scenes. This improves object-level feature consistency, enabling stable detection across varying environments. Lastly, we integrate both local cluster features and generalized scene memory into object queries, guiding attention toward informative regions. Exploiting a unified local clustering and generalized scene memory strategy, MonoCLUE enables robust monocular 3D detection under occlusion and limited visibility, achieving state-of-the-art performance on the KITTI benchmark.

单目3D检测视觉聚类场景记忆自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。