arXiv:2503.19145cs.CV2025-03CVPR被引 4

无需训练即可检测开放词汇属性,通过组合缓存提升精度。

Compositional Caching for Training-free Open-vocabulary Attribute Detection

  • 用网页数据和大模型构建属性-物体组合缓存
  • 软标签聚合使预测准确率显著优于零样本基线
  • 适配多种视觉语言模型,适合快速部署新属性

属性检测对计算机视觉任务至关重要,可描述颜色、纹理、材质等属性。现有方法依赖繁琐标注,且受限于预定义属性集,难以扩展。本文提出无需训练的开放词汇属性检测方法ComCa,仅需目标属性与物体列表,利用网络数据库和大语言模型生成辅助缓存图像,并基于属性-物体兼容性赋予软标签。推理时根据输入与缓存图像的相似度聚合标签,增强底层视觉语言模型的预测。该方法不依赖特定模型,实验表明其性能显著超越零样本及缓存基线,接近训练型方法,证明精心设计的免训练方案可有效解决开放词汇属性检测问题。

原文摘要 · Abstract (English)

Attribute detection is crucial for many computer vision tasks, as it enables systems to describe properties such as color, texture, and material. Current approaches often rely on labor-intensive annotation processes which are inherently limited: objects can be described at an arbitrary level of detail (e.g., color vs. color shades), leading to ambiguities when the annotators are not instructed carefully. Furthermore, they operate within a predefined set of attributes, reducing scalability and adaptability to unforeseen downstream applications. We present Compositional Caching (ComCa), a training-free method for open-vocabulary attribute detection that overcomes these constraints. ComCa requires only the list of target attributes and objects as input, using them to populate an auxiliary cache of images by leveraging web-scale databases and Large Language Models to determine attribute-object compatibility. To account for the compositional nature of attributes, cache images receive soft attribute labels. Those are aggregated at inference time based on the similarity between the input and cache images, refining the predictions of underlying Vision-Language Models (VLMs). Importantly, our approach is model-agnostic, compatible with various VLMs. Experiments on public datasets demonstrate that ComCa significantly outperforms zero-shot and cache-based baselines, competing with recent training-based methods, proving that a carefully designed training-free approach can successfully address open-vocabulary attribute detection.

属性检测开放词汇缓存机制视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。