arXiv:2511.18811cs.CVcs.AI2025-11被引 1

无需训练的缓存机制,有效提升罕见互动检测能力

Mitigating Long-Tail Bias in HOI Detection via Adaptive Diversity Cache

  • 构建自适应多样性缓存,动态存储高置信度特征
  • 在HICO-DET和V-COCO上显著提升罕见类别的检测准确率
  • 无需微调即可部署,适合资源受限的长尾场景

人-物交互(HOI)检测是计算机视觉中的基础任务,使机器能够理解现实世界中的人与物关系。尽管基于视觉语言模型(VLM)的方法通过跨模态表示显著提升了性能,但多数方法依赖额外训练或提示调优,导致计算开销大、可扩展性差,尤其在长尾分布下,稀有交互严重不足。本文提出自适应多样性缓存(ADC)模块,一种无需训练、即插即用的新机制,用于缓解长尾偏差。ADC在推理过程中构建类别特定的缓存,积累高置信度且多样化的特征表示,通过自适应容量分配优先支持稀有类别,并动态增强特征以实现鲁棒预测校准,无需额外训练或微调。在HICO-DET和V-COCO数据集上的大量实验表明,ADC能持续提升现有HOI检测器性能,特别是在稀有类别检测方面表现突出,同时保持整体性能稳定。结果验证了ADC作为训练免费、即插即用的长尾偏差缓解方案的有效性。

原文摘要 · Abstract (English)

Human-Object Interaction (HOI) detection is a fundamental task in computer vision, empowering machines to comprehend human-object relationships in diverse real-world scenarios. Recent advances in VLMs have significantly improved HOI detection by leveraging rich cross-modal representations. However, most existing VLM-based approaches rely heavily on additional training or prompt tuning, resulting in substantial computational overhead and limited scalability, particularly in long-tailed scenarios where rare interactions are severely underrepresented. In this paper, we propose the Adaptive Diversity Cache (ADC) module, a novel training-free and plug-and-play mechanism designed to mitigate long-tail bias in HOI detection. ADC constructs class-specific caches that accumulate high-confidence and diverse feature representations during inference. The method incorporates adaptive capacity allocation favoring rare categories and dynamic feature augmentation to enable robust prediction calibration without requiring additional training or fine-tuning. Extensive experiments on HICO-DET and V-COCO datasets show that ADC consistently improves existing HOI detectors, particularly enhancing rare category detection while preserving overall performance. These findings confirm the effectiveness of ADC as a training-free, plug-and-play solution for long-tail bias mitigation.

HOI检测长尾问题缓存机制零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。