arXiv:2509.25989cs.CV2025-09NeurIPS被引 2

改进视觉少样本学习的示例选择,提升准确性和全面性

Towards Reliable and Holistic Visual In-Context Learning Prompt Selection

  • 用自助法与覆盖设计优化配对比较采样策略
  • 在多个视觉任务上超越基线方法,显著提升性能
  • 适合研究视觉少样本学习与提示工程的学者

视觉上下文学习(VICL)通过利用上下文示例中的信息适应视觉基础模型至新任务,可视为对候选示例的全局排序问题。现有方法如Partial2Global和VPR基于相似性优先假设,认为与查询图像更相似的示例是更好的上下文示例,但该假设缺乏充分依据。此外,Partial2Global依赖随机采样的成对偏好预测构建全局排序,易导致覆盖不全与重复比较,影响最终排序质量。为此,本文提出RH-Partial2Global,采用自助法引导的置信区间生成可靠替代集,并结合覆盖设计采样策略,确保成对偏好比较的全面与均匀覆盖。大量实验表明,RH-Partial2Global在多种视觉任务上表现优异,显著优于Partial2Global。

原文摘要 · Abstract (English)

Visual In-Context Learning (VICL) has emerged as a prominent approach for adapting visual foundation models to novel tasks, by effectively exploiting contextual information embedded in in-context examples, which can be formulated as a global ranking problem of potential candidates. Current VICL methods, such as Partial2Global and VPR, are grounded in the similarity-priority assumption that images more visually similar to a query image serve as better in-context examples. This foundational assumption, while intuitive, lacks sufficient justification for its efficacy in selecting optimal in-context examples. Furthermore, Partial2Global constructs its global ranking from a series of randomly sampled pairwise preference predictions. Such a reliance on random sampling can lead to incomplete coverage and redundant samplings of comparisons, thus further adversely impacting the final global ranking. To address these issues, this paper introduces an enhanced variant of Partial2Global designed for reliable and holistic selection of in-context examples in VICL. Our proposed method, dubbed RH-Partial2Global, leverages a jackknife conformal prediction-guided strategy to construct reliable alternative sets and a covering design-based sampling approach to ensure comprehensive and uniform coverage of pairwise preferences. Extensive experiments demonstrate that RH-Partial2Global achieves excellent performance and outperforms Partial2Global across diverse visual tasks.

视觉上下文学习提示选择少样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。