arXiv:2606.31222cs.AI2026-06

通过分步推理提升零样本图像检索准确率

Thinking Before Retrieving: Robust Zero-Shot Composed Image Retrieval via Strategic Planning and Self-Criticism

论文配图:Thinking Before Retrieving: Robust Zero-Shot Composed Image Retrieval via Strategic Planning and Self-Criticism
图 1 · 摘自论文原文
  • 采用规划-执行-批判三阶段框架生成查询
  • 多候选评估机制显著降低生成误差
  • 适合追求高精度零样本检索的研究者

组合式图像检索要求从图库中识别目标图像,需结合参考图像与文本修改指令。在无训练的零样本设置下,该任务依赖于在冻结的视觉-语言嵌入空间中动态构建检索用文本查询。现有方法多采用单次生成策略,将参考上下文与修改文本融合为统一描述,难以检测或修正语义偏差与遗漏,导致参考属性保留与文本需求整合相互干扰,降低检索精度。为此,我们提出PEC-CIR,一种无训练框架,将查询构建重构为多阶段推理流程。该框架采用规划-执行-批判架构:规划器提取显式约束,执行器生成多个候选目标描述,批判器根据约束合规性评估候选。通过将查询构建转化为分阶段推理而非单次输出,PEC-CIR在检索前显式评估候选查询,减少生成误差传播,从而提升检索稳定性。

原文摘要 · Abstract (English)

Composed image retrieval requires identifying a target image from a gallery by integrating a reference image with a textual modification instruction. In a training-free zero-shot setting, this task relies on constructing a retrieval-oriented textual query within a frozen vision--language embedding space at inference time. Existing approaches predominantly rely on a single-pass generation strategy that fuses the reference context and modification text into a unified description. This strategy makes it difficult to detect or correct semantic distortions and omissions during generation. Consequently, the preservation of reference attributes and the integration of textual requirements interfere with each other, which degrades retrieval precision. To address these challenges, we introduce PEC-CIR, a training-free framework that structures query construction as a multi-stage reasoning pipeline. The framework operates through a Planner--Executor--Critic architecture where the Planner extracts explicit constraints, the Executor generates multiple candidate target descriptions, and the Critic evaluates these candidates based on constraint compliance. By reframing query construction as a staged inference process instead of a single-pass output, PEC-CIR reduces the propagation of generative errors by explicitly evaluating candidate queries before retrieval, thereby improving retrieval stability.

图像检索零样本推理框架文本生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。