通过多智能体协作实现测试时推理增强,提升图像组合检索精度
DeliCIR: Memory-Guided Test-Time Deliberation via Multi-Agent Collaboration for Composed Image Retrieval

- 构建分层多智能体框架,动态分配感知信号生成候选集
- 引入无训练推理经验蒸馏与锦标赛式测试时扩展,提升细粒度推理能力
- 在三个基准数据集上达最新最优,适合细粒度多媒体检索研究者
组合图像检索(CIR)需同时保持参考图像的视觉连续性并准确执行修改文本中的语义变量,这是该任务的核心挑战。现有方法常因单一空间感知局限导致感知盲区,或因底层检索器感知上限引发逻辑漂移。为此,我们提出首个将测试时扩展(TTS)引入CIR的一站式层次化感知-反思框架(PDF)。基于分层多智能体架构,PDF首先由意图路由管理器根据修改意图动态调度多视角工作智能体的感知信号,构建高召回候选池。随后,反思管理器结合无训练推理经验蒸馏机制与锦标赛式测试时扩展策略(T-TTS),实现经验引导的细粒度推理,生成最终检索结果。实验表明,PDF在三个基准数据集(CIRR、CIRCO、Fashion IQ)上均取得最新最优性能。本研究证实,经验驱动的记忆机制与测试时扩展是实现细粒度多媒体检索极具前景且可扩展的路径。代码将在论文录用后公开。
原文摘要 · Abstract (English)
Composed Image Retrieval (CIR) requires both preserving the visual continuity of the reference image and faithfully executing the semantic variables specified in the modification text, which constitute the core challenge of the task. Existing methods often suffer from Perception Myopia in a single space, or fall into Logic Drift in iterative collaboration due to the perception ceiling of the underlying retriever. To address this issue, we propose a one-stop hierarchical Perception-to-Deliberation Framework (PDF), which, to the best of our knowledge, is the first to introduce Test-Time Scaling (TTS) into CIR. Relying on a hierarchical multi-agent architecture, PDF first utilizes an Intent Routing Manager to dynamically dispatch multi-view Worker perception signals based on modification intents to construct a high-recall candidate pool. Subsequently, the Deliberation Manager combines a training-free reasoning experience distillation mechanism with a tournament-style test-time scaling strategy (T-TTS) to perform experience-guided fine-grained reasoning and produce the final retrieval results. Experimental results demonstrate that PDF achieves SOTA performance on three benchmark datasets: CIRR, CIRCO, and Fashion IQ. This study indicates that experience-driven memory mechanism and TTS represent a highly promising and scalable path for achieving fine-grained multimedia retrieval. The code will be made publicly available upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。