arXiv:2605.17365cs.CV2026-05

用记忆模块动态更新对话中用户意图,提升图像检索效率与准确率。

Memory-Augmented Query Intent Understanding for Efficient Chat-based Image Retrieval

论文配图:Memory-Augmented Query Intent Understanding for Efficient Chat-based Image Retrieval
图 1 · 摘自论文原文
  • 引入轻量记忆模块,动态聚合对话中的语义意图
  • 相比基线减少86.4%对话编码计算量,性能显著提升
  • 适合需要高效多轮交互的图像检索系统开发者

与传统文本到图像检索不同,基于对话的图像检索通过多轮交互逐步澄清和细化用户意图,实现更精准的检索结果。其核心挑战在于动态理解并更新跨轮次的用户查询意图。现有方法通常简单地将历史查询拼接为长序列或依赖大模型重构当前查询,导致计算冗余且易产生意图不一致。为此,本文提出一种新型高效的基于记忆的用户意图更新框架——MAQIU。该框架引入轻量级记忆模块,动态聚合并演化对话中的语义意图表示;同时采用记忆召回机制防止意图遗忘,增强长期语义一致性。此外,MAQIU还将历史检索结果作为视觉引导,强化跨轮次关联性,提升当前视觉理解能力。大量实验表明,MAQIU在保持高效率的同时显著提升性能,相较基线ChatIR降低86.4%的对话编码浮点运算量。源代码已公开于https://github.com/HuiGuanLab/MAQIU。

原文摘要 · Abstract (English)

Different from traditional text-to-image retrieval tasks, chat-based image retrieval allows the human-interactive system to iteratively clarify and refine user intent through multi-round dialogue, thereby achieving more fine-grained retrieval results. The key challenge in this task lies in dynamically understanding and updating the user's query intent across dialogue rounds. Although existing works have achieved great performance on this new task, they simply handle history query information either by directly concatenating all previous queries into a long textual sequence or by relying on large language models to reconstruct the current query from history. Such strategies are computationally redundant and easily lead to inconsistent intent representations as the dialogue progresses. To alleviate these issues, this paper proposes a novel and efficient memory-based user intent updating framework for the chat-based image retrieval task, called Memory-Augmented Query Intent Understanding (MAQIU). It introduces a lightweight memorization module that dynamically aggregates and evolves the semantic representation of query intent across dialogues, while a memory recall mechanism is further employed to prevent intent forgetting and enhance long-term semantic integrity. In addition, MAQIU also integrates historical image retrieval results as visual guidance, allowing the model to strengthen cross-round correlations and refine current visual understanding. Extensive experiments demonstrate that MAQIU achieves substantial performance gains while maintaining high computational efficiency, reducing dialogue encoding FLOPs by 86.4\% compared with the prior baseline ChatIR. Source code is available at https://github.com/HuiGuanLab/MAQIU.

图像检索对话系统记忆网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。