arXiv:2505.14680cs.IRcs.AI2025-05被引 5

让生成式搜索重新获得细粒度反馈,实现持续优化。

NExT-Search: Rebuilding User Feedback Ecosystem for Generative AI Search

  • 引入用户干预与代理模拟双模式,获取过程级反馈
  • 支持在线实时优化和离线模型迭代,提升各环节性能
  • 适合关注AI搜索可持续演进的研究者与产品设计者

生成式AI搜索通过端到端回答复杂问题,减少了用户手动浏览和总结网页的需求。然而,这一范式削弱了传统网络搜索中由用户反馈驱动的改进循环。传统搜索可收集大规模、细粒度的文档级反馈(如点击、停留时间),而生成式搜索流程长,涵盖查询分解、文档检索和答案生成,通常仅接收最终答案的粗粒度反馈,导致反馈信号难以映射到具体组件,阻碍中间阶段优化。本文提出NExT-Search,一种下一代生成式搜索范式,旨在重建细粒度、过程级反馈机制。其包含两种互补模式:用户调试模式允许用户在关键阶段介入;影子用户模式则通过个性化用户代理模拟偏好,为低交互用户生成辅助反馈。这些反馈可用于在线自适应,实时优化当前输出;也可通过离线更新,聚合交互日志定期微调查询分解、检索与生成模型。通过恢复人类对生成式搜索关键环节的控制,我们相信NExT-Search为构建持续进化、反馈丰富的AI搜索系统提供了可行方向。

原文摘要 · Abstract (English)

Generative AI search is reshaping information retrieval by offering end-to-end answers to complex queries, reducing users' reliance on manually browsing and summarizing multiple web pages. However, while this paradigm enhances convenience, it disrupts the feedback-driven improvement loop that has historically powered the evolution of traditional Web search. Web search can continuously improve their ranking models by collecting large-scale, fine-grained user feedback (e.g., clicks, dwell time) at the document level. In contrast, generative AI search operates through a much longer search pipeline, spanning query decomposition, document retrieval, and answer generation, yet typically receives only coarse-grained feedback on the final answer. This introduces a feedback loop disconnect, where user feedback for the final output cannot be effectively mapped back to specific system components, making it difficult to improve each intermediate stage and sustain the feedback loop. In this paper, we envision NExT-Search, a next-generation paradigm designed to reintroduce fine-grained, process-level feedback into generative AI search. NExT-Search integrates two complementary modes: User Debug Mode, which allows engaged users to intervene at key stages; and Shadow User Mode, where a personalized user agent simulates user preferences and provides AI-assisted feedback for less interactive users. Furthermore, we envision how these feedback signals can be leveraged through online adaptation, which refines current search outputs in real-time, and offline update, which aggregates interaction logs to periodically fine-tune query decomposition, retrieval, and generation models. By restoring human control over key stages of the generative AI search pipeline, we believe NExT-Search offers a promising direction for building feedback-rich AI search systems that can evolve continuously alongside human feedback.

生成式搜索用户反馈AI优化人机交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。