搭建无代码平台，对比大模型搜索与智能代理的信息交互体验
From SERPs to Agents: A Platform for Comparative Studies of Information Interaction
- 通过可视化仪表板实现无需编码的实验配置
- 在真实用户研究中验证RAG与自主代理的行为差异
- 适合关注人机交互、信息检索的研究者使用
信息获取系统从传统检索到自主代理的多样化发展，亟需开展对比性用户研究。然而，部署和管理不同系统的技术门槛成为主要障碍。我们提出UXLab——一个开源的基于网页的用户研究平台，其核心是一个无需编码的可视化仪表板，支持复杂实验设计的全流程配置。研究人员可直观管理从参与者招募到后端系统（如传统搜索、向量数据库、大语言模型）对比的全过程。通过一个微型案例研究，我们展示了UXLab在比较RAG与自主代理用户行为方面的价值。该平台使研究者能聚焦于实验设计与分析，为未来的多模态交互研究提供支持。
原文摘要 · Abstract (English)
The diversification of information access systems, from RAG to autonomous agents, creates a critical need for comparative user studies. However, the technical overhead to deploy and manage these distinct systems is a major barrier. We present UXLab, an open-source system for web-based user studies that addresses this challenge. Its core is a web-based dashboard enabling the complete, no-code configuration of complex experimental designs. Researchers can visually manage the full study, from recruitment to comparing backends like traditional search, vector databases, and LLMs. We demonstrate UXLab's value via a micro case study comparing user behavior with RAG versus an autonomous agent. UXLab allows researchers to focus on experimental design and analysis, supporting future multi-modal interaction research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。