用大模型模拟用户，提前测试网页设计的可用性。
UXAgent: A System for Simulating Usability Testing of Web Design with LLM Agents
- 用大模型生成虚拟用户角色并自动操作网页
- 可生成交互日志和问卷反馈等多维度数据
- 适合预研网页设计，提升真实测试效率
可用性测试是用户体验研究中评估和迭代新设计的核心方法。但如何评估和优化测试方案本身？我们受大语言模型模拟代理（LLM Agent）研究进展启发，设计了UXAgent系统，帮助用户体验研究者在开展真实人机实验前，评估和迭代研究设计。该系统包含角色生成模块、大模型代理模块和通用浏览器连接器模块，可自动生成数千名模拟用户，并与目标网站进行交互式测试。系统还提供结果查看界面，便于研究者分析代理生成的定性数据（如测试后问卷）和定量数据（如交互日志），甚至可直接对代理进行访谈。通过16位用户体验研究者的启发式评估，参与者高度认可系统的创新性，但也对大模型代理在未来用户体验研究中的应用前景表达了关切。
原文摘要 · Abstract (English)
Usability testing is a fundamental research method that user experience (UX) researchers use to evaluate and iterate their new designs. But what about evaluating and iterating the usability testing study design itself? Recent advances in Large Language Model-simulated Agent (LLM Agent) research inspired us to design UXAgent to support UX researchers in evaluating and iterating their study design before they conduct the real human-subject study. Our system features a Persona Generator module, an LLM Agent module, and a Universal Browser Connector module to automatically generate thousands of simulated users and to interactively test the target website. The system also provides a Result Viewer Interface so that the UX researchers can easily review and analyze the generated qualitative (e.g., agents' post-study surveys) and quantitative data (e.g., agents' interaction logs), or even interview agents directly. Through a heuristic evaluation with 16 UX researchers, participants praised the innovation of our system but also expressed concerns about the future of LLM Agent usage in UX studies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。