arXiv:2602.10295cs.HCcs.AI2026-02

ECHO平台让研究者轻松开展人机交互实验,支持聊天与搜索双重场景。

ECHO: An Open Research Platform for Evaluation of Chat, Human Behavior, and Outcomes

  • 统一框架整合问卷、对话、搜索、写作任务等全流程实验
  • 记录细粒度交互数据,支持可复现的人类行为研究
  • 适合信息检索、人机交互、社会科学等领域研究者使用

ECHO(聊天、人类行为与结果评估)是一个开放研究平台,旨在支持可复现的混合方法研究,探索人类与对话式AI系统及网络搜索引擎的互动。该平台使不同学科的研究者能够在低代码环境下,协调端到端的实验流程,包括同意书与背景调查、基于聊天和搜索的信息获取会话、写作或判断任务,以及任务前后的评估。ECHO记录细粒度交互轨迹和参与者响应,并导出结构化数据集用于后续分析。通过同时支持聊天与搜索,并提供灵活的评估工具,ECHO降低了跨信息获取范式下学习、决策与用户体验研究的技术门槛,助力信息检索、人机交互及社会科学领域的研究者开展可扩展且可复现的人中心AI评估。

原文摘要 · Abstract (English)

ECHO (Evaluation of Chat, Human behavior, and Outcomes) is an open research platform designed to support reproducible, mixed-method studies of human interaction with both conversational AI systems and Web search engines. It enables researchers from varying disciplines to orchestrate end-to-end experimental workflows that integrate consent and background surveys, chat-based and search-based information-seeking sessions, writing or judgment tasks, and pre- and post-task evaluations within a unified, low-coding-load framework. ECHO logs fine-grained interaction traces and participant responses, and exports structured datasets for downstream analysis. By supporting both chat and search alongside flexible evaluation instruments, ECHO lowers technical barriers for studying learning, decision making, and user experience across different information access paradigms, empowering researchers from information retrieval, HCI, and the social sciences to conduct scalable and reproducible human-centered AI evaluations.

人机交互实验平台可复现研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。