arXiv:2501.04410cs.AIcs.HC2025-01被引 24

用生成式AI模拟用户行为,助力AI系统训练与评估。

User Simulation in the Era of Generative AI: User Modeling, Synthetic Data Generation, and System Evaluation

  • 构建能模仿人类交互的智能代理,实现可控仿真。
  • 生成高质量合成数据,支持训练与评估闭环。
  • 适合研究人机交互、AI安全与个性化系统的团队。

用户模拟是生成式AI时代的一个新兴跨学科领域,涉及创建能够模仿人类用户与AI系统交互的智能体,以建模和分析用户行为、生成用于训练的合成数据,并在可控、可复现的环境中评估交互式AI系统。由于其广泛的应用范围,相关研究目前分散于人工智能、人机交互、信息科学、计算社会科学和心理学等多个领域。为解决当前研究的碎片化问题,本文提出一项基础性综合工作:强调从传统预测模型到现代生成式方法的范式转变,明确指出伦理考量——可控模拟不仅是偏见的风险来源,更可作为主动保障公平代表性和系统安全的强大工具。此外,本文建立用户模拟与通用人工智能追求之间的理论联系,认为真实模拟器是克服关键数据与评估瓶颈、优化个性化的不可或缺催化剂。最终,提出一个连接学术界与产业界的可持续创新生态,推动该技术持续发展。

原文摘要 · Abstract (English)

User simulation is an emerging interdisciplinary topic with multiple critical applications in the era of Generative AI. It involves creating an intelligent agent that mimics the actions of a human user interacting with an AI system, enabling researchers to model and analyze user behaviour, generate synthetic data for training, and evaluate interactive AI systems in a controlled and reproducible manner. Because of its broad scope, research on this topic currently remains scattered across artificial intelligence, human-computer interaction, information science, computational social science, and psychology. To address this fragmented landscape of current research, this article presents a foundational synthesis. We highlight the paradigm shift from traditional predictive models to modern generative approaches, and explicitly frame critical ethical considerations -- demonstrating how controlled simulation serves not merely as a risk vector for bias, but as a powerful, proactive tool to ensure fair representation and system safety. Furthermore, we establish the theoretical connection between user simulation and the pursuit of Artificial General Intelligence, arguing that realistic simulators are indispensable catalysts for overcoming critical data and evaluation bottlenecks and optimizing personalization. Ultimately, we propose a practical, self-sustaining innovation ecosystem bridging academia and industry to advance this increasingly important technology.

用户模拟生成式AI人机交互合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。