arXiv:2509.04303cs.HCcs.AI2025-09被引 2

用强化学习实现对话机器人实时个性化,根据用户行为动态调整回应风格。

HumAIne-Chatbot: Real-Time Personalized Conversational AI via Reinforcement Learning

  • 通过虚拟人格预训练建立用户类型先验,结合实时行为信号动态更新用户画像。
  • 在50个合成人物上测试,启用个性化后用户满意度、匹配准确率和任务完成度均显著提升。
  • 适合需要高互动性与定制化服务的场景,如心理陪伴、教育辅导等应用。

当前对话AI系统常提供通用化、千篇一律的交互,忽视个体差异且缺乏自适应对话管理。为弥补这一空白,我们提出 extbf{HumAIne-chatbot},一种基于新型用户画像框架的对话代理。系统在多样GPT生成的虚拟人格上进行预训练,建立广泛的用户类型先验。在实际对话中,一个在线强化学习代理结合隐式信号(如打字速度、情绪倾向、参与时长)与显式反馈(如点赞或否定),持续优化每个用户的模型。该画像动态影响聊天机器人的对话策略,实现内容与风格的实时适配。为评估系统,我们在多个对话领域对50个合成人格进行了受控实验。结果显示,启用个性化功能后,用户满意度、个性化准确率及任务完成度均有稳定提升。统计分析证实个性化与非个性化条件间存在显著差异,关键指标效应量较大。这些发现验证了人工智能驱动用户画像的有效性,并为未来真实世界验证奠定了坚实基础。

原文摘要 · Abstract (English)

Current conversational AI systems often provide generic, one-size-fits-all interactions that overlook individual user characteristics and lack adaptive dialogue management. To address this gap, we introduce \textbf{HumAIne-chatbot}, an AI-driven conversational agent that personalizes responses through a novel user profiling framework. The system is pre-trained on a diverse set of GPT-generated virtual personas to establish a broad prior over user types. During live interactions, an online reinforcement learning agent refines per-user models by combining implicit signals (e.g. typing speed, sentiment, engagement duration) with explicit feedback (e.g., likes and dislikes). This profile dynamically informs the chatbot dialogue policy, enabling real-time adaptation of both content and style. To evaluate the system, we performed controlled experiments with 50 synthetic personas in multiple conversation domains. The results showed consistent improvements in user satisfaction, personalization accuracy, and task achievement when personalization features were enabled. Statistical analysis confirmed significant differences between personalized and nonpersonalized conditions, with large effect sizes across key metrics. These findings highlight the effectiveness of AI-driven user profiling and provide a strong foundation for future real-world validation.

对话系统个性化强化学习用户建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。