让AI心理咨询师像人一样通过经验持续进化
PsychAgent: An Experience-Driven Lifelong Learning Agent for Self-Evolving Psychological Counselor

- 用记忆增强规划引擎保持长程咨询连续性
- 从过往咨询中提取新技能并自我更新
- 适合需要长期陪伴式心理服务的场景
现有AI心理咨询方法主要依赖静态对话数据集进行监督微调,与人类专家通过临床实践持续提升能力的方式不符。为此,我们提出体验驱动的终身学习代理(PsychAgent)用于心理辅导。首先,构建面向长期多轮交互的记忆增强规划引擎,通过持久记忆与策略规划保障治疗连续性;其次,设计技能演化引擎,从历史咨询轨迹中提取基于实践的新技能;最后,引入强化内化引擎,通过拒绝微调将演化后的技能融入模型,以提升在多样场景下的表现。对比分析显示,该方法在所有评估维度上均优于强基准大模型(如GPT-5.4、Gemini-3)及领域专用基线。结果表明,终身学习能有效提升多轮咨询响应的一致性与整体质量。
原文摘要 · Abstract (English)
Existing methods for AI psychological counselors predominantly rely on supervised fine-tuning using static dialogue datasets. However, this contrasts with human experts, who continuously refine their proficiency through clinical practice and accumulated experience. To bridge this gap, we propose an Experience-Driven Lifelong Learning Agent (\texttt{PsychAgent}) for psychological counseling. First, we establish a Memory-Augmented Planning Engine tailored for longitudinal multi-session interactions, which ensures therapeutic continuity through persistent memory and strategic planning. Second, to support self-evolution, we design a Skill Evolution Engine that extracts new practice-grounded skills from historical counseling trajectories. Finally, we introduce a Reinforced Internalization Engine that integrates the evolved skills into the model via rejection fine-tuning, aiming to improve performance across diverse scenarios. Comparative analysis shows that our approach achieves higher scores than strong general LLMs (e.g., GPT-5.4, Gemini-3) and domain-specific baselines across all reported evaluation dimensions. These results suggest that lifelong learning can improve the consistency and overall quality of multi-session counseling responses.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。