轻量级心理辅导大模型PsyLite,安全高效且适合低配设备部署。
PsyLite Technical Report
- 两阶段训练提升推理与心理辅导能力,结合条件RAG增强对话趣味性。
- 心理辅导专业度提升47.6%,对话安全性得分提高2.4,优于基线模型。
- 支持5GB内存运行,适合移动端或资源受限场景使用。
随着数字技术快速发展,人工智能驱动的心理咨询逐渐成为心理健康领域的重要研究方向。然而,现有模型在对话安全、场景处理细致度和轻量化部署方面仍存在不足。为此,本研究基于InternLM2.5-7B-chat模型提出PsyLite,一个轻量级心理辅导大语言模型代理。通过混合蒸馏数据微调与ORPO偏好优化的两阶段训练策略,显著提升模型的深度推理、心理辅导能力及对话安全性。部署采用Ollama与Open WebUI,结合Pipelines构建自定义工作流。创新设计条件RAG机制,在适当时机引入对话幽默元素以提升用户体验,并有效降低危险请求响应。评估结果显示,PsyLite在中文通用评测(CEval)、心理辅导专业评测(CPsyCounE)和对话安全评测(SafeDialBench)中均优于基线模型,尤其在心理辅导专业度上提升47.6%,对话安全得分提高2.4。此外,通过量化技术(GGUF q4_k_m)实现低硬件需求部署,仅需5GB内存即可运行,为资源受限环境下的心理咨询服务提供可行方案。
原文摘要 · Abstract (English)
With the rapid development of digital technology, AI-driven psychological counseling has gradually become an important research direction in the field of mental health. However, existing models still have deficiencies in dialogue safety, detailed scenario handling, and lightweight deployment. To address these issues, this study proposes PsyLite, a lightweight psychological counseling large language model agent developed based on the base model InternLM2.5-7B-chat. Through a two-stage training strategy (hybrid distillation data fine-tuning and ORPO preference optimization), PsyLite enhances the model's deep-reasoning ability, psychological counseling ability, and safe dialogue ability. After deployment using Ollama and Open WebUI, a custom workflow is created with Pipelines. An innovative conditional RAG is designed to introduce crosstalk humor elements at appropriate times during psychological counseling to enhance user experience and decline dangerous requests to strengthen dialogue safety. Evaluations show that PsyLite outperforms the baseline models in the Chinese general evaluation (CEval), psychological counseling professional evaluation (CPsyCounE), and dialogue safety evaluation (SafeDialBench), particularly in psychological counseling professionalism (CPsyCounE score improvement of 47.6\%) and dialogue safety (\safe{} score improvement of 2.4\%). Additionally, the model uses quantization technology (GGUF q4\_k\_m) to achieve low hardware deployment (5GB memory is sufficient for operation), providing a feasible solution for psychological counseling applications in resource-constrained environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。