arXiv:2603.01059cs.CL2026-03被引 1

GroupGPT让群聊助手更省 token 且更隐私,自动判断何时介入对话。

GroupGPT: A Token-efficient and Privacy-preserving Agentic Framework for Multi-User Chat Assistant

  • 分拆决策与回复生成,边缘设备处理敏感信息,减少云端计算。
  • 在2500段群聊数据上测试,响应准确率平均4.72/5.0,比基线少用3倍token。
  • 适合需要低延迟、高隐私的多用户实时协作场景,支持图文语音输入。

大语言模型(LLMs)推动了聊天机器人的发展,但现有系统多聚焦单用户场景,难以应对复杂多用户群聊中的动态交互。传统方法将决策与回复全交由LLM处理,导致高token消耗、可扩展性差及隐私风险。为此,我们提出GroupGPT,一种面向多用户聊天助手的轻量高效、隐私保护的智能体框架。该框架采用边云协同架构,分离干预时机判断与回复生成,实现精准决策并保障隐私——敏感信息在本地处理,仅传输非敏感内容。系统支持图片、视频、语音等多模态输入。为评估干预时机准确性与回复质量,我们构建了包含2500个标注群聊片段的MUIR基准数据集,涵盖干预标签与推理理由。实验表明,GroupGPT在各类模型(开源与闭源,含小型模型)上均表现优异,平均评分4.72/5.0,用户反馈良好;相比基线,其token消耗降低最多达3倍,同时实现用户消息的隐私净化。代码已开源:https://github.com/Eliot-Shen/GroupGPT。

原文摘要 · Abstract (English)

Recent advances in large language models (LLMs) have enabled increasingly capable chatbots. However, most existing systems focus on single-user settings and do not generalize well to multi-user group chat interactions, where agents require more proactive and accurate intervention under complex, evolving contexts. Existing approaches typically rely on LLMs for both intervention reasoning and response generation, leading to high token consumption, limited scalability, and potential privacy risks. To address these challenges, we propose GroupGPT, a token-efficient and privacy-preserving agentic framework for multi-user chat assistant. GroupGPT adopts an edge-cloud model collaboration architecture to decouple intervention timing from response generation, enabling efficient and accurate decision-making while preserving user privacy through on-device processing of sensitive information. The framework also supports multimodal inputs, including memes, images, videos, and voice messages.To support evaluation of timing accuracy and response quality, we further introduce MUIR, a benchmark dataset for multi-user chat assistant intervention reasoning. MUIR contains 2,500 annotated group chat segments with intervention labels and rationales. We evaluate a range of models on MUIR, spanning from open-source to proprietary variants, including both LLMs and their smaller counterparts. Extensive experiments demonstrate that GroupGPT generates accurate and well-timed responses, achieving an average score of 4.72/5.0 in LLM-based evaluation, and is well-received by users across diverse group chat scenarios. Moreover, GroupGPT reduces the token usage by up to 3 times compared to baselines, while providing privacy sanitization of user messages before cloud transmission. Code is available at: https://github.com/Eliot-Shen/GroupGPT .

群聊助手隐私保护轻量化多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。