RedOne让大模型更懂社交平台,通用性提升14%以上
RedOne: Revealing Domain-specific LLM Post-Training in Social Networking Services
- 三阶段训练:持续预训练+监督微调+偏好优化
- 8个任务平均提升14.02%,双语评测提升7.56%
- 适合社交平台内容管理与真实场景部署
作为现代信息传播的主要媒介,社交网络服务(SNS)快速发展,对平台内容管理与互动质量提出挑战。尽管大语言模型(LLM)提供了潜在解决方案,但现有研究多聚焦单一任务,不仅受限于数据规模的边际效益,也难以灵活适应多样现实场景。为此,我们提出RedOne,一个面向SNS的领域专用大模型,采用三阶段训练策略(持续预训练、监督微调、偏好优化),基于大规模真实世界数据构建。大量实验表明,RedOne在8项主要SNS任务上平均性能提升14.02%,在SNS双语评估基准上提升7.56%。线上测试显示,其有害内容曝光率降低11.23%,帖子浏览搜索点击率提升14.95%,显著优于单任务微调基线模型。结果验证了RedOne在多种任务上的强泛化能力,具备实际应用潜力。
原文摘要 · Abstract (English)
As a primary medium for modern information dissemination, social networking services (SNS) have experienced rapid growth, which has proposed significant challenges for platform content management and interaction quality improvement. Recently, the development of large language models (LLMs) has offered potential solutions but existing studies focus on isolated tasks, which not only encounter diminishing benefit from the data scaling within individual scenarios but also fail to flexibly adapt to diverse real-world context. To address these challenges, we introduce RedOne, a domain-specific LLM designed to break the performance bottleneck of single-task baselines and establish a comprehensive foundation for the SNS. RedOne was developed through a three-stage training strategy consisting of continue pretraining, supervised fine-tuning, and preference optimization, using a large-scale real-world dataset. Through extensive experiments, RedOne maintains strong general capabilities, and achieves an average improvement up to 14.02% across 8 major SNS tasks and 7.56% in SNS bilingual evaluation benchmark, compared with base models. Furthermore, through online testing, RedOne reduced the exposure rate in harmful content detection by 11.23% and improved the click page rate in post-view search by 14.95% compared with single-tasks finetuned baseline models. These results establish RedOne as a robust domain-specific LLM for SNS, demonstrating excellent generalization across various tasks and promising applicability in real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。