arXiv:2606.15396cs.CLcs.AI2026-06

针对中文大模型安全风险,构建细粒度分类体系与可扩展数据管道。

CHILLGuard: Towards Fine-Grained Chinese LLM Safety Guardrail with Scalable Data Construction and Model-aware Preference Alignment

论文配图:CHILLGuard: Towards Fine-Grained Chinese LLM Safety Guardrail with Scalable Data Construction and Model-aware Preference Alignment
图 1 · 摘自论文原文
  • 设计5大类31小类中文安全风险分类体系,适配政策与文化语境。
  • 构建40.5万样本训练集与5.17万样本测试集,提升识别准确率。
  • 适用于需要精准内容管控的中文AI产品开发与合规部署。

大型语言模型生成的恶意内容可能带来严重安全风险与伦理问题。现有安全防护机制在英文或多语种场景表现良好,但难以适应中文特有的监管政策、文化背景和语言特征,无法实现多样部署需求下的细粒度风险分类。本文提出一个包含5个宏观类别、31个微观类别的中文场景细粒度风险分类体系,并构建专用于中文大模型内容安全的防护系统CHILLGuard。为解决高质量中文安全标注数据稀缺问题,提出可扩展的多阶段数据构建流程:通过检索增强生成扩充多源语料,利用提示工程重写生成隐性有害样本,并采用多模型投票机制进行标签校准以提升数据质量。基于此,构建了包含405,007个样本的CHILLGuardTrain训练集和51,745个样本的严格标注测试集CHILLGuardTest。在生成器-分类器协同框架下,采用模型感知的直接偏好优化方法训练CHILLGuard。多项实验表明其性能达到当前最优水平,例如在基准测试中相比Qwen3Guard-8B-Strict的F1分数提升15.92%。相关资源将开源发布于https://github.com/cswbyu/CHILLGuard。

原文摘要 · Abstract (English)

Malicious content generated from large language models (LLMs) could pose severe safety risks and ethical concerns. While existing LLM safety guardrails excel in English or multilingual settings, they lack adaptation to Chinese-specific regulatory policies, cultural context and linguistic nuances, failing to support fine-grained risk classification for diverse deployment needs. In this paper, we introduce a 5-macro, 31-micro category fine-grained risk taxonomy for Chinese scenarios, and build CHILLGuard: a dedicated Chinese LLM content safety guardrail. To address the critical scarcity of high-quality annotated Chinese safety data, we propose a scalable multi-stage data construction pipeline: we expand multi-source corpus via retrieval-augmented generation, generate implicit harmful samples through prompt engineering rewriting, and refine high-quality data via multi-model voting-based label calibration. Based on this, we build CHILLGuardTrain, a large-scale training set with 405,007 samples, and CHILLGuardTest, a rigorously curated annotated test set with 51,745 samples. We then train CHILLGuard on CHILLGuardTrain under a generator-classifier collaborative framework via Model-aware Direct Preference Optimization. Extensive experiments under multiple settings demonstrate the state-of-the-art performance of CHILLGuard, e.g., a 15.92% improvement of F1 score over Qwen3Guard-8B-Strict on our benchmark. We will release our resources at https://github.com/cswbyu/CHILLGuard.

大模型安全中文LLM风险分类数据构建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。