arXiv:2602.23636cs.LGcs.AI2026-02ACL被引 6

提出可动态适应审查严格度的连续风险评分系统,提升大模型内容审核稳定性。

FlexGuard: Continuous Risk Scoring for Strictness-Adaptive LLM Content Moderation

  • 用连续风险分代替固定二分类,支持不同平台严格度需求
  • 在多个严格度下测试显示现有模型性能波动大,而新方法更稳定
  • 通过风险对齐训练与阈值策略,实现部署时灵活适配

确保大模型生成内容的安全性对实际应用至关重要。现有防护模型多将审核任务设为固定二分类,隐含假设有害性定义不变。但实践中,不同平台及时间的审查严格度存在差异,导致二分类模型在要求变化时表现脆弱。为此,我们提出 FlexBench——一个支持多严格度控制评估的适配型大模型审核基准。实验表明,现有模型在不同严格度下性能不一致:高表现可能伴随严重退化,限制实用性。针对此问题,我们提出 FlexGuard,一种基于大模型的审核系统,输出校准后的连续风险分数,反映风险严重程度,并通过阈值设定支持特定严格度决策。通过风险对齐优化训练提升分数与严重性的一致性,并提供实用阈值选择策略以适配部署时的目标严格度。在 FlexBench 和公开基准上的实验表明,FlexGuard 在多种严格度下均实现更高准确率和显著更强的鲁棒性。源代码与数据已开源,支持复现。

原文摘要 · Abstract (English)

Ensuring the safety of LLM-generated content is essential for real-world deployment. Most existing guardrail models formulate moderation as a fixed binary classification task, implicitly assuming a fixed definition of harmfulness. In practice, enforcement strictness - how conservatively harmfulness is defined and enforced - varies across platforms and evolves over time, making binary moderators brittle under shifting requirements. We first introduce FlexBench, a strictness-adaptive LLM moderation benchmark that enables controlled evaluation under multiple strictness regimes. Experiments on FlexBench reveal substantial cross-strictness inconsistency in existing moderators: models that perform well under one regime can degrade substantially under others, limiting their practical usability. To address this, we propose FlexGuard, an LLM-based moderator that outputs a calibrated continuous risk score reflecting risk severity and supports strictness-specific decisions via thresholding. We train FlexGuard via risk-alignment optimization to improve score-severity consistency and provide practical threshold selection strategies to adapt to target strictness at deployment. Experiments on FlexBench and public benchmarks demonstrate that FlexGuard achieves higher moderation accuracy and substantially improved robustness under varying strictness. We release the source code and data to support reproducibility.

内容审核风险评分大模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。