文生图安全机制对非标准方言存在偏见,导致误判率高达28.29个百分点。
Not Safe for All: Auditing the Dialect Penalty in Text-to-Image Safety Pipelines
- 基于语言表面特征而非语义意图触发安全过滤
- 五种英语方言中误判率差距达28.29个百分点
- 可通过均衡训练数据缓解,不依赖复杂优化方法
文生图(T2I)安全防护机制在非标准方言上无法公平泛化。我们在五种英语方言中评估了23,080对提示词,首次将此失败形式化为‘方言惩罚’——过滤器因语言表层特征而非语义意图被触发。文本级过滤器表现相反:NSFW-T过度标记良性方言提示,而LatentGuard过度标记有毒内容(偏差差距达+28.29个百分点),OpenAI Moderation API则低估了这些风险。受控拼写错误消融实验表明,该惩罚源于对方言特征的误标,而非一般性分布外敏感性。像素级生成器基本无方言偏好,惩罚发生在文本处理阶段并级联至后置防护。我们发现此偏差与训练数据不平衡相关,通过群体平衡再训练可缓解,且增益主要来自均衡暴露,而非GroupDRO等最坏情况优化目标。当前管道系统性地忽视方言使用者,这种公平性缺失被平均准确率指标掩盖。官方代码与数据集已公开于https://github.com/minguinho26/dialect-penalty-t2i。内容警告:本文包含攻击性、有毒或令人不适的提示词与生成图像。
原文摘要 · Abstract (English)
Text-to-image (T2I) safety guardrails fail to generalize equitably to non-standard dialects. Evaluating 23,080 paired prompts across five English dialects, we formalize this failure as the dialect penalty, where filters trigger based on linguistic surface features rather than semantic intent. Text-level filters fail in opposing directions: NSFW-T over-flags benign dialect prompts and LatentGuard over-flags toxic ones (bias gaps up to +28.29 pp), while the OpenAI Moderation API under-detects them. A controlled typo ablation confirms this penalty originates from flagging dialectal features, not generic out-of-distribution sensitivity. The pixel-level generator is largely dialect-agnostic; the penalty enters at text processing and cascades unevenly to post-hoc guardrails. We show this bias tracks training data imbalance and is mitigable via group-balanced retraining, with an ablation attributing the gain to balanced exposure rather than to the worst-group objective of GroupDRO (group distributionally robust optimization). Current pipelines systematically fail dialect speakers, an equity failure masked by mean accuracy benchmarks. Our official code and dataset are publicly available at https://github.com/minguinho26/dialect-penalty-t2i. Content Warning: This paper contains offensive, toxic, or disturbing text prompts and generated images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。