arXiv:2605.06619cs.CLcs.CY2026-05被引 1

研究算法话术如何在避免检测和保持可读性间权衡,揭示其背后的语言演化规律。

Algospeak, Hiding in the Open: The Trade-off Between Legible Meaning and Detection Avoidance

论文配图:Algospeak, Hiding in the Open: The Trade-off Between Legible Meaning and Detection Avoidance
图 1 · 摘自论文原文
  • 提出'多数可理解调制'概念,量化逃避与可读性的平衡点。
  • 构建700条新冠虚假信息的可调节变体数据集,验证不同策略效果。
  • 提供可复现框架与评估方法,适合内容安全与语言模型研究者使用。

随着大语言模型在内容生成与审核中扮演越来越重要的角色,名为‘算法话术’(Algospeak)的语言规避策略加剧了规避者与检测器之间的动态博弈。本研究基于联合行动模型,形式化了这一机制:当算法话术增强时,检测率与可理解性均下降。引入‘多数可理解调制’(MUM)概念,定义为在该水平之上,进一步规避虽能降低被检测概率,却导致多数接收者难以理解。为实证检验此权衡,提出一个可复现的框架,基于现有分类体系,生成语义保留、可调变程度的算法话术变体。以新冠疫情虚假信息为例,构建包含20个基础句子、5个调制层级、7种策略的700条参考数据集。对7个语言模型进行两项关联评估:一项测试意义恢复能力,另一项测试虚假信息检测性能。通过调制层级的曲线拟合,估算出MUM阈值,并开展跨策略与模型的敏感性分析。结果揭示了可理解性与调制强度间的典型关系。本研究为理解算法话术动态提供了基础,同时贡献了框架、数据集与实验设置。

原文摘要 · Abstract (English)

As large language models (LLMs) increasingly mediate both content generation and moderation, linguistic evasion strategies known as Algospeak have intensified the coevolution between evaders and detectors. This research formalizes the underlying dynamics grounded in a joint action model: when Algospeak increases, detectability and understandability decrease. Further, the concept of Majority Understandable Modulation (MUM) is introduced and defined as the modulation level at which additional evasive alteration increases detector evasion but loses comprehension for the majority of recipients. To empirically probe this trade-off, we introduce a reproducible framework that can be used to create meaning-preserving, Algospeak-style variants, based on an existing taxonomy and with tunable modulation levels. Using COVID-19 disinformation as a first proof-by-example setting, we construct a reference dataset of 700 modulated items, drawn from twenty base sentences across five modulation levels and seven strategies. We then run two linked evaluations with seven different language models: one testing for interpretation through meaning recovery and one for disinformation detection through classification. Curve fitting over modulation levels yields an estimate of the Majority Understandable Modulation threshold and enables sensitivity analyses across strategies and models, see Figure 1. Results reveal the characteristic relationships between understandability and modulation. This study lays the groundwork for understanding the dynamics behind Algospeak and provides the framework, dataset, and experimental setups described.

算法话术内容安全大模型虚假信息

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。