arXiv:2510.15061cs.LGcs.CL2025-10被引 2

解决大模型生成文本重复问题,让AI输出更自然。

Antislop: A Comprehensive Framework for Identifying and Eliminating Repetitive Patterns in Language Models

  • 用回溯法在推理时抑制重复短语,不破坏词汇库。
  • 可识别并消除超1000倍于人类的重复模式,减少90%以上。
  • 适合关注生成质量、避免机械重复的研究者和开发者。

大模型广泛应用带来了称为「slop」的重复性表达,严重影响输出质量且易被识别。本文提出Antislop框架,包含三项创新:(1) Antislop Sampler利用回溯法在推理时抑制不良字符串,不破坏词汇;(2) 自动化流水线对比模型与人类文本,生成训练数据;(3) 最终标记偏好优化(FTPO),对单个标记进行精细调整,针对推理中出现的禁用模式修改logits。实验显示,部分slop模式在大模型输出中频率超过人类文本1000倍以上。Antislop Sampler成功抑制8000+模式,而传统标记方法在2000个时已不可用。最重要的是,FTPO实现90% sloop减少,同时在GSM8K、MMLU及创意写作任务中保持或提升性能。相比之下,DPO虽抑制较弱,但显著降低写作质量和词汇多样性。代码与结果已开源,MIT许可:https://github.com/sam-paech/auto-antislop。

原文摘要 · Abstract (English)

Widespread LLM adoption has introduced characteristic repetitive phraseology, termed "slop," which degrades output quality and makes AI-generated text immediately recognizable. We present Antislop, a comprehensive framework providing tools to both detect and eliminate these overused patterns. Our approach combines three innovations: (1) The Antislop Sampler, which uses backtracking to suppress unwanted strings at inference time without destroying vocabulary; (2) An automated pipeline that profiles model-specific slop against human baselines and generates training data; (3) Final Token Preference Optimization (FTPO), a novel fine-tuning method that operates on individual tokens, surgically adjusting logits wherever a banned pattern has appeared in an inference trace. We demonstrate that some slop patterns appear over 1,000x more frequently in LLM output than human text. The Antislop Sampler successfully suppresses 8,000+ patterns while maintaining quality, whereas token banning becomes unusable at just 2,000. Most importantly, FTPO achieves 90% slop reduction while maintaining or improving performance in cross-domain evals including GSM8K, MMLU, and creative writing tasks. In contrast, DPO suffers significant degradation in writing quality and lexical diversity despite achieving weaker suppression. We release all code and results under MIT license: https://github.com/sam-paech/auto-antislop.

语言模型重复生成文本优化推理改进

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。