arXiv:2602.08274cs.CLcs.AI2026-02

通过拆解句子改写类型,让模型更精准理解语义相似性。

Language Modeling and Understanding Through Paraphrase Generation and Detection

  • 将改写分解为词汇、句法等具体语言层面,提升语义理解粒度
  • 在抄袭检测中达到89.6%准确率,超越人类专家的78.4%
  • 适合需要细粒度语义匹配的场景,如问答去重与学术查重

语言使人类能够共享知识、推理世界并传递生存与创新策略。其核心不仅在于沟通能力,更在于表达的极大灵活性——同一思想可用无数词句和结构表述,这种能力称为改写。建模改写是计算语言模型理解意义的关键;能生成或判断不同文本是否传达相同含义,体现强大的语义理解能力。若计算模型要表征意义,就必须在细微层面区分哪些因素维持原意、哪些导致歧义。然而现有方法多将改写简化为二元判断或单一重写,掩盖了决定语义保持的言语因素。本文提出:将改写分解为构成性语言层面(改写类型),可提供更精细且符合认知规律的语义等价视角。研究显示,即使先进模型也难以完成此任务。但当模型显式学习改写类型后,在相关改写任务及下游应用中表现显著提升。例如,在维基百科抄袭检测中,模型准确率达89.6%,优于人类基准(78.4%);在arXiv科学论文抄袭检测中,达66.5%,超过人类55.7%。在Quora重复问题识别任务中,基于改写类型训练的模型亦优于仅使用二元对训练的模型。

原文摘要 · Abstract (English)

Language enables humans to share knowledge, reason about the world, and pass on strategies for survival and innovation across generations. At the heart of this process is not just the ability to communicate but also the remarkable flexibility in how we can express ourselves. We can express the same thoughts in virtually infinite ways using different words and structures - this ability to rephrase and reformulate expressions is known as paraphrase. Modeling paraphrases is a keystone to meaning in computational language models; being able to construct different variations of texts that convey the same meaning or not shows strong abilities of semantic understanding. If computational language models are to represent meaning, they must understand and control the different aspects that construct the same meaning as opposed to different meanings at a fine granularity. Yet most existing approaches reduce paraphrasing to a binary decision between two texts or to producing a single rewrite of a source, obscuring which linguistic factors are responsible for meaning preservation. In this thesis, I propose that decomposing paraphrases into their constituent linguistic aspects (paraphrase types) offers a more fine-grained and cognitively grounded view of semantic equivalence. I show that even advanced machine learning models struggle with this task. Yet, when explicitly trained on paraphrase types, models achieve stronger performance on related paraphrase tasks and downstream applications. For example, in plagiarism detection, language models trained on paraphrase types surpass human baselines: 89.6% accuracy compared to 78.4% for plagiarism cases from Wikipedia, and 66.5% compared to 55.7% for plagiarism of scientific papers from arXiv. In identifying duplicate questions on Quora, models trained with paraphrase types improve over models trained on binary pairs. Furthermore, I demonstrate that...

语义理解改写生成抄袭检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。