arXiv:2508.00675cs.CL2025-08被引 1

用序列句子对分类器检测文档中写作风格变化,精准定位每句风格转折。

Team "better_call_claude": Style Change Detection using a Sequential Sentence Pair Classifier

  • 将句子序列整体建模,用预训练模型+双向LSTM捕捉上下文语义。
  • 在易、中、难三数据集上宏平均F1达0.923、0.828、0.724,优于基线和Claude-3.7。
  • 特别擅长处理短而风格浅的句子,适合细粒度风格分析任务。

风格变化检测——识别文档中写作风格转变的位置——是计算作者分析中最重要且最具挑战性的问题之一。在PAN 2025共享任务中,参赛者需以最细粒度级别(单句)检测风格切换。该任务涵盖三个数据集,每个数据集在文档内逐步增加主题多样性。本文提出一种序列句子对分类器(SSPC),将问题实例(一系列句子)视为整体进行建模。通过预训练语言模型(PLM)获取单句表示,再输入双向LSTM(BiLSTM)以在文档上下文中进行语义增强。相邻句子的BiLSTM向量拼接后输入多层感知机进行逐对预测。基于以往参与者的工作,该方法相对保守且轻量。然而,其有效利用了上下文信息,解决了今年任务中最棘手的难点:基准数据中普遍存在“风格浅”的短句。在官方PAN-2025测试集上,模型在EASY、MEDIUM、HARD数据集上的宏平均F1分别为0.923、0.828、0.724,不仅超过官方随机基线,也优于更具挑战性的Claude-3.7-sonnet零样本表现。

原文摘要 · Abstract (English)

Style change detection - identifying the points in a document where writing style shifts - remains one of the most important and challenging problems in computational authorship analysis. At PAN 2025, the shared task challenges participants to detect style switches at the most fine-grained level: individual sentences. The task spans three datasets, each designed with controlled and increasing thematic variety within documents. We propose to address this problem by modeling the content of each problem instance - that is, a series of sentences - as a whole, using a Sequential Sentence Pair Classifier (SSPC). The architecture leverages a pre-trained language model (PLM) to obtain representations of individual sentences, which are then fed into a bidirectional LSTM (BiLSTM) to contextualize them within the document. The BiLSTM-produced vectors of adjacent sentences are concatenated and passed to a multi-layer perceptron for prediction per adjacency. Building on the work of previous PAN participants classical text segmentation, the approach is relatively conservative and lightweight. Nevertheless, it proves effective in leveraging contextual information and addressing what is arguably the most challenging aspect of this year's shared task: the notorious problem of "stylistically shallow", short sentences that are prevalent in the proposed benchmark data. Evaluated on the official PAN-2025 test datasets, the model achieves strong macro-F1 scores of 0.923, 0.828, and 0.724 on the EASY, MEDIUM, and HARD data, respectively, outperforming not only the official random baselines but also a much more challenging one: claude-3.7-sonnet's zero-shot performance.

风格检测序列建模文本分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。