arXiv:2601.03474cs.CLcs.AI2026-01

用句子衔接预测解决文本分段,无需标签也能精准切分话题边界。

SegNSP: Revisiting Next Sentence Prediction for Linear Text Segmentation

论文配图:SegNSP: Revisiting Next Sentence Prediction for Linear Text Segmentation
图 1 · 摘自论文原文
  • 将文本分段重构为无标签的句子衔接预测任务,捕捉上下文连贯性。
  • 在CitiLink-Minutes上达B-F1 0.79,WikiSection上超基线0.17点。
  • 适合需要自动分段的摘要、检索等下游NLP应用。

线性文本分段是自然语言处理中的长期难题,旨在将连续文本划分为语义连贯的单元。由于话题边界定义复杂、话语结构多变,且需兼顾局部连贯与全局上下文,该任务仍具挑战性,影响摘要、信息检索和问答等下游应用。本文提出SegNSP,将文本分段重构为下一个句子预测(NSP)任务。尽管现代预训练中已少用NSP,但其对句子间连续性的显式建模使其成为检测话题边界的天然选择。我们提出一种无标签的NSP方法,不依赖话题标签即可预测下一句是否延续当前话题,并结合分段感知损失与更难负样本采样以增强话语连贯性捕捉能力。不同于近期需额外话题分类辅助的方法,本方法避免任务特定监督。在两个数据集上评估:首次建立基准的CitiLink-Minutes和WikiSection。SegNSP在CitiLink-Minutes上获得B-F1 0.79,接近人工标注的话题转换;在WikiSection上达到B-F1 0.65,超越最强可复现基线TopSeg 0.17绝对点。结果表明该方法具有竞争力与鲁棒性,证明通过建模句子间连续性可有效提升分段质量,支持下游NLP任务。

原文摘要 · Abstract (English)

Linear text segmentation is a long-standing problem in natural language processing (NLP), focused on dividing continuous text into coherent and semantically meaningful units. Despite its importance, the task remains challenging due to the complexity of defining topic boundaries, the variability in discourse structure, and the need to balance local coherence with global context. These difficulties hinder downstream applications such as summarization, information retrieval, and question answering. In this work, we introduce SegNSP, framing linear text segmentation as a next sentence prediction (NSP) task. Although NSP has largely been abandoned in modern pre-training, its explicit modeling of sentence-to-sentence continuity makes it a natural fit for detecting topic boundaries. We propose a label-agnostic NSP approach, which predicts whether the next sentence continues the current topic without requiring explicit topic labels, and enhance it with a segmentation-aware loss combined with harder negative sampling to better capture discourse continuity. Unlike recent proposals that leverage NSP alongside auxiliary topic classification, our approach avoids task-specific supervision. We evaluate our model against established baselines on two datasets, CitiLink-Minutes, for which we establish the first segmentation benchmark, and WikiSection. On CitiLink-Minutes, SegNSP achieves a B-$F_1$ of 0.79, closely aligning with human-annotated topic transitions, while on WikiSection it attains a B-F$_1$ of 0.65, outperforming the strongest reproducible baseline, TopSeg, by 0.17 absolute points. These results demonstrate competitive and robust performance, highlighting the effectiveness of modeling sentence-to-sentence continuity for improving segmentation quality and supporting downstream NLP applications.

文本分段句子衔接无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。