arXiv:2601.18788cs.CLcs.LG2026-01被引 1

无需训练,用嵌入向量检测文本边界,理论与实践结合。

Unsupervised Text Segmentation via Kernel Change-Point Detection on Sentence Embeddings

论文配图:Unsupervised Text Segmentation via Kernel Change-Point Detection on Sentence Embeddings
图 1 · 摘自论文原文
  • 将句子转为向量,通过最小化惩罚的核变化点目标找分割点。
  • 理论证明能准确捕捉真实分段点,窗口大小远小于段落长度。
  • 适合需要可靠无监督分段的研究者,尤其关注理论保障的场景。

无监督文本分割至关重要,因边界标注成本高、主观性强且难以跨领域和粒度迁移。我们提出Embed-KCPD,一种无需训练的方法:将句子表示为嵌入向量,并通过最小化惩罚的核变化点检测(KCPD)目标来估计分段边界。除了算法实现,我们首次建立了在m-依赖序列下的依赖感知理论,该模型刻画了语言中常见的短程依赖。我们证明了总体惩罚风险的泛化界以及定位保证——每个真实变化点均能在远小于段落长度的窗口内被恢复。为连接理论与实践,我们引入基于大语言模型的仿真框架,生成具有可控短记忆依赖和已知边界的合成文档,验证了预测的缩放行为。在标准分割基准上,Embed-KCPD常优于强基线。对泰勒·斯威夫特推文的案例研究显示,该方法兼具强理论保障、模拟可靠性与实际有效性。

原文摘要 · Abstract (English)

Unsupervised text segmentation is crucial because boundary labels are expensive, subjective, and often fail to transfer across domains and granularity choices. We propose Embed-KCPD, a training-free method that represents sentences as embedding vectors and estimates boundaries by minimizing a penalized KCPD objective. Beyond the algorithmic instantiation, we develop, to our knowledge, the first dependence-aware theory for KCPD under $m$-dependent sequences, a finite-memory abstraction of short-range dependence common in language. We prove an oracle inequality for the population penalized risk and a localization guarantee showing that each true change point is recovered within a window that is small relative to segment length. To connect theory to practice, we introduce an LLM-based simulation framework that generates synthetic documents with controlled finite-memory dependence and known boundaries, validating the predicted scaling behavior. Across standard segmentation benchmarks, Embed-KCPD often outperforms strong unsupervised baselines. A case study on Taylor Swift's tweets illustrates that Embed-KCPD combines strong theoretical guarantees, simulated reliability, and practical effectiveness for text segmentation.

文本分割无监督学习变化点检测嵌入向量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。