arXiv:2609.07307cs.CL2026-09

解决大规模概念分类的结构退化问题,提升层次化组织准确性。

SPARROW: Scalable Taxonomy Induction via Structure-Preserving Partitioning and Constraint-Guided Merging

论文配图:SPARROW: Scalable Taxonomy Induction via Structure-Preserving Partitioning and Constraint-Guided Merging
图 1 · 摘自论文原文
  • 分而治之:用保持结构的谱聚类分割概念集,生成局部分类
  • 全局融合时引入约束引导增量合并,避免父节点错位
  • 在多个大型基准上优于现有方法,适合大规模知识组织

分类法归纳旨在将概念集合组织成连贯的层次结构。基于大语言模型的方法可直接从扁平术语列表中归纳分类,无需语料库,但随着概念规模增大性能急剧下降。我们指出,这种退化不仅源于上下文长度限制,更源于层次推理中的结构失败。为此,我们采用分治-合并范式:将概念划分为小子集,分别诱导局部分类,再合并为全局层次。然而我们识别出两种固有结构失效模式:结构碎片化(划分削弱局部层次信号)与父节点位移(局部合理关系在全局中被错误放置)。为此提出SPARROW框架,结合保持结构的谱聚类划分,确保每块内层次连通性;并采用约束引导的增量融合,将块间关系作为结构约束而非全局真实值进行融合。在大规模基准上的实验表明,SPARROW在多种骨干模型下均保持最优全局结构质量。代码已开源:https://github.com/rebeccazyr/SPARROW。

原文摘要 · Abstract (English)

Taxonomy induction aims to organize concept sets into coherent hierarchical structures. Recent LLM-based methods can induce taxonomies directly from flat term lists, avoiding the need for corpora, but degrade sharply as concept sets scale up. We argue that this degradation stems not only from context length limitations, but also from structural failures in hierarchical reasoning. To address this, we adopt a divide-and-merge paradigm that partitions concepts into smaller subsets, induces local taxonomies, and merges them into a global hierarchy. However, we identify two structural failure modes inherent to this paradigm: Structural Fragmentation, where partitioning weakens local hierarchical signals, and Parent Displacement, where locally plausible relations are misplaced in the global hierarchy. To address both, we propose SPARROW, a scalable taxonomy induction framework that combines structure-preserving spectral partitioning to retain hierarchical connectivity within each block, and constraint-guided incremental fusion that treats block-level relations as structural constraints rather than ground truth for global placement. Experiments on large-scale benchmarks show that SPARROW consistently achieves the strongest global structural quality across backbones. The code is available at https://github.com/rebeccazyr/SPARROW.

分类法归纳层次结构大模型聚类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。