arXiv:2601.11872cs.CL2026-01AAAI被引 4

构建统一语义空间,实现多语言主题模型的精准对齐

GloCTM: Cross-Lingual Topic Modeling via a Global Context Space

  • 用跨语言词汇邻域扩展词袋,构建融合上下文的输入表示
  • 通过全局主题词分布与CKA损失,使不同语言主题语义对齐
  • 适合需要跨语言主题分析的研究者,尤其关注细粒度语义对齐

跨语言主题建模旨在发现多语言间连贯且语义一致的主题,是多语言理解的核心任务。然而现有模型通常在独立的语言空间中学习主题,并依赖双语词典等对齐机制,难以捕捉深层语义,导致主题空间关联松散。同时,这些方法常忽略预训练多语言表示中的丰富语义信号,限制了细粒度对齐能力。本文提出GloCTM框架,通过贯穿整个模型流程的统一语义空间强制跨语言主题对齐。GloCTM通过引入跨语言词汇邻域扩充词袋表示,结合局部与全局编码器推断主题比例,并利用内部正则化对齐其潜在表示。在输出层,基于合并词表定义的全局主题-词分布,结构化同步不同语言的主题含义。为进一步将主题锚定在深层语义空间,GloCTM引入中心核对齐(CKA)损失,对齐潜在主题空间与多语言上下文嵌入。多个基准测试表明,GloCTM显著提升主题连贯性与跨语言对齐效果,优于强基线。

原文摘要 · Abstract (English)

Cross-lingual topic modeling seeks to uncover coherent and semantically aligned topics across languages - a task central to multilingual understanding. Yet most existing models learn topics in disjoint, language-specific spaces and rely on alignment mechanisms (e.g., bilingual dictionaries) that often fail to capture deep cross-lingual semantics, resulting in loosely connected topic spaces. Moreover, these approaches often overlook the rich semantic signals embedded in multilingual pretrained representations, further limiting their ability to capture fine-grained alignment. We introduce GloCTM (Global Context Space for Cross-Lingual Topic Model), a novel framework that enforces cross-lingual topic alignment through a unified semantic space spanning the entire model pipeline. GloCTM constructs enriched input representations by expanding bag-of-words with cross-lingual lexical neighborhoods, and infers topic proportions using both local and global encoders, with their latent representations aligned through internal regularization. At the output level, the global topic-word distribution, defined over the combined vocabulary, structurally synchronizes topic meanings across languages. To further ground topics in deep semantic space, GloCTM incorporates a Centered Kernel Alignment (CKA) loss that aligns the latent topic space with multilingual contextual embeddings. Experiments across multiple benchmarks demonstrate that GloCTM significantly improves topic coherence and cross-lingual alignment, outperforming strong baselines.

主题建模跨语言语义对齐多语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。