arXiv:2505.07157cs.CL2025-05

用大模型生成医疗主题,再通过图神经网络优化,提升跨语言主题质量。

HAMLET: Healthcare-focused Adaptive Multilingual Learning Embedding-based Topic Modeling

  • 结合LLM生成初始主题,再用BERT与GNN融合优化嵌入表示。
  • 在英法双语医疗数据集上,主题的连贯性与可解释性显著提升。
  • 适合需要高质量跨语言医疗文本分析的研究者使用。

传统主题模型难以处理上下文细节、多义词和罕见词,导致主题不连贯。大语言模型虽能生成初始主题,但缺乏精细化与代表性,存在冗余且语义相似度低的问题。本文提出HAMLET,一种基于图神经网络的跨语言医疗主题建模框架。该方法利用神经增强语义融合,对LLM生成的主题嵌入进行优化。不依赖统计共现或人工解读,而是通过BERT与句子BERT(SBERT)构建混合嵌入,并借助图神经网络建立文档、主题、词汇及相似主题/词汇间的连接关系,引入新相似度计算方法,实现主题嵌入的精细调整。最终提取前k个最优主题。实验在两个医疗数据集(英文与法文)上进行,共生成六组测试数据,结果表明该方法在主题质量和一致性方面表现优异。

原文摘要 · Abstract (English)

Traditional topic models often struggle with contextual nuances and fail to adequately handle polysemy and rare words. This limitation typically results in topics that lack coherence and quality. Large Language Models (LLMs) can mitigate this issue by generating an initial set of topics. However, these raw topics frequently lack refinement and representativeness, which leads to redundancy without lexical similarity and reduced interpretability. This paper introduces HAMLET, a graph-driven architecture for cross-lingual healthcare topic modeling that uses LLMs. The proposed approach leverages neural-enhanced semantic fusion to refine the embeddings of topics generated by the LLM. Instead of relying solely on statistical co-occurrence or human interpretation to extract topics from a document corpus, this method introduces a topic embedding refinement that uses Bidirectional Encoder Representations from Transformers (BERT) and Graph Neural Networks (GNN). After topic generation, a hybrid technique that involves BERT and Sentence-BERT (SBERT) is employed for embedding. The topic representations are further refined using a GNN, which establishes connections between documents, topics, words, similar topics, and similar words. A novel method is introduced to compute similarities. Consequently, the topic embeddings are refined, and the top k topics are extracted. Experiments were conducted using two healthcare datasets, one in English and one in French, from which six sets were derived. The results demonstrate the effectiveness of HAMLET.

主题建模医疗AI多语言图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。