构建1500万节点土耳其语同义词图,解决嵌入相似性误判反义词的问题。
Beyond Cosine Similarity: Taming Semantic Drift and Antonym Intrusion in a 15-Million Node Turkish Synonym Graph
- 用大语言模型生成并人工验证84万组语义关系,构建高质量标签数据集。
- 提出三元语义判别器,90%宏平均F1值实现同义/反义精准区分。
- 设计软到硬聚类算法,防止语义漂移,适合多义词和资源少的语言。
神经嵌入存在一个顽疾:难以可靠区分同义词与反义词。因此,提高相似度阈值常无法阻止对立词被错误归为一类。我们构建了一个大规模语义聚类系统,专门应对这一问题。该系统处理1500万词汇项,评估5.2亿潜在关系,最终生成290万高精度语义簇。主要贡献有三:第一,通过Gemini 2.5-Flash大模型增强并经人工校验,构建包含84.3万组概念对的标注数据集,涵盖同义、反义及共下位关系;第二,提出专用三元语义关系判别器,实现90%宏平均F1,显著超越原始嵌入相似度;第三,引入新颖的软到硬聚类算法,缓解语义漂移,避免错误传递链(如'热→辣→痛→抑郁'),同时解决多义性问题。方法采用拓扑感知的两阶段扩展-剪枝流程与拓扑投票机制,确保每个词仅归属一个语义一致簇。该资源支持高精度语义搜索与检索增强生成,尤其适用于形态复杂、低资源语言。
原文摘要 · Abstract (English)
Neural embeddings have a notorious blind spot: they can't reliably tell synonyms apart from antonyms. Consequently, increasing similarity thresholds often fails to prevent opposites from being grouped together. We've built a large-scale semantic clustering system specifically designed to tackle this problem head on. Our pipeline chews through 15 million lexical items, evaluates a massive 520 million potential relationships, and ultimately generates 2.9 million high-precision semantic clusters. The system makes three primary contributions. First, we introduce a labeled dataset of 843,000 concept pairs spanning synonymy, antonymy, and co-hyponymy, constructed via Gemini 2.5-Flash LLM augmentation and verified using human-curated dictionary resources. Second, we propose a specialized three-way semantic relation discriminator that achieves 90% macro-F1, enabling robust disambiguation beyond raw embedding similarity. Third, we introduce a novel soft-to-hard clustering algorithm that mitigates semantic drift preventing erroneous transitive chains (e.g., hot -> spicy -> pain -> depression) while simultaneously resolving polysemy. Our approach employs a topology-aware two-stage expansion-pruning procedure with topological voting, ensuring that each term is assigned to exactly one semantically coherent cluster. The resulting resource enables high-precision semantic search and retrieval-augmented generation, particularly for morphologically rich and low-resource languages where existing synonym databases remain sparse.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。