用Transformer构建阿拉伯语反向词典,提升查词效率。
Advancing Arabic Reverse Dictionary Systems: A Transformer-Based Approach with Dataset Construction Guidelines
- 采用分层递减的半编码器架构,优化阿拉伯语语义匹配。
- ARBERTv2模型在评测中得分0.0644,性能领先现有方法。
- 提供可复用工具库与定义质量标准,助力语言学习与研究。
本研究针对阿拉伯语自然语言处理中的关键空白,构建了一个高效的阿拉伯语反向词典系统,使用户可通过语义描述查找对应词汇。提出一种基于Transformer的新型半编码神经网络架构,采用几何递减层数设计,在阿拉伯语反向词典任务中达到当前最优效果。方法包含全面的数据集构建流程,并确立了阿拉伯语词典释义的质量评估标准。实验表明,专用阿拉伯语模型显著优于通用多语言嵌入,其中 ARBERTv2 取得最高排名得分(0.0644)。此外,本文形式化抽象了反向词典任务,增强了理论理解,并开发了一个模块化、可扩展的 Python 工具库 RDTL,支持可配置训练流程。对数据集质量的分析揭示了改进释义构建的关键洞察,提炼出八项高质量反向词典资源建设标准。本工作对阿拉伯语计算语言学具有重要意义,为阿拉伯语学习、学术写作和专业交流提供了有力支持。
原文摘要 · Abstract (English)
This study addresses the critical gap in Arabic natural language processing by developing an effective Arabic Reverse Dictionary (RD) system that enables users to find words based on their descriptions or meanings. We present a novel transformer-based approach with a semi-encoder neural network architecture featuring geometrically decreasing layers that achieves state-of-the-art results for Arabic RD tasks. Our methodology incorporates a comprehensive dataset construction process and establishes formal quality standards for Arabic lexicographic definitions. Experiments with various pre-trained models demonstrate that Arabic-specific models significantly outperform general multilingual embeddings, with ARBERTv2 achieving the best ranking score (0.0644). Additionally, we provide a formal abstraction of the reverse dictionary task that enhances theoretical understanding and develop a modular, extensible Python library (RDTL) with configurable training pipelines. Our analysis of dataset quality reveals important insights for improving Arabic definition construction, leading to eight specific standards for building high-quality reverse dictionary resources. This work contributes significantly to Arabic computational linguistics and provides valuable tools for language learning, academic writing, and professional communication in Arabic.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。