arXiv:2608.21365cs.CLcs.AI2026-08

针对高棉语检索难题,构建新数据集并验证混合检索与大模型扩写效果。

KSE-Web: An Analysis of Hybrid Retrieval and LLM-Assisted Query Expansion for Low-Resource Khmer Semantic Search

论文配图:KSE-Web: An Analysis of Hybrid Retrieval and LLM-Assisted Query Expansion for Low-Resource Khmer Semantic Search
图 1 · 摘自论文原文
  • 用17K标题构建3K清洗文档,含300条人工标注查询与半人工相关性标签。
  • 字符n-gram BM25表现最佳,达0.943召回率和0.876 nDCG,混合检索紧随其后。
  • 大模型扩写效果受限,模型规模影响结果,需警惕主题偏移与语义丢失。

作为低资源语言,高棉语面临标注数据少、词边界模糊、多语言嵌入支持弱及频繁中英文混用等检索挑战。本文提出KSE-Web,分析混合检索与大模型辅助查询扩写在高棉语语义搜索中的应用。从约17,000个候选高棉语文标题中构建数据集,经过滤、归一化、去重和长度控制后保留3,000篇完整文本文档,并包含300条人工审校的用户风格搜索查询及部分人工验证的银标准相关性标签。评估了字符n-gram BM25、多语言稠密检索、混合BM25+稠密检索以及基于Qwen2.5模型的大模型查询扩写。实验表明,BM25整体表现最强,达0.943召回率与0.876 nDCG;混合检索表现相近,为0.929召回率与0.871 nDCG,而纯稠密检索表现较差。大模型扩写未超越原始查询,但Qwen2.5-3B生成结果显著优于Qwen2.5-0.5B,说明模型规模与扩写质量对低资源高棉语检索至关重要。分析还显示,直接大模型扩写易引入主题漂移、通用词汇与噪声重述,简单过滤可能损失有用语义线索。研究揭示了大模型辅助检索在高棉语中的潜力与局限,为未来更高质量人工标注数据集与高棉语感知检索模型奠定基础。数据集与文档将开源至github.com/back-kh/KhmerSemantic-Search。

原文摘要 · Abstract (English)

As a low-resource language, Khmer presents several retrieval challenges, including limited annotated data, ambiguous word boundaries, weak support in multilingual embedding models, and frequent mixed Khmer-English usage. This paper presents KSE-Web, an analysis of hybrid retrieval and LLM-assisted query expansion for Khmer semantic search. We construct the dataset from approximately 17K candidate Khmer titles and retain 3K cleaned full-text Khmer documents after filtering, normalization, deduplication, and document-length control. The dataset includes 300 manually reviewed user-style Khmer search queries and silver relevance labels with partial human verification. We evaluate character n-gram BM25, multilingual dense retrieval, hybrid BM25+dense retrieval, and LLM-assisted query expansion using Qwen2.5 models. Experimental results show that BM25 achieves the strongest overall performance, reaching 0.943 Recall and 0.876 nDCG. Hybrid BM25+dense retrieval performs comparably, achieving 0.929 Recall and 0.871 nDCG, while dense retrieval alone performs lower. LLM-assisted query expansion does not outperform non-expanded retrieval; however, Qwen2.5-3B produces substantially stronger expanded-query results than Qwen2.5-0.5B, suggesting that LLM size and expansion quality matter for low-resource Khmer retrieval. Our analysis further shows that direct LLM expansion can introduce topic drift, generic terms, and noisy reformulations, while simple filtering may remove useful semantic cues. These findings highlight both the potential and limitations of LLM-assisted retrieval for Khmer semantic search and provide a foundation for future Khmer retrieval datasets with stronger human-verified annotations and Khmer-aware retrieval models. The dataset and documentation will be made available at github.com/back-kh/KhmerSemantic-Search.

低资源语言语义搜索大模型扩写高棉语

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。