为阿姆哈拉语发布两个新数据集,支持检索与指令生成研究。
AmharicIR+Instr: A Two-Dataset Resource for Neural Retrieval and Instruction Tuning
- 构建1091组查询-正负文档三元组,用于神经检索模型训练与评估。
- 整理6285条跨领域指令响应对,提升阿姆哈拉语生成模型性能。
- 数据格式标准化,可推广至其他低资源语言研究。
神经检索与类GPT生成模型依赖大规模高质量标注数据,但阿姆哈拉语等低资源语言仍严重缺乏。本文发布一个包含两个数据集的阿姆哈拉语资源,支持(i)神经检索排序与(ii)指令遵循文本生成研究。检索数据集包含1,091组经人工验证的查询-正负文档三元组,来源多样,通过专家设计、网络获取与大模型辅助生成构建,正负文档来自网页或大模型合成,并经母语者验证。指令数据集包含6,285条覆盖多领域和多种指令类型的阿姆哈拉语提示-响应对,由多个大模型生成并经人工校对,确保语法正确性、相关性、流畅性与事实合理性。两个数据集均以标准格式(CSV、JSON、JSONL)发布,支持可复现研究,方法亦可推广至其他低资源语言。
原文摘要 · Abstract (English)
Neural retrieval and GPT-style generative models rely on large, high-quality supervised data, which is still scarce for low-resource languages such as Amharic. We release an Amharic data resource consisting of two datasets that supports research on (i) neural retrieval-ranking and (ii) instruction-following text generation. The retrieval-ranking dataset contains 1,091 manually verified query-positive-negative document triplets drawn from diverse Amharic sources and constructed to support contrastive training and benchmarking of neural retrievers (e.g., DPR, ColBERT-style late interaction and SPLADE-style sparse neural retrieval). Triplets are created through a combination of expert-curated queries, web-derived queries, and LLM-assisted generation, with positive/negative documents selected from the web or synthesized by LLMs and then validated by native speakers. The instruction prompt-response dataset comprises 6,285 Amharic prompt-response pairs spanning multiple domains and instruction types, generated with several LLMs and refined through manual review and correction for grammaticality, relevance, fluency, and factual plausibility. We release both datasets with standardized splits and formats (CSV,JSON,JSONL) to enable reproducible work on Amharic retrieval, ranking, and generative modelling. These datasets also come with a methodology that can be generalized to other low-resource languages.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。