用大模型自动解析复杂地理描述,提升生物标本定位精度
Georeferencing complex relative locality descriptions with large language models
- 用提示工程+QLoRA微调大模型,处理多语言复杂地理描述
- 平均65%的记录在10公里内,纽约州最高达85%在10公里内
- 适合处理历史标本记录等长篇、非坐标类地理描述场景
地理编码通常依赖地名词典或语言模型将文本与地理位置关联,但许多位置描述基于相对空间关系,仅靠地名或地理关键词难以准确标注。这类问题在生物标本采集记录中尤为常见,尤其在GPS普及前的记录中多以叙述性文字描述位置。准确地理编码对生物多样性研究至关重要,但人工处理成本高,亟需自动化方案。本文探索大语言模型(LLM)在自动地理编码中的潜力,聚焦生物多样性收藏领域。我们首先识别有效提示模式,随后使用量化低秩适配(QLoRA)在多地区、多语言的生物多样性数据集上微调模型。在固定训练数据量下,该方法在各数据集上的平均表现达到65%的记录位于10公里半径内,最佳结果(纽约州)为85%在10公里内,67%在1公里内。所选模型对长篇复杂描述仍有良好表现,展现出处理复杂地理描述的强大潜力。
原文摘要 · Abstract (English)
Georeferencing text documents has typically relied on either gazetteer-based methods to assign geographic coordinates to place names, or on language modelling approaches that associate textual terms with geographic locations. However, many location descriptions specify positions relatively with spatial relationships, making geocoding based solely on place names or geo-indicative words inaccurate. This issue frequently arises in biological specimen collection records, where locations are often described through narratives rather than coordinates if they pre-date GPS. Accurate georeferencing is vital for biodiversity studies, yet the process remains labour-intensive, leading to a demand for automated georeferencing solutions. This paper explores the potential of Large Language Models (LLMs) to georeference complex locality descriptions automatically, focusing on the biodiversity collections domain. We first identified effective prompting patterns, then fine-tuned an LLM using Quantized Low-Rank Adaptation (QLoRA) on biodiversity datasets from multiple regions and languages. Our approach outperforms existing baselines with an average, across datasets, of 65% of records within a 10 km radius, for a fixed amount of training data. The best results (New York state) were 85% within 10km and 67% within 1km. The selected LLM performs well for lengthy, complex descriptions, highlighting its potential for georeferencing intricate locality descriptions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。