让农业专家快速获取可信气候适应策略答案,兼顾可读性与出处可靠性。
CAIRNS: Balancing Readability and Scientific Accuracy in Climate Adaptation Question Answering
- 用结构化提示生成易读且带引用的答案
- 通过多模型一致性评估提升结果可信度
- 无需微调,适合农业顾问等领域专家使用
针对气候变化下的农业适应策略,现有信息分散于非结构化科学文献或政府开放数据中。本文提出CAIRNS框架,帮助农民顾问从网络复杂证据源中获取可信的初步回答。该框架通过结构化ScholarGuide提示增强答案可读性与引用可靠性,并采用基于模型间一致性的加权混合评估器进行鲁棒验证。整体无需微调或强化学习,即可实现可读、可验证、领域相关的问答。在已有的专家标注问答数据集上,CAIRNS在多数指标上优于基线方法。彻底的消融实验确认了各组件的有效性。为验证LLM评估的有效性,还报告了其与人工判断的相关性分析。
原文摘要 · Abstract (English)
Climate adaptation strategies are proposed in response to climate change. They are practised in agriculture to sustain food production. These strategies can be found in unstructured data (for example, scientific literature from the Elsevier website) or structured (heterogeneous climate data via government APIs). We present Climate Adaptation question-answering with Improved Readability and Noted Sources (CAIRNS), a framework that enables experts -- farmer advisors -- to obtain credible preliminary answers from complex evidence sources from the web. It enhances readability and citation reliability through a structured ScholarGuide prompt and achieves robust evaluation via a consistency-weighted hybrid evaluator that leverages inter-model agreement with experts. Together, these components enable readable, verifiable, and domain-grounded question-answering without fine-tuning or reinforcement learning. Using a previously reported dataset of expert-curated question-answers, we show that CAIRNS outperforms the baselines on most of the metrics. Our thorough ablation study confirms the results on all metrics. To validate our LLM-based evaluation, we also report an analysis of correlations against human judgment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。