arXiv:2602.21212cs.CLcs.IR2026-02

用轻量化模型提升灾害问答精准度,降低错误信息传播风险。

Disaster Question Answering with LoRA Efficiency and Accurate End Position

  • 基于日语灾害数据,结合BERT+Bi-LSTM与LoRA优化,实现高效推理。
  • 端位置准确率达70.4%,参数量仅117M的5.7%(6.7M),F1达0.885。
  • 适合灾时应急响应、边缘设备部署,尤其适用于通信中断场景。

地震、暴雨、洪水、火山喷发等自然灾害发生频率极低,影响范围有限。灾时个体常因缺乏领域知识与经验而陷入混乱,即便使用RAG与大模型查询,也难以获取针对性的灾情应对信息。若问答系统产生幻觉,可能引发虚假信息传播,加剧混乱。本文构建面向日本灾害情境的问答系统,采用cl-tohoku/bert-base-japanese-v3 + Bi-LSTM + 增强位置头结构,并通过LoRA进行参数效率优化,在仅使用总参数5.7%(6.7M/117M)的情况下,实现70.4%的端位置准确率。实验表明,日语BERT优化与Bi-LSTM上下文理解结合,可达到0.885的Span F1,满足真实灾害响应需求。未来挑战包括建立灾害问答基准数据集、注入灾害知识微调基础模型、开发低功耗边缘AI灾害问答应用,以及实现知识库持续更新与学习能力。

原文摘要 · Abstract (English)

Natural disasters such as earthquakes, torrential rainfall, floods, and volcanic eruptions occur with extremely low frequency and affect limited geographic areas. When individuals face disaster situations, they often experience confusion and lack the domain-specific knowledge and experience necessary to determine appropriate responses and actions. While disaster information is continuously updated, even when utilizing RAG search and large language models for inquiries, obtaining relevant domain knowledge about natural disasters and experiences similar to one's specific situation is not guaranteed. When hallucinations are included in disaster question answering, artificial misinformation may spread and exacerbate confusion. This work introduces a disaster-focused question answering system based on Japanese disaster situations and response experiences. Utilizing the cl-tohoku/bert-base-japanese-v3 + Bi-LSTM + Enhanced Position Heads architecture with LoRA efficiency optimization, we achieved 70.4\% End Position accuracy with only 5.7\% of the total parameters (6.7M/117M). Experimental results demonstrate that the combination of Japanese BERT-base optimization and Bi-LSTM contextual understanding achieves accuracy levels suitable for real disaster response scenarios, attaining a 0.885 Span F1 score. Future challenges include: establishing natural disaster Q\&A benchmark datasets, fine-tuning foundation models with disaster knowledge, developing lightweight and power-efficient edge AI Disaster Q\&A applications for situations with insufficient power and communication during disasters, and addressing disaster knowledge base updates and continual learning capabilities.

灾害问答LoRA轻量化模型边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。