用AI整合零散文本与数据,提升缺资料地区的粮食安全决策能力
Leveraging Natural Language Processing and Machine Learning for Evidence-Based Food Security Policy Decision-Making in Data-Scarce Making
- 结合文本嵌入与社会经济指标,用轻量Transformer模型处理稀疏数据
- 在25个地区1200样本上达91%准确率,优于传统模型13%-17%
- 减少城乡偏差至3%,适合政策制定者和低资源治理场景
数据匮乏地区粮食安全政策制定面临结构化数据少、文本报告分散及决策系统存在人口偏见的挑战。本研究提出ZeroHungerAI,一种融合自然语言处理(NLP)与机器学习(ML)的集成框架,旨在极端数据稀缺条件下实现基于证据的粮食安全政策建模。系统通过基于迁移学习的DistilBERT架构,将结构化社会经济指标与政策文本上下文嵌入相结合。在覆盖25个区县的1200样本混合数据集上评估显示,该方法在不平衡条件下实现91%分类准确率、0.89精确率、0.85召回率和0.86 F1分数。相比经典SVM提升13%,相比逻辑回归提升17%。精确率-召回率分析表明对少数类检测稳健(平均精确率约0.88)。公平性优化使人口平等差异降至3%,确保城乡政策推断的公平性。结果验证了基于Transformer的上下文学习在低资源治理环境中显著提升政策智能,支持可扩展且无偏见的饥饿预测系统。
原文摘要 · Abstract (English)
Food security policy formulation in data-scarce regions remains a critical challenge due to limited structured datasets, fragmented textual reports, and demographic bias in decision-making systems. This study proposes ZeroHungerAI, an integrated Natural Language Processing (NLP) and Machine Learning (ML) framework designed for evidence-based food security policy modeling under extreme data scarcity. The system combines structured socio-economic indicators with contextual policy text embeddings using a transfer learning based DistilBERT architecture. Experimental evaluation on a 1200-sample hybrid dataset across 25 districts demonstrates superior predictive performance, achieving 91 percent classification accuracy, 0.89 precision, 0.85 recall, and an F1 score of 0.86 under imbalanced conditions. Comparative analysis shows a 13 percent performance improvement over classical SVM and 17 percent over Logistic Regression models. Precision Recall evaluation confirms robust minority class detection (average precision around 0.88). Fairness aware optimization reduces demographic parity difference to 3 percent, ensuring equitable rural urban policy inference. The results validate that transformer based contextual learning significantly enhances policy intelligence in low resource governance environments, enabling scalable and bias aware hunger prediction systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。