arXiv:2508.21738cs.CYcs.CV2025-08

用无人机图+AI分析农村宜居性,效率高还更准。

From Drone Imagery to Livability Mapping: AI-powered Environment Perception in Rural China

  • 用链式思维引导多模态大模型识别无人机图中的生活品质特征。
  • 相比主流模型提升0.1的评估相关性,计算效率提升三倍。
  • 适合做大规模农村环境评估的研究者与政策制定者参考。

获取农村街景图像成本高昂,限制了对农村环境的全面感知。无人机照片具备易获取、覆盖广、分辨率高等优势,是实现大规模农村环境感知的可行方案。然而,从无人机图像中系统识别关键环境要素并量化其对环境感知影响的方法仍不成熟。为此,本文提出一种视觉-语言对比排序框架(VLCR),用于中国农村宜居性评估。该框架采用链式思维提示策略,引导多模态大语言模型(MLLMs)从无人机图像中识别与生活质量及生态宜居性相关的视觉特征;针对村庄间成对比较的不稳定性,提出文本描述约束的图像对比策略;为克服全国范围成对比较的效率瓶颈,设计基于二分搜索插值的创新排名算法,通过自动选择对比目标减少比较次数。所提框架在评估中取得优异表现,斯皮尔曼鞋带距离达0.74,优于主流商业MLLMs约0.1;同时,并发对比与排序机制使计算效率提升三倍。本框架在数据与方法上实现双重突破,为大规模村庄宜居性分析提供有力支持。

原文摘要 · Abstract (English)

The high cost of acquiring rural street view images has constrained comprehensive environmental perception in rural areas. Drone photographs, with their advantages of easy acquisition, broad coverage, and high spatial resolution, offer a viable approach for large-scale rural environmental perception. However, a systematic methodology for identifying key environmental elements from drone photographs and quantifying their impact on environmental perception remains lacking. To address this gap, a Vision-Language Contrastive Ranking Framework (VLCR) is designed for rural livability assessment in China. The framework employs chain-of-thought prompting strategies to guide multimodal large language models (MLLMs) in identifying visual features related to quality of life and ecological habitability from drone photographs. Subsequently, to address the instability in pairwise village comparison, a text description-constrained drone photograph comparison strategy is proposed. Finally, to overcome the efficiency bottleneck in nationwide pairwise village comparisons, an innovation ranking algorithm based on binary search interpolation is developed, which reduces the number of comparisons through automated selection of comparison targets. The proposed framework achieves superior performance with a Spearman Footrule distance of 0.74, outperforming mainstream commercial MLLMs by approximately 0.1. Moreover, the mechanism of concurrent comparison and ranking demonstrates a threefold enhancement in computational efficiency. Our framework has achieved data innovation and methodological breakthroughs in village livability assessment, providing strong support for large-scale village livability analysis. Keywords: Drone photographs, Environmental perception, Rural livability assessment, Multimodal large language models, Chain-of-thought prompting.

无人机乡村评估多模态大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。