arXiv:2508.05676cs.IRcs.LG2025-08被引 1

对比两种方法,提升建筑信息模型的自然语言查询准确率。

Domain-Specific Fine-Tuning and Prompt-Based Learning: A Comparative Study for developing Natural Language-Based BIM Information Retrieval Systems

  • 用领域微调和提示学习分别处理意图识别与问答。
  • 微调在意图识别上更准,提示学习(GPT-4o)在问答上表现更强。
  • 混合方案兼顾两者优势,适合复杂实际场景应用。

建筑信息模型(BIM)贯穿建筑全生命周期,支持设计到维护的各项任务。自然语言接口(NLI)作为用户友好的信息检索工具正受到关注,但因查询复杂性和领域知识专属性,精准提取BIM数据仍具挑战。本研究对比了两种主流方法:领域微调与基于大模型的提示学习,在一个包含1,740条标注查询、覆盖69种模型的BIM专用数据集上进行评估。实验表明,领域微调在意图识别任务中表现更优,而提示学习(尤其是GPT-4o)在表格问答任务中更具优势。据此提出混合方案:以微调负责意图识别,提示学习负责问答,实现任务间更均衡稳健的表现。该方案在不同复杂度的BIM模型案例中验证有效。研究系统分析了两种方法的优劣,为真实世界BIM场景中的智能语言驱动系统设计提供依据。

原文摘要 · Abstract (English)

Building Information Modeling (BIM) is essential for managing building data across the entire lifecycle, supporting tasks from design to maintenance. Natural Language Interface (NLI) systems are increasingly explored as user-friendly tools for information retrieval in Building Information Modeling (BIM) environments. Despite their potential, accurately extracting BIM-related data through natural language queries remains a persistent challenge due to the complexity use queries and specificity of domain knowledge. This study presents a comparative analysis of two prominent approaches for developing NLI-based BIM information retrieval systems: domain-specific fine-tuning and prompt-based learning using large language models (LLMs). A two-stage framework consisting of intent recognition and table-based question answering is implemented to evaluate the effectiveness of both approaches. To support this evaluation, a BIM-specific dataset of 1,740 annotated queries of varying types across 69 models is constructed. Experimental results show that domain-specific fine-tuning delivers superior performance in intent recognition tasks, while prompt-based learning, particularly with GPT-4o, shows strength in table-based question answering. Based on these findings, this study identify a hybrid configuration that combines fine-tuning for intent recognition with prompt-based learning for question answering, achieving more balanced and robust performance across tasks. This integrated approach is further tested through case studies involving BIM models of varying complexity. This study provides a systematic analysis of the strengths and limitations of each approach and discusses the applicability of the NLI to real-world BIM scenarios. The findings offer insights for researchers and practitioners in designing intelligent, language-driven BIM systems.

BIM自然语言提示学习微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。