用三重引导微调让AI读懂桥梁损伤的隐性成因,实现低耗高准诊断。
Encoding Invisible Causation for Bridge Diagnostic Agents: Triple-Guided Retrieval-Augmented Fine-Tuning with QLoRA

- 从手册中提取损伤-成因三元组,构建可检索的知识库
- 在测试集上达到87.07%准确率,推理速度提升11%,显存降低72%
- 适合部署在消费级硬件上的轻量诊断系统,尤其适合边缘设备
桥梁结构随时间逐渐退化,但盐分侵入、冻胀、疲劳裂纹等根本原因难以肉眼察觉。专家诊断依赖多年积累的隐性经验。本文提出损伤成因编码器,基于可见损伤描述 $S_i$ 对10类损伤成因进行分类,用于自主桥梁诊断系统。方法包含三步:(i)知识三元组提取——利用大模型从15–35份诊断手册中抽取 (损伤 → 成因) 形式的因果三元组,并存入FAISS向量库;(ii)检索增强上下文——训练与推理时,检索相关因果三元组 $/mathcal{C}_i$ 并拼接至 $S_i$,将隐性知识显式化为编码器上下文;(iii)系统性微调对比——在固定黄金测试集(116个分层样本)上比较LoRA、QLoRA与QA-LoRA,结果表明QLoRA在精度(87.07%)、速度(快11%)、内存(降72%)间取得最优平衡,且对未见输入泛化能力更强。在涵盖全部10类成因的100样本多样化评估中,QLoRA较LoRA高出13个百分点。研究还提出一个可复用的受控黄金测试集。成果支持在消费级硬件上部署内存高效、高精度的诊断代理。
原文摘要 · Abstract (English)
Bridge infrastructure deteriorates gradually, yet its root causes---salt intrusion, freezing, fatigue cracking, and others---remain invisible to the naked eye. Expert diagnosis relies on tacit knowledge built over years of practice. We address the challenge of automating this latent causal reasoning by proposing a Damage Cause Encoder that classifies 10-class damage causes from visible damage descriptions $S_i$ for use in autonomous bridge diagnostic agents. Our approach chains three components: (i)Knowledge Triple Extraction---a large language model extracts causal triples of the form (damage $\xrightarrow{\mathtt{caused\_by}}$ cause) from 15--35 diagnostic PDF manuals and indexes them in a FAISS vector store; (ii)Retrieval-Augmented Context---at training and inference time, relevant causal triples $\mathcal{C}_i$ are retrieved and concatenated with $S_i$, converting implicit domain knowledge into explicit Encoder context; (iii)Systematic Fine-tuning Comparison---we conduct a rigorous comparison of LoRA, QLoRA, and QA-LoRA on a fixed Golden Testset (116 stratified samples), demonstrating that QLoRA achieves the optimal trade-off: identical test accuracy (87.07%) to full-precision LoRA, 11% faster inference, 72% lower GPU memory, and superior generalization across diverse unseen inputs. A controlled Golden Testset---stratified, deduplicated, and difficulty-tagged---is introduced as a reusable benchmark contribution. QLoRA further outperforms LoRA by 13 percentage points on a 100-sample diverse evaluation spanning all 10 damage cause classes.These findings enable memory-efficient, high-accuracy diagnostic agents on consumer-grade hardware for edge deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。