iLoRA通过动态图结构提升微生物组诊断精度与可解释性
iLoRA: Bayesian Low-Rank Adaptation with Latent Interaction Graphs for Microbiome Diagnosis

- 基于输入生成潜变量交互图,动态生成低秩更新
- 在炎症性肠病诊断中优于传统LoRA与贝叶斯方法
- 可恢复符合医学知识的微生物互作图,适合临床研究者
参数高效适配使大模型在领域预测中可行,但标准LoRA仍依赖静态低秩更新,无法揭示驱动科学标签的潜在交互。我们提出iLoRA,据知是首个贝叶斯图条件化的LoRA框架。它从输入推断潜变量交互图,并用其生成输入相关的LoRA更新,实现预测与潜结构学习联合优化,而非事后分析。该方法应用于微生物组诊断,疾病状态既依赖物种丰度又依赖微生物间互作。在两种互补场景下评估:带人工标注图的交互式问答(测试潜结构恢复能力),及多队列炎症性肠病(IBD)诊断(测试生物医学实用性)。结果表明,iLoRA在两项任务中均优于强基线方法,恢复的图与人工标注及队列水平微生物关联一致,并提供校准不确定性,图分支开销适中。
原文摘要 · Abstract (English)
Parameter-efficient adaptation has made LLMs practical for domain prediction, but standard LoRA still relies on a static low-rank update and does not expose the latent interactions that often drive scientific labels. We introduce iLoRA. To our knowledge, it is the first Bayesian graph-conditioned LoRA framework. It infers a latent interaction graph from the input and uses it to generate input-conditioned LoRA updates. As a result, iLoRA learns prediction and latent interaction structure jointly, rather than training a predictor and applying interaction analysis only post hoc. We instantiate this idea for microbiome diagnosis, where disease state can depend on both species-level abundance and microbe-microbe cross-talk, and evaluate it in two complementary settings: interactive QA with human-annotated graphs, which tests latent structure recovery, and multi-cohort IBD diagnosis, which tests biomedical utility. Across both settings, iLoRA improves over strong LoRA and Bayesian adaptation baselines, recovers graphs aligned with human annotations and cohort-level microbiome associations, and provides calibrated uncertainty with moderate graph-branch overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。