用AI Agent快速识别药物研发竞争格局,提升尽职调查效率。
LLM-Based Agents for Competitive Landscape Mapping in Drug Asset Due Diligence
- 构建基于LLM的竞品发现Agent,自动提取药物关键属性。
- 在真实数据上达83%召回率,较OpenAI Deep Research高出18个百分点。
- 适合生物技术投资机构,可将分析时间从2.5天压缩至3小时。
本文描述并评估了一个用于快速药物资产尽职调查的竞品发现组件。该竞品发现AI Agent在给定适应症后,能自动检索该适应症下的所有竞争性药物,并提取其标准化属性。由于竞品定义依赖投资者、数据源受版权保护、分散于多个注册库、适应症术语不一致、药物名称别名众多、数据多模态且动态变化,当前基于LLM的系统难以可靠地检索全部竞品,且缺乏公开基准。为此,我们利用LLM Agent将一家私人生物技术风投基金五年的多模态非结构化尽调备忘录转化为结构化评估语料库,实现适应症到竞品药物及其标准化属性的映射。同时引入一个作为裁判的验证型LLM-Agent,过滤预测结果中的假阳性以提升精度并抑制幻觉。在该基准上,我们的竞品发现Agent达到83%召回率,超过OpenAI Deep Research(65%)和Perplexity Labs(60%)。系统已部署于生产环境;在某生物技术风投基金案例中,分析师完成竞品分析的时间从2.5天降至约3小时(约20倍提升)。
原文摘要 · Abstract (English)
In this paper, we describe and benchmark a competitor-discovery component used within an agentic AI system for fast drug asset due diligence. A competitor-discovery AI agent, given an indication, retrieves all drugs comprising the competitive landscape of that indication and extracts canonical attributes for these drugs. The competitor definition is investor-specific, and data is paywalled/licensed, fragmented across registries, ontology-mismatched by indication, alias-heavy for drug names, multimodal, and rapidly changing. Although considered the best tool for this problem, the current LLM-based AI systems aren't capable of reliably retrieving all competing drug names, and there is no accepted public benchmark for this task. To address the lack of evaluation, we use LLM-based agents to transform five years of multi-modal, unstructured diligence memos from a private biotech VC fund into a structured evaluation corpus mapping indications to competitor drugs with normalized attributes. We also introduce a competitor validating LLM-as-a-judge agent that filters out false positives from the list of predicted competitors to maximize precision and suppress hallucinations. On this benchmark, our competitor-discovery agent achieves 83% recall, exceeding OpenAI Deep Research (65%) and Perplexity Labs (60%). The system is deployed in production with enterprise users; in a case study with a biotech VC investment fund, analyst turnaround time dropped from 2.5 days to $\sim$3 hours ($\sim$20x) for the competitive analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。