让大模型精准匹配分子结构与文本描述,提升可解释性。
MolReFlect: Towards In-Context Fine-grained Alignments between Molecules and Texts
- 用师生框架自动学习分子子结构与文本的细粒度对应关系
- 在分子-文本翻译任务上超越现有基线,达当前最佳性能
- 适合需要可解释分子理解的药物研发与材料设计人员
分子发现是影响医药与材料等领域的关键研究方向。近年来,大语言模型(LLMs)被广泛用于分子理解和生成,作为分子空间与自然语言空间之间的桥梁,但分子与其对应描述之间的对齐仍面临挑战。以往方法通常将分子视为整体输入,缺乏中间推理过程,牺牲了可解释性。本文定义细粒度对齐为分子子结构与解释其性质的文本短语之间的精确对应,这对实现更准确、可解释的分子理解至关重要。这类对齐通常需专家标注,成本高且耗时。为使LLMs能自动标注并学习细粒度对齐,我们提出MolReFlect——一种新型师生框架:教师模型先生成并优化文本短语与SMILES子结构的映射,再显式教授给学生模型。实验表明,MolReFlect显著优于先前基线,在分子-文本翻译任务中达到最先进水平。代码已开源:https://github.com/phenixace/MolReFlect。
原文摘要 · Abstract (English)
Molecule discovery is a pivotal research field, impacting everything from medicine to materials. Recently, Large Language Models (LLMs) have been widely adopted in molecular understanding and generation, serving as a bridge between the molecular space and the natural language space, yet the alignment between molecules and their corresponding captions remains a significant challenge. Previous endeavors typically treat molecules as monolithic inputs, lacking an intermediate reasoning process and sacrificing explainability. In this work, we define fine-grained alignments as the precise correspondence between a molecule's sub-structures and the textual phrases that explain their properties. These alignments are crucial for LLMs to understand molecules in a more accurate and explainable manner. Normally, such fine-grained alignments require expert annotation, which is both costly and time-consuming. To allow LLMs to automatically label and learn the fine-grained alignments, we propose MolReFlect, a novel teacher-student framework, where a teacher LLM first generates and refines mappings between caption phrases and SMILES substructures and then explicitly teaches these detailed alignments to a student LLM. Experimental results demonstrate that MolReFlect enables LLMs to significantly outperform previous baselines, achieving the state-of-the-art performance in the molecule-caption translation task. Our codes are available via: https://github.com/phenixace/MolReFlect.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。