arXiv:2608.16005cs.LG2026-08

通过检索增强双路融合,提升分子与文本的对齐精度

Retrieval-guided Twin Fusion with Similarity-aware Contrast for Molecule-Text Alignment

论文配图:Retrieval-guided Twin Fusion with Similarity-aware Contrast for Molecule-Text Alignment
图 1 · 摘自论文原文
  • 用跨模态检索构建子结构的双路潜在表示
  • 在多个基准数据集上优于现有方法
  • 适合分子搜索与性质预测任务

本文研究分子-文本对齐问题,旨在将分子及其文本描述映射到联合潜在空间,以支持分子搜索和分子性质预测等下游任务。以往方法多结合图结构挖掘与对比学习,但常忽略子结构与文本间的细粒度语义关系,导致下游性能受限。为此,提出一种名为RISEN的新方法:为每个子结构构造一个潜在双路分子,通过跨模态检索实现语义增强。具体地,针对每个子结构查询,检索相关文本描述,并采样共享相似描述的分子;通过注意力池化聚合其表征,生成双路潜在表示,再与原始子结构融合以丰富表征。此外,测量子结构与文本间的相似性,通过软阈值引导跨模态对比学习。大量实验表明,RISEN在多个基准数据集上显著优于现有基线。

原文摘要 · Abstract (English)

This paper studies the problem of molecule-text alignment, which aims to project molecules and their textual descriptions into a joint latent space for downstream tasks including molecule search and molecular property prediction. Previous approaches typically combine graph structure mining with contrastive learning to enhance joint representation learning. However, they typically neglect fine-grained semantic relationships between substructures and texts, leading to suboptimal performance on downstream tasks. Towards this end, we propose a novel approach named Retrieval-guided Twin Fusion with Similarity-aware Contrast (RISEN) for molecule-text alignment. The core idea of RISEN is to construct a latent twin molecule for each substructure with cross-modal retrieval for semantic enhancement. In particular, for each substructure query, we retrieve relevant textual descriptions and sample several molecules that share similar descriptions of substructures. Then, we aggregate their representations via attention pooling for a twin latent representation, which would be further fused with the original substructure for representation enrichment. In addition, we measure the similarity across substructures and texts, which would further guide cross-modal contrastive learning with soft thresholding. Extensive experiments on benchmark datasets validate the superiority of the proposed RISEN in comparison with existing baselines.

分子生成跨模态对齐对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。