arXiv:2411.18391cs.CV2024-11

用问答方式从病理图像预测基因表达,支持新基因泛化。

GeneQuery: A General QA-based Framework for Spatial Gene Expression Predictions from Histology Images

  • 将基因表达预测转为图文问答任务,引入基因随机变量建模分布。
  • 在已知和未知基因上均超越现有方法,尤其对新基因表现更优。
  • 适合需要泛化能力的生物医学图像分析研究者使用。

基因表达谱分析揭示了分子机制的深层信息,但其耗时且成本高昂,常带来显著挑战。相比之下,全幻灯片苏木精-伊红(H&E)染色病理图像易于获取,可在显微层面详细分析组织结构与组成。近年来的研究利用这些图像预测空间分辨的基因表达谱。然而,现有方法将基因表达预测视为多输出回归问题,每个基因独立学习权重,未能捕捉基因间的共享依赖关系与共表达模式。此外,现有方法仅能预测训练中出现的基因,难以泛化至未见的新基因。为此,本文提出GeneQuery,以问答(QA)形式解决基因表达预测任务,提升泛化性与灵活性。具体而言,GeneQuery将基因相关文本作为查询,全幻灯片图像作为上下文,预测目标基因的表达值。通过此转换,GeneQuery可隐式估计基因分布。此外,提出的GeneQuery包含两种架构实现:针对图像间模式的点感知型(spot-aware)和针对基因间模式的基因感知型(gene-aware)。在空间转录组数据集上的综合实验表明,GeneQuery在已知基因和未见基因上均优于现有最先进方法。更多结果还表明,GeneQuery具备分析组织结构的潜力。

原文摘要 · Abstract (English)

Gene expression profiling provides profound insights into molecular mechanisms, but its time-consuming and costly nature often presents significant challenges. In contrast, whole-slide hematoxylin and eosin (H&E) stained histological images are readily accessible and allow for detailed examinations of tissue structure and composition at the microscopic level. Recent advancements have utilized these histological images to predict spatially resolved gene expression profiles. However, state-of-the-art works treat gene expression prediction as a multi-output regression problem, where each gene is learned independently with its own weights, failing to capture the shared dependencies and co-expression patterns between genes. Besides, existing works can only predict gene expression values for genes seen during training, limiting their ability to generalize to new, unseen genes. To address the above limitations, this paper presents GeneQuery, which aims to solve this gene expression prediction task in a question-answering (QA) manner for better generality and flexibility. Specifically, GeneQuery takes gene-related texts as queries and whole-slide images as contexts and then predicts the queried gene expression values. With such a transformation, GeneQuery can implicitly estimate the gene distribution by introducing the gene random variable. Besides, the proposed GeneQuery consists of two architecture implementations, i.e., spot-aware GeneQuery for capturing patterns between images and gene-aware GeneQuery for capturing patterns between genes. Comprehensive experiments on spatial transcriptomics datasets show that the proposed GeneQuery outperforms existing state-of-the-art methods on known and unseen genes. More results also demonstrate that GeneQuery can potentially analyze the tissue structure.

基因表达图像问答空间转录组

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。