提出新型哈希与树模型,加速百亿级数据搜索并预测癌症生存期。
Learning ON Large Datasets Using Bit-String Trees
- 用压缩倒排哈希树压缩存储,实现高速近似最近邻搜索。
- 在百亿样本上精度达0.90,速度比现有方法快4到296倍。
- 可解释基因突变影响,用于癌症患者生存预测和关键基因发现。
本论文开发了保距哈希、分类与癌症基因组学的计算方法。传统基于二叉搜索树(BST)的分治哈希因指数增长和稀疏性导致效率低下。为此,提出压缩倒排哈希树(ComBI),实现内存节省的快速近似最近邻搜索。在高达十亿样本的数据集上,ComBI达到0.90精度,较多索引哈希(Multi-Index Hashing)提速4至296倍,且在单细胞RNA-seq搜索中优于Cellfishing.jl,提升2至13倍。基于哈希结构,提出引导随机森林(GRAF),结合全局与局部划分,减少泛化误差,在115个数据集上表现优异;其无监督版本(uGRAF)支持引导哈希与重要性采样。我们证明GRAF与ComBI可用于估计样本分类能力,实现癌症患者生存率的规模化预测。为解决突变解读难题,提出连续密码子切换表示(CRCS),通过深度学习将遗传变异嵌入数值向量,无需配对正常样本即可识别体细胞突变、发现驱动基因、评分肿瘤突变,并在膀胱癌、肝癌和脑癌中验证生存预测有效性。这些方法共同提供高效、可扩展且可解释的大规模数据分析工具,适用于生物医学应用。
原文摘要 · Abstract (English)
This thesis develops computational methods in similarity-preserving hashing, classification, and cancer genomics. Standard space partitioning-based hashing relies on Binary Search Trees (BSTs), but their exponential growth and sparsity hinder efficiency. To overcome this, we introduce Compressed BST of Inverted hash tables (ComBI), which enables fast approximate nearest-neighbor search with reduced memory. On datasets of up to one billion samples, ComBI achieves 0.90 precision with 4X-296X speed-ups over Multi-Index Hashing, and also outperforms Cellfishing.jl on single-cell RNA-seq searches with 2X-13X gains. Building on hashing structures, we propose Guided Random Forest (GRAF), a tree-based ensemble classifier that integrates global and local partitioning, bridging decision trees and boosting while reducing generalization error. Across 115 datasets, GRAF delivers competitive or superior accuracy, and its unsupervised variant (uGRAF) supports guided hashing and importance sampling. We show that GRAF and ComBI can be used to estimate per-sample classifiability, which enables scalable prediction of cancer patient survival. To address challenges in interpreting mutations, we introduce Continuous Representation of Codon Switches (CRCS), a deep learning framework that embeds genetic changes into numerical vectors. CRCS allows identification of somatic mutations without matched normals, discovery of driver genes, and scoring of tumor mutations, with survival prediction validated in bladder, liver, and brain cancers. Together, these methods provide efficient, scalable, and interpretable tools for large-scale data analysis and biomedical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。