arXiv:2507.06264eess.IVcs.AI2025-07

融合多种特征表示,提升X光图像的泛化能力

X-ray transferable polyrepresentation learning

  • 整合嵌入、自监督与放射组学等多种特征表示
  • 在小数据集上实现良好迁移性能,准确率显著提升
  • 适用于医疗影像及其他多模态数据场景

机器学习算法的成功高度依赖于有意义特征的提取,而数据表示的质量是关键。然而,从未见数据集中有效泛化并提取特征同样重要。为此,我们提出一种新概念——多表示(polyrepresentation),即整合来自不同来源的同一模态的多种表示,如孪生网络的向量嵌入、自监督模型特征和可解释的放射组学特征。相比单一表示,该方法在性能指标上表现更优。在X光图像场景中,我们验证了所构建的多表示在小规模数据集上的可迁移性,表明其在各类图像解决方案中具有实用性和资源效率。此外,该多表示概念在医学数据中的应用也可推广至其他领域,展现其广泛适用性与潜在影响。

原文摘要 · Abstract (English)

The success of machine learning algorithms is inherently related to the extraction of meaningful features, as they play a pivotal role in the performance of these algorithms. Central to this challenge is the quality of data representation. However, the ability to generalize and extract these features effectively from unseen datasets is also crucial. In light of this, we introduce a novel concept: the polyrepresentation. Polyrepresentation integrates multiple representations of the same modality extracted from distinct sources, for example, vector embeddings from the Siamese Network, self-supervised models, and interpretable radiomic features. This approach yields better performance metrics compared to relying on a single representation. Additionally, in the context of X-ray images, we demonstrate the transferability of the created polyrepresentation to a smaller dataset, underscoring its potential as a pragmatic and resource-efficient approach in various image-related solutions. It is worth noting that the concept of polyprepresentation on the example of medical data can also be applied to other domains, showcasing its versatility and broad potential impact.

多表示X光图像特征提取迁移学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。