arXiv:2501.08717cs.IRcs.CV2025-01

将自监督学习与层次聚类结合,自动挖掘数据的多层结构关系。

$\texttt{InfoHier}$: Hierarchical Information Extraction via Encoding and Embedding

  • 用自监督学习生成可适应的表示,支持层次聚类发现复杂结构。
  • 联合优化使表示更贴合数据内在层次关系,提升聚类效果。
  • 适合处理图像等高维复杂数据的结构化分析任务。

分析大规模数据集,尤其是图像等复杂高维数据,极具挑战性。自监督学习(SSL)虽能从无标签数据中学习有效表示,但通常仅关注扁平、非层级结构,忽略了真实数据中的多层级关系。层次聚类(HC)可通过树状结构揭示这些关系,但常依赖固定相似度度量,难以捕捉多样数据类型的复杂性。为此,我们提出 $ exttt{InfoHier}$ 框架,融合 SSL 与 HC,联合学习鲁棒的潜在表示与层次结构。该方法利用 SSL 提供自适应表示,增强 HC 对复杂模式的捕捉能力;同时引入 HC 损失反向优化 SSL 训练,使表示更契合底层信息层级。$ exttt{InfoHier}$ 有望提升聚类与表征学习的表达力与性能,为数据挖掘、管理与信息检索带来显著优势。

原文摘要 · Abstract (English)

Analyzing large-scale datasets, especially involving complex and high-dimensional data like images, is particularly challenging. While self-supervised learning (SSL) has proven effective for learning representations from unlabelled data, it typically focuses on flat, non-hierarchical structures, missing the multi-level relationships present in many real-world datasets. Hierarchical clustering (HC) can uncover these relationships by organizing data into a tree-like structure, but it often relies on rigid similarity metrics that struggle to capture the complexity of diverse data types. To address these we envision $\texttt{InfoHier}$, a framework that combines SSL with HC to jointly learn robust latent representations and hierarchical structures. This approach leverages SSL to provide adaptive representations, enhancing HC's ability to capture complex patterns. Simultaneously, it integrates HC loss to refine SSL training, resulting in representations that are more attuned to the underlying information hierarchy. $\texttt{InfoHier}$ has the potential to improve the expressiveness and performance of both clustering and representation learning, offering significant benefits for data analysis, management, and information retrieval.

自监督学习层次聚类表示学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。