arXiv:2409.12289cs.LGcs.AI2024-09中稿 · @ The 22nd Interna…被引 2

MetaPix助企业高效管理视觉数据,提升AI开发效率

MetaPix: A Data-Centric AI Development Platform for Efficient Management and Utilization of Unstructured Computer Vision Data

  • 以数据源、数据集、提取器和扩展为核心,构建全流程数据管理
  • 支持数据摄入、处理、版本控制与发现,实现可视化数据全生命周期管理
  • 适合需要统一管理海量图像数据的AI研发团队或企业

在当今先进的AI技术环境中,数据管理是任何AI/ML解决方案的关键组成部分。有效的数据管理对于创建和维护高质量、多样化的数据集至关重要,能显著提升预测能力并推动更智能的商业解决方案。本文介绍MetaPix,一个专为非结构化数据设计的数据中心型AI平台,提供涵盖数据摄入、处理、存储、版本控制、治理和发现的完整管理方案。该平台基于四大核心概念:DataSources(数据源)、Datasets(数据集)、Extensions(扩展)和Extractors(提取器)。DataSources作为顶层资产,代表特定用途的窄范围数据来源;Datasets是结构化的数据集合;Extractors是嵌入后台的内部工具,用于数据处理与增强;Extensions则支持与第三方外部工具集成,拓展平台功能。本文详细阐述了各概念,说明其如何协同实现平台目标。通过提供对非结构化计算机视觉数据的全面管理与利用方案,MetaPix为组织提供了高效开发AI应用的强大工具集。

原文摘要 · Abstract (English)

In today's world of advanced AI technologies, data management is a critical component of any AI/ML solution. Effective data management is vital for the creation and maintenance of high-quality, diverse datasets, which significantly enhance predictive capabilities and lead to smarter business solutions. In this work, we introduce MetaPix, a Data-centric AI platform offering comprehensive data management solutions specifically designed for unstructured data. MetaPix offers robust tools for data ingestion, processing, storage, versioning, governance, and discovery. The platform operates on four key concepts: DataSources, Datasets, Extensions and Extractors. A DataSource serves as MetaPix top level asset, representing a narrow-scoped source of data for a specific use. Datasets are MetaPix second level object, structured collections of data. Extractors are internal tools integrated into MetaPix's backend processing, facilitate data processing and enhancement. Additionally, MetaPix supports extensions, enabling integration with external third-party tools to enhance platform functionality. This paper delves into each MetaPix concept in detail, illustrating how they collectively contribute to the platform's objectives. By providing a comprehensive solution for managing and utilizing unstructured computer vision data, MetaPix equips organizations with a powerful toolset to develop AI applications effectively.

数据管理视觉数据AI平台

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。