用机器学习找复杂系统描述的最优解,揭示组件如何协同形成整体结构。
Surveying the space of descriptions of a composite system with machine learning
- 将系统描述建模为有损压缩,用机器学习优化信息理论指标
- 在自旋系统、数独和自然语言中找到极值描述,揭示全局变化来源
- 适合研究复杂系统组织结构的科研人员,尤其关注信息整合机制
多变量信息论为理解复杂系统中各组件的连接关系提供了通用而严谨的框架。现有分析方法粗略且计算成本高,依赖离散子系统的表征。本文提出将复合系统的连续描述空间作为其组织结构的观察窗口。描述由各组件所传递的具体信息构成,该空间等价于对组件进行有损压缩的所有可能方案。我们引入机器学习框架,优化描述以极化关键信息理论量,如总相关性和O-信息。通过自旋系统、数独板和自然语言字母序列的案例研究,识别出能揭示系统整体变异如何从个体组件产生的极值描述。通过将机器学习融入细粒度的信息理论分析,本框架为探究真实世界复杂系统的结构开辟了新路径。
原文摘要 · Abstract (English)
Multivariate information theory provides a general and principled framework for understanding how the components of a complex system are connected. Existing analyses are coarse in nature -- built up from characterizations of discrete subsystems -- and can be computationally prohibitive. In this work, we propose to study the continuous space of possible descriptions of a composite system as a window into its organizational structure. A description consists of specific information conveyed about each of the components, and the space of possible descriptions is equivalent to the space of lossy compression schemes of the components. We introduce a machine learning framework to optimize descriptions that extremize key information theoretic quantities used to characterize organization, such as total correlation and O-information. Through case studies on spin systems, sudoku boards, and letter sequences from natural language, we identify extremal descriptions that reveal how system-wide variation emerges from individual components. By integrating machine learning into a fine-grained information theoretic analysis of composite random variables, our framework opens a new avenues for probing the structure of real-world complex systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。